Skip to content

Releases: MobileTeleSystems/etl-entities

2.4.0 (2024-11-12)

12 Nov 14:10
bd14cd5
Compare
Choose a tag to compare

Breaking Changes

  • Make KeyValueIntHWM keys strictly integers. Previously string values could be used. (#103)
  • KeyValueHWM now has 2 required generic arguments - KeyValueHWMKeyType and KeyValueHWMValueType. This allows creating own key -> value HWM types with arbitrary key type (previously it was Any). (#103)

2.3.1 (2024-08-29)

29 Aug 07:10
b611747
Compare
Choose a tag to compare

Improvements

  • Replace all assert in documentation with doctest syntax. This should make documentation more readable. (#91)

2.3.0 (2024-03-05)

05 Mar 09:35
f5b7e93
Compare
Choose a tag to compare

Breaking Changes

  • Rename HWMStoreClassRegistry.known_types to aliases (#79)

Features

  • Allow using etl-entities with both Pydantic v1 and v2. (#82)

2.2.0 (2024-01-10)

10 Jan 14:37
6a4caba
Compare
Choose a tag to compare

Breaking Changes

  • Remove cover method from base HWM class, it only remains in FileHWM class (#71)

Features

  • Improve typing:
    • Fix Pylance (VS Code) complained "SomeClass" is not exported from module "etl_entities.module". Import from "etl_entities.module.submodule" instead.
    • Mark old HWM classes with typing_extensions.deprecated decorator (#69)
  • Add KeyValueIntHWM class, designed to manage HWM for partitioned data sources like Kafka topics. It extends the functionality of the base HWM classes to handle key-value pairs. (#71)

2.1.2 (2023-12-08)

08 Dec 16:19
ac23193
Compare
Choose a tag to compare

Bug fixes

  • Fix missing default value ColumnHWM.source

2.1.1 (2023-12-08)

08 Dec 15:09
dc015f9
Compare
Choose a tag to compare

Improvements

  • Add compatibility with Python 3.12 (#62)

2.1.0 (2023-12-07)

07 Dec 12:11
21f3f9d
Compare
Choose a tag to compare

Breaking Changes

  • Drop HWM.qualified_name attribute, it is not used anymore. (#57)
  • Rename attribute ColumnHWM.column to ColumnHWM.source. This is not required anymore, and should contain table/collection/topic name instead of column.
    Use attribute ColumnHWM.expression to store column name. (#59)
  • Make attribute FileHWM.directory optional.
    All paths in FileListHWM.value are now absolute instead of relative. (#60)
  • Disallow comparison hwm < raw_value and hwm > raw_value where raw_value is a primitive type value, like int.
    This now raises TypeError. (#61)
  • Disallow passing extra fields to HWM class constructors instead of silently ignore them. (#61)

2.0.8 (2023-12-05)

05 Dec 11:00
cf6f02a
Compare
Choose a tag to compare

Features

  • Allow to pass float and Decimal values as valid input for ColumnIntHWM (but only if value does contain only 0 after decimal part). (#58)

2.0.7 (2023-12-05)

05 Dec 08:03
31cd2c1
Compare
Choose a tag to compare

Bug Fixes

  • MemoryHWMStore now stores serialized data to avoid implicit updates using hwm.update(...) method. (#56)

2.0.6 (2023-11-24)

24 Nov 09:00
82e877c
Compare
Choose a tag to compare

Features

  • Restrict passing int values in ColumnDateHWM and ColumnDatetimeHWM classes (#53)