Skip to content

Commit b69bdbd

Browse files
lazebnyioctavia-squidington-iii
andauthored
feat(low-code cdk): add transform_before_filtering to partition router schema (#413)
Co-authored-by: octavia-squidington-iii <[email protected]>
1 parent 80a1e0f commit b69bdbd

File tree

3 files changed

+11
-1
lines changed

3 files changed

+11
-1
lines changed

airbyte_cdk/sources/declarative/declarative_component_schema.yaml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3008,6 +3008,10 @@ definitions:
30083008
- "$ref": "#/definitions/SchemaNormalization"
30093009
- "$ref": "#/definitions/CustomSchemaNormalization"
30103010
default: None
3011+
transform_before_filtering:
3012+
description: If true, transformation will be applied before record filtering.
3013+
type: boolean
3014+
default: false
30113015
$parameters:
30123016
type: object
30133017
additionalProperties: true

airbyte_cdk/sources/declarative/models/declarative_component_schema.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1786,6 +1786,10 @@ class RecordSelector(BaseModel):
17861786
description="Responsible for normalization according to the schema.",
17871787
title="Schema Normalization",
17881788
)
1789+
transform_before_filtering: Optional[bool] = Field(
1790+
False,
1791+
description="If true, transformation will be applied before record filtering.",
1792+
)
17891793
parameters: Optional[Dict[str, Any]] = Field(None, alias="$parameters")
17901794

17911795

airbyte_cdk/sources/declarative/parsers/model_to_component_factory.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2598,7 +2598,9 @@ def create_record_selector(
25982598
else None
25992599
)
26002600

2601-
transform_before_filtering = False
2601+
assert model.transform_before_filtering is not None # for mypy
2602+
2603+
transform_before_filtering = model.transform_before_filtering
26022604
if client_side_incremental_sync:
26032605
record_filter = ClientSideIncrementalRecordFilterDecorator(
26042606
config=config,

0 commit comments

Comments
 (0)