Introduce Backend Interface (DatabricksClient)#573

Merged

varun-edachali-dbx merged 149 commits intosea-migrationfrom

backend-interface

May 30, 2025

Commits on May 28, 2025

move py.typed to correct places (#403)

authored and
varun-edachali-dbx
committed
Upgrade mypy (#406)

wyattscarpenter
authored and
varun-edachali-dbx
committed
Do not retry failing requests with status code 401 (#408)

Hodnebo
authored and
varun-edachali-dbx
committed
[PECO-1715] Remove username/password (BasicAuth) auth option (#409)

jackyhu-db
authored and
varun-edachali-dbx
committed
[PECO-1751] Refactor CloudFetch downloader: handle files sequentially (#405)

kravets-levko
authored and
varun-edachali-dbx
committed
Fix CloudFetch retry policy to be compatible with all `urllib3` versions we support (#412)

kravets-levko
authored and
varun-edachali-dbx
committed
Disable SSL verification for CloudFetch links (#414)

kravets-levko
authored and
varun-edachali-dbx
committed
Prepare relese 3.3.0 (#415)

kravets-levko
authored and
varun-edachali-dbx
committed
Fix pandas 2.2.2 support (#416)

authored and
varun-edachali-dbx
committed
[PECO-1801] Make OAuth as the default authenticator if no authentication setting is provided (#419)

jackyhu-db
authored and
varun-edachali-dbx
committed
[PECO-1857] Use SSL options with HTTPS connection pool (#425)

kravets-levko
authored and
varun-edachali-dbx
committed
Prepare release v3.4.0 (#430)

kravets-levko
authored and
varun-edachali-dbx
committed
[PECO-1926] Create a non pyarrow flow to handle small results for the column set (#440)

jprakash-db
authored and
varun-edachali-dbx
committed
[PECO-1961] On non-retryable error, ensure PySQL includes useful information in error (#447)

shivam2680
authored and
varun-edachali-dbx
committed
Reformatted all the files using black (#448)

jprakash-db
authored and
varun-edachali-dbx
committed
Prepare release v3.5.0 (#457)

jackyhu-db
authored and
varun-edachali-dbx
committed
[PECO-2051] Add custom auth headers into cloud fetch request (#460)

jackyhu-db
authored and
varun-edachali-dbx
committed
Prepare release 3.6.0 (#461)

jackyhu-db
authored and
varun-edachali-dbx
committed
[ PECO - 1768 ] PySQL: adjust HTTP retry logic to align with Go and Nodejs drivers (#467)

jprakash-db
authored and
varun-edachali-dbx
committed
[ PECO-2065 ] Create the async execution flow for the PySQL Connector (#463)

jprakash-db
authored and
varun-edachali-dbx
committed
Fix for check_types github action failing (#472)

jprakash-db
authored and
varun-edachali-dbx
committed
Remove upper caps on dependencies (#452)

arredond
authored and
varun-edachali-dbx
committed
Updated the doc to specify native parameters in PUT operation is not supported from >=3.x connector (#477)

jprakash-db
authored and
varun-edachali-dbx
committed
Incorrect rows in inline fetch result (#479)

jprakash-db
authored and
varun-edachali-dbx
committed
Bumped up to version 3.7.0 (#482)

jprakash-db
authored and
varun-edachali-dbx
committed
PySQL Connector split into connector and sqlalchemy (#444)

authored and
varun-edachali-dbx
committed
Removed CI CD for python3.8 (#490)

jprakash-db
authored and
varun-edachali-dbx
committed
Added CI CD upto python 3.12 (#491)

jprakash-db
authored and
varun-edachali-dbx
committed
Merging changes from v3.7.1 release (#488)

jprakash-db
authored and
varun-edachali-dbx
committed
Bumped up to version 4.0.0 (#493)

jprakash-db
authored and
varun-edachali-dbx
committed
Updated action's version (#455)

newwingbird
authored and
varun-edachali-dbx
committed
Support Python 3.13 and update deps (#510)

authored and
varun-edachali-dbx
committed
Improve debugging + fix PR review template (#514)

samikshya-db
authored and
varun-edachali-dbx
committed
Forward porting all changes into 4.x.x. uptil v3.7.3 (#529)

jprakash-db
authored and
varun-edachali-dbx
committed
Updated the actions/cache version (#532)

jprakash-db
authored and
varun-edachali-dbx
committed
Updated the CODEOWNERS (#531)

jprakash-db
authored and
varun-edachali-dbx
committed
Add version check for urllib3 in backoff calculation (#526)

shivam2680
authored and
varun-edachali-dbx
committed
[ES-1372353] make user_agent_header part of public API (#530)

shivam2680
authored and
varun-edachali-dbx
committed
Updates runner used to run DCO check to use databricks-protected-runner (#521)

madhav-db
authored and
varun-edachali-dbx
committed
Support multiple timestamp formats in non arrow flow (#533)

jprakash-db
authored and
varun-edachali-dbx
committed
prepare release for v4.0.1 (#534)

shivam2680
authored and
varun-edachali-dbx
committed
Relaxed bound for python-dateutil (#538)

jprakash-db
authored and
varun-edachali-dbx
committed
Bumped up the version for 4.0.2 (#539)

jprakash-db
authored and
varun-edachali-dbx
committed
Added example for async execute query (#537)

jprakash-db
authored and
varun-edachali-dbx
committed
Added urllib3 version check (#547)

jprakash-db
authored and
varun-edachali-dbx
committed
Bump version to 4.0.3 (#549)

jprakash-db
authored and
varun-edachali-dbx
committed
Cleanup fields as they might be deprecated/removed/change in the future (#553)

vikrantpuppala
authored and
varun-edachali-dbx
committed
Refactor decimal conversion in PyArrow tables to use direct casting (#544)

jayantsing-db
authored and
varun-edachali-dbx
committed
[PECOBLR-361] convert column table to arrow if arrow present (#551)

shivam2680
authored and
varun-edachali-dbx
committed
decouple session class from existing Connection
varun-edachali-dbx
committed
add open property to Connection to ensure maintenance of existing API
varun-edachali-dbx
committed
update unit tests to address ThriftBackend through session instead of through Connection
varun-edachali-dbx
committed
chore: move session specific tests from test_client to test_session
varun-edachali-dbx
committed
formatting (black)
varun-edachali-dbx
committed
use connection open property instead of long chain through session
varun-edachali-dbx
committed
trigger integration workflow
varun-edachali-dbx
committed
fix: ensure open attribute of Connection never fails
varun-edachali-dbx
committed
introduce databricksClient interface and thrift backend implementation
varun-edachali-dbx
committed
change names of ThriftBackend -> ThriftDatabricksClient in tests
varun-edachali-dbx
committed
fix: remove excess debug log
varun-edachali-dbx
committed
fix: replace thrift_backend with backend in result set param
varun-edachali-dbx
committed
fix: replace module replacement with concrete mock instance in executemany test
varun-edachali-dbx
committed
formatting: black + re-organise backend into new dir
varun-edachali-dbx
committed
fix: sql.thrift_backend -> sql.backend.thrift_backend in tests and examples
varun-edachali-dbx
committed
Update CODEOWNERS (#562)

jprakash-db
authored and
varun-edachali-dbx
committed
Enhance Cursor close handling and context manager exception management to prevent server side resource leaks (#554)

madhav-db
authored and
varun-edachali-dbx
committed
PECOBLR-86 improve logging on python driver (#556)

saishreeeee
authored and
varun-edachali-dbx
committed
Update github actions run conditions (#569)

jprakash-db
authored and
varun-edachali-dbx
committed
remove un-necessary example change
varun-edachali-dbx
committed
[empty commit] trigger integration tests
varun-edachali-dbx
committed
fix: use backend in Cursor, not thrift_backend
varun-edachali-dbx
committed
fix: backend references in integration tests
varun-edachali-dbx
committed
fix: thrift_backend -> backend in ResultSet reference in e2e test
varun-edachali-dbx
committed
introduce normalised sessionId and CommandId for (near) complete backend abstraction
varun-edachali-dbx
committed
fix: Any is not defined
varun-edachali-dbx
committed
fix: get_session_id_hex() is not defined
varun-edachali-dbx
committed
command_handle -> command_id in ExecuteResponse
varun-edachali-dbx
committed
fix: active op handle -> active command id in Cursor
varun-edachali-dbx
committed
fixed (most) tests by accounting for normalised Session interface
varun-edachali-dbx
committed
fix: convert command id to operationHandle in status_request
varun-edachali-dbx
committed
decouple session class from existing Connection
varun-edachali-dbx
committed
add open property to Connection to ensure maintenance of existing API
varun-edachali-dbx
committed
formatting (black)
varun-edachali-dbx
committed
use connection open property instead of long chain through session
varun-edachali-dbx
committed
trigger integration workflow
varun-edachali-dbx
committed
fix: ensure open attribute of Connection never fails
varun-edachali-dbx
committed
fix: de-complicate earlier connection open logic
varun-edachali-dbx
committed
Revert "fix: de-complicate earlier connection open logic"
varun-edachali-dbx
committed
[empty commit] attempt to trigger ci e2e workflow
varun-edachali-dbx
committed
PECOBLR-86 improve logging on python driver (#556)

saishreeeee
authored and
varun-edachali-dbx
committed
Revert "Merge remote-tracking branch 'upstream/sea-migration' into decouple-session"
varun-edachali-dbx
committed
Reapply "Merge remote-tracking branch 'upstream/sea-migration' into decouple-session"
varun-edachali-dbx
committed
fix: separate session opening logic from instantiation
varun-edachali-dbx
committed
chore: use get_handle() instead of private session attribute in client
varun-edachali-dbx
committed
fix: remove accidentally removed assertions
varun-edachali-dbx
committed
generalise open session, fix session tests to consider positional args
varun-edachali-dbx
committed
formatting (black)
varun-edachali-dbx
committed
correct session logic after duplication during merge
varun-edachali-dbx
committed
args -> kwargs in tests
varun-edachali-dbx
committed
delegate protocol version to SessionId
varun-edachali-dbx
committed
ids -> backend/types
varun-edachali-dbx
committed
update open session with normalised SessionId
varun-edachali-dbx
committed
Merging changes from v3.7.1 release (#488)

jprakash-db
authored and
varun-edachali-dbx
committed
Support Python 3.13 and update deps (#510)

authored and
varun-edachali-dbx
committed
Updated the actions/cache version (#532)

jprakash-db
authored and
varun-edachali-dbx
committed
Add version check for urllib3 in backoff calculation (#526)

shivam2680
authored and
varun-edachali-dbx
committed
Support multiple timestamp formats in non arrow flow (#533)

jprakash-db
authored and
varun-edachali-dbx
committed
Added example for async execute query (#537)

jprakash-db
authored and
varun-edachali-dbx
committed
Added urllib3 version check (#547)

jprakash-db
authored and
varun-edachali-dbx
committed
decouple session class from existing Connection
varun-edachali-dbx
committed
formatting (black)
varun-edachali-dbx
committed
use connection open property instead of long chain through session
varun-edachali-dbx
committed
trigger integration workflow
varun-edachali-dbx
committed
fix: ensure open attribute of Connection never fails
varun-edachali-dbx
committed
Revert "fix: de-complicate earlier connection open logic"
varun-edachali-dbx
committed
[empty commit] attempt to trigger ci e2e workflow
varun-edachali-dbx
committed
PECOBLR-86 improve logging on python driver (#556)

saishreeeee
authored and
varun-edachali-dbx
committed
Revert "Merge remote-tracking branch 'upstream/sea-migration' into decouple-session"
varun-edachali-dbx
committed
Reapply "Merge remote-tracking branch 'upstream/sea-migration' into decouple-session"
varun-edachali-dbx
committed
fix: separate session opening logic from instantiation
varun-edachali-dbx
committed
Enhance Cursor close handling and context manager exception management to prevent server side resource leaks (#554)

madhav-db
authored and
varun-edachali-dbx
committed
PECOBLR-86 improve logging on python driver (#556)

saishreeeee
authored and
varun-edachali-dbx
committed
New Complex type test table + Github Action changes (#575)

jprakash-db
authored and
varun-edachali-dbx
committed
remove excess logs, assertions, instantiations
varun-edachali-dbx
committed
Merge remote-tracking branch 'origin/sea-migration' into backend-interface
varun-edachali-dbx
committed
formatting (black) + remove excess log (merge artifact)
varun-edachali-dbx
committed
fix typing
varun-edachali-dbx
committed
remove un-necessary check
varun-edachali-dbx
committed
remove un-necessary replace call
varun-edachali-dbx
committed
introduce __str__ methods for CommandId and SessionId
varun-edachali-dbx
committed

Commits on May 29, 2025

docstrings for DatabricksClient interface
varun-edachali-dbx
committed
stronger typing of Cursor and ExecuteResponse
varun-edachali-dbx
committed
remove utility functions from backend interface, fix circular import
varun-edachali-dbx
committed
rename info to properties
varun-edachali-dbx
committed
newline for cleanliness
varun-edachali-dbx
committed
fix circular import
varun-edachali-dbx
committed
formatting (black)
varun-edachali-dbx
committed
to_hex_id -> get_hex_id
varun-edachali-dbx
committed
better comment on protocol version getter
varun-edachali-dbx
committed
formatting (black)
varun-edachali-dbx
committed
move guid to hex id to new utils module
varun-edachali-dbx
committed
formatting (black)
varun-edachali-dbx
committed
move staging allowed local path to connection props
varun-edachali-dbx
committed

Introduce Backend Interface (DatabricksClient)#573varun-edachali-dbx merged 149 commits intosea-migrationdatabricks/databricks-sql-python:sea-migrationfrom backend-interfacedatabricks/databricks-sql-python:backend-interfaceCopy head branch name to clipboard

Commits

Commits on May 28, 2025

Commits on May 29, 2025

Introduce Backend Interface (DatabricksClient)#573
varun-edachali-dbx merged 149 commits intosea-migrationfrom
backend-interface