Skip to content

Support for Databricks profiles #858

@ralphkootker

Description

@ralphkootker

Datacontract import from Unity Catalog now only supports HOST & TOKEN:
https://github.com/datacontract/datacontract-cli?tab=readme-ov-file#environment-variables-6

However use of tokens for databricks in discouraged.
Instead, we make use of the Databricks-CLI with PROFILES:
https://databricks-sdk-py.readthedocs.io/en/latest/authentication.html#overriding-databrickscfg

Would be great if the datacontracts-cli will support the use of PROFILES here:
https://github.com/datacontract/datacontract-cli/blob/main/datacontract/imports/unity_importer.py#L107

from databricks.sdk import WorkspaceClient
w = WorkspaceClient(profile='MYPROFILE')
# Now call the Databricks workspace APIs as desired...

This way, we can use various auth types such as the "databricks-cli" and the "azure-cli" as well as use of TOKENS or SERVICE PRINCIPALS (client_id/secret).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions