-
Notifications
You must be signed in to change notification settings - Fork 9
Closed
Description
I am encountering a dependency conflict when trying to install dagster-sqlmesh alongside dlt[pyiceberg]. The issue arises due to incompatible version requirements for the pyarrow package.
No solution found when resolving dependencies:
╰─▶ Because only the following versions of pyarrow are available:
pyarrow<=18.0.0
pyarrow==18.1.0
pyarrow==19.0.0
and dlt[pyiceberg]==1.6.1 depends on pyarrow>=18.0.0, we can conclude that
dlt[pyiceberg]==1.6.1 depends on pyarrow>=18.0.0.
And because all versions of dagster-sqlmesh depend on pyarrow>=17.0.0,<18.0.0 and only
dlt[pyiceberg]<=1.6.1 is available, we can conclude that all versions of dagster-sqlmesh and
dlt[pyiceberg]>=1.6.1 are incompatible.
And because your project depends on dagster-sqlmesh and dlt[pyiceberg]>=1.6.1, we can conclude
that your project's requirements are unsatisfiable.
Expected Behavior
The dependencies should resolve successfully, allowing both dagster-sqlmesh and dlt[pyiceberg] to be installed in the same environment.
Actual Behavior
The dependency resolver fails due to incompatible pyarrow version requirements:
- dagster-sqlmesh requires pyarrow>=17.0.0,<18.0.0.
- dlt[pyiceberg] requires pyarrow>=18.0.0.
Environment
- Python Version: >=3.13
- Package Manager: uv
- Operating System: macOS
Additional Context
This issue prevents me from using both dagster-sqlmesh and dlt[pyiceberg] in the same project. I need both packages for my workflow, and resolving this conflict is critical.
Metadata
Metadata
Assignees
Labels
No labels