Skip to content

Dependency Conflict: dagster-sqlmesh and dlt[pyiceberg] Incompatible Due to pyarrow Version Requirements #8

@vndv

Description

@vndv

I am encountering a dependency conflict when trying to install dagster-sqlmesh alongside dlt[pyiceberg]. The issue arises due to incompatible version requirements for the pyarrow package.

No solution found when resolving dependencies:
  ╰─▶ Because only the following versions of pyarrow are available:
          pyarrow<=18.0.0
          pyarrow==18.1.0
          pyarrow==19.0.0
      and dlt[pyiceberg]==1.6.1 depends on pyarrow>=18.0.0, we can conclude that
      dlt[pyiceberg]==1.6.1 depends on pyarrow>=18.0.0.
      And because all versions of dagster-sqlmesh depend on pyarrow>=17.0.0,<18.0.0 and only
      dlt[pyiceberg]<=1.6.1 is available, we can conclude that all versions of dagster-sqlmesh and
      dlt[pyiceberg]>=1.6.1 are incompatible.
      And because your project depends on dagster-sqlmesh and dlt[pyiceberg]>=1.6.1, we can conclude
      that your project's requirements are unsatisfiable.

Expected Behavior

The dependencies should resolve successfully, allowing both dagster-sqlmesh and dlt[pyiceberg] to be installed in the same environment.

Actual Behavior

The dependency resolver fails due to incompatible pyarrow version requirements:

  • dagster-sqlmesh requires pyarrow>=17.0.0,<18.0.0.
  • dlt[pyiceberg] requires pyarrow>=18.0.0.

Environment

  • Python Version: >=3.13
  • Package Manager: uv
  • Operating System: macOS

Additional Context

This issue prevents me from using both dagster-sqlmesh and dlt[pyiceberg] in the same project. I need both packages for my workflow, and resolving this conflict is critical.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions