Skip to content

Conversation

jacobtomlinson
Copy link
Member

@jacobtomlinson jacobtomlinson commented Sep 10, 2025

Attempt to resolve #9110

The warning in #9110 is about a failure to parse the warning to parse the warning from pynvml FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.

This PR resolves it by following the advice of the warning and switching to the nvidia-ml-py package, rather than digging into the parsing error. We could look at this too, but this PR resolves the immediate issue.

The nvidia-ml-py package also provides the pynvml library and still uses import pynvml but is more officially maintained than the pynvml package on PyPI/conda-forge. Recent releases of pynvml just depend on nvidia-ml-py and raise this warning when imported.

  • Tests added / passed
  • Passes pre-commit run --all-files

Copy link
Contributor

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

    27 files  ±    0      27 suites  ±0   7h 9m 36s ⏱️ + 1h 43m 34s
 4 113 tests +   24   4 003 ✅ +   24    107 💤 ±  0  3 ❌ ±0 
42 440 runs  +9 927  40 607 ✅ +9 651  1 827 💤 +275  6 ❌ +1 

For more details on these failures, see this check.

Results for commit d1b3be8. ± Comparison against base commit 7024d52.

@jacobtomlinson
Copy link
Member Author

cc @jameslamb for visibility who has done a bunch of pynvml to nvidia-ml-py migrations recently

@jacobtomlinson jacobtomlinson changed the title pynvml => nvidia-ml-py in CI pynvml -> nvidia-ml-py in CI Sep 10, 2025
Copy link
Member

@jameslamb jameslamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the @, that summary is exactly right and I agree that distributed should switch to using nvidia-ml-py here in CI.

The new warning is from here: gpuopenanalytics/pynvml#62

Copy link
Member

@rjzamora rjzamora left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Recent pynvml releases are just "meta-packages" for nvidia-ml-py. So, this change makes perfect sense.

Copy link
Member

@pentschev pentschev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@jacobtomlinson
Copy link
Member Author

Merging based on high number of approvals from folks without merge rights but good expertise here. Thanks all!

@jacobtomlinson jacobtomlinson merged commit 257435b into dask:main Sep 15, 2025
26 of 34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

pynvml warning causing CI failure

4 participants