Skip to content

[Bug]: Current Main Does Not Work On Python3.8 #6033

@robertgshaw2-redhat

Description

@robertgshaw2-redhat

Your current environment

The output of `python collect_env.py`

🐛 Describe the bug

SUMMARY:

  • Install on python 3.8
  • run from vllm import LLM
    Fails with:
  File "<string>", line 1, in <module>
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/__init__.py", line 4, in <module>
    from vllm.engine.async_llm_engine import AsyncLLMEngine
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/async_llm_engine.py", line 14, in <module>
    from vllm.engine.llm_engine import LLMEngine
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/llm_engine.py", line 18, in <module>
    from vllm.engine.output_processor.interfaces import (
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/output_processor/interfaces.py", line 10, in <module>
    from vllm.transformers_utils.detokenizer import Detokenizer
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/detokenizer.py", line 6, in <module>
    from vllm.transformers_utils.tokenizer_group.base_tokenizer_group import (
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/tokenizer_group/__init__.py", line 11, in <module>
    from vllm.transformers_utils.tokenizer_group.ray_tokenizer_group import (
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/tokenizer_group/ray_tokenizer_group.py", line 5, in <module>
    from ray.exceptions import ActorDiedError

Simple reproduction:

from ray.exceptions import ActorDiedError

Fails with:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name 'ActorDiedError' from 'ray.exceptions' (/home/rshaw/.pyenv/versions/nm-vllm-src-3.8/lib/python3.8/site-packages/ray/exceptions.py)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions