-
-
Notifications
You must be signed in to change notification settings - Fork 10.6k
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Your current environment
The output of `python collect_env.py`
🐛 Describe the bug
SUMMARY:
- Install on python 3.8
- run
from vllm import LLM
Fails with:
File "<string>", line 1, in <module>
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/__init__.py", line 4, in <module>
from vllm.engine.async_llm_engine import AsyncLLMEngine
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/async_llm_engine.py", line 14, in <module>
from vllm.engine.llm_engine import LLMEngine
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/llm_engine.py", line 18, in <module>
from vllm.engine.output_processor.interfaces import (
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/output_processor/interfaces.py", line 10, in <module>
from vllm.transformers_utils.detokenizer import Detokenizer
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/detokenizer.py", line 6, in <module>
from vllm.transformers_utils.tokenizer_group.base_tokenizer_group import (
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/tokenizer_group/__init__.py", line 11, in <module>
from vllm.transformers_utils.tokenizer_group.ray_tokenizer_group import (
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/tokenizer_group/ray_tokenizer_group.py", line 5, in <module>
from ray.exceptions import ActorDiedError
Simple reproduction:
from ray.exceptions import ActorDiedError
Fails with:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
ImportError: cannot import name 'ActorDiedError' from 'ray.exceptions' (/home/rshaw/.pyenv/versions/nm-vllm-src-3.8/lib/python3.8/site-packages/ray/exceptions.py)
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working