Skip to content

[Bug] 部署internvl2.5-38b-mpo-awq的时候,报错怎么回事? #3805

@lmingze

Description

@lmingze

Checklist

  • 1. I have searched related issues but cannot get the expected help.
  • 2. The bug has not been fixed in the latest version.
  • 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug

Traceback (most recent call last):
File "/data3/mingze/miniforge3/envs/eric/bin/lmdeploy", line 8, in
sys.exit(run())
^^^^^
File "/data3/mingze/miniforge3/envs/eric/lib/python3.12/site-packages/lmdeploy/cli/entrypoint.py", line 31, in run
args.model_path = get_model(args.model_path, download_dir=download_dir, revision=revision)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data3/mingze/miniforge3/envs/eric/lib/python3.12/site-packages/lmdeploy/utils.py", line 218, in get_model
model_path = snapshot_download(pretrained_model_name_or_path, ignore_patterns=['*.pth'], **download_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data3/mingze/miniforge3/envs/eric/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
validate_repo_id(arg_value)
File "/data3/mingze/miniforge3/envs/eric/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
raise HFValidationError(
huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/home/li_mingze/models/OpenGVLab/InternVL2_5-38B-MPO-AWQ'. Use repo_type argument if needed.

Reproduction

python是3.12

Environment

Package                           Version
--------------------------------- -------------
accelerate                        1.9.0
addict                            2.4.0
aiohappyeyeballs                  2.6.1
aiohttp                           3.12.14
aiosignal                         1.4.0
airportsdata                      20250706
annotated-types                   0.7.0
anyio                             4.9.0
astor                             0.8.1
attrs                             25.3.0
av                                15.0.0
blake3                            1.0.5
cachetools                        6.1.0
cbor2                             5.6.5
certifi                           2025.7.14
cffi                              1.17.1
charset-normalizer                3.4.2
click                             8.2.1
cloudpickle                       3.1.1
compressed-tensors                0.10.2
cupy-cuda12x                      13.5.1
depyf                             0.19.0
dill                              0.4.0
diskcache                         5.6.3
distro                            1.9.0
dnspython                         2.7.0
einops                            0.8.1
email_validator                   2.2.0
et_xmlfile                        2.0.0
fastapi                           0.116.1
fastapi-cli                       0.0.8
fastapi-cloud-cli                 0.1.4
fastrlock                         0.8.3
filelock                          3.18.0
fire                              0.7.0
frozenlist                        1.7.0
fsspec                            2025.7.0
genson                            1.3.0
gguf                              0.17.1
h11                               0.16.0
hf-xet                            1.1.5
httpcore                          1.0.9
httptools                         0.6.4
httpx                             0.28.1
huggingface-hub                   0.34.0
idna                              3.10
interegular                       0.3.3
iso3166                           2.1.1
Jinja2                            3.1.6
jiter                             0.10.0
jsonpath-ng                       1.7.0
jsonschema                        4.25.0
jsonschema-specifications         2025.4.1
lark                              1.2.2
llguidance                        0.7.30
llvmlite                          0.44.0
lm-format-enforcer                0.10.11
lmdeploy                          0.9.2
markdown-it-py                    3.0.0
MarkupSafe                        3.0.2
mdurl                             0.1.2
mistral_common                    1.8.2
mmengine-lite                     0.10.7
modelscope                        1.28.1
mpmath                            1.3.0
msgpack                           1.1.1
msgspec                           0.19.0
multidict                         6.6.3
nest-asyncio                      1.6.0
networkx                          3.5
ninja                             1.11.1.4
numba                             0.61.2
numpy                             1.26.4
nvidia-cublas-cu12                12.6.4.1
nvidia-cuda-cupti-cu12            12.6.80
nvidia-cuda-nvrtc-cu12            12.6.77
nvidia-cuda-runtime-cu12          12.6.77
nvidia-cudnn-cu12                 9.5.1.17
nvidia-cufft-cu12                 11.3.0.4
nvidia-cufile-cu12                1.11.1.6
nvidia-curand-cu12                10.3.7.77
nvidia-cusolver-cu12              11.7.1.2
nvidia-cusparse-cu12              12.5.4.2
nvidia-cusparselt-cu12            0.6.3
nvidia-ml-py                      12.575.51
nvidia-nccl-cu12                  2.26.2
nvidia-nvjitlink-cu12             12.6.85
nvidia-nvtx-cu12                  12.6.77
nvitop                            1.5.2
openai                            1.90.0
opencv-python-headless            4.12.0.88
openpyxl                          3.1.5
outlines                          1.1.1
outlines_core                     0.1.26
packaging                         25.0
pandas                            2.3.1
partial-json-parser               0.2.1.1.post6
peft                              0.14.0
pillow                            11.3.0
pip                               25.1.1
platformdirs                      4.3.8
ply                               3.11
prometheus_client                 0.22.1
prometheus-fastapi-instrumentator 7.1.0
propcache                         0.3.2
protobuf                          6.31.1
psutil                            7.0.0
py-cpuinfo                        9.0.0
pybase64                          1.4.1
pycountry                         24.6.1
pycparser                         2.22
pydantic                          2.11.7
pydantic_core                     2.33.2
pydantic-extra-types              2.10.5
Pygments                          2.19.2
pynvml                            12.0.0
python-dateutil                   2.9.0.post0
python-dotenv                     1.1.1
python-json-logger                3.3.0
python-multipart                  0.0.20
pytz                              2025.2
PyYAML                            6.0.2
pyzmq                             27.0.0
qwen-vl-utils                     0.0.11
ray                               2.48.0
referencing                       0.36.2
regex                             2024.11.6
requests                          2.32.4
rich                              14.1.0
rich-toolkit                      0.14.8
rignore                           0.6.4
rpds-py                           0.26.0
safetensors                       0.5.3
scipy                             1.16.0
sentencepiece                     0.2.0
sentry-sdk                        2.33.2
setuptools                        79.0.1
shellingham                       1.5.4
shortuuid                         1.0.13
six                               1.17.0
sniffio                           1.3.1
soundfile                         0.13.1
soxr                              0.5.0.post1
starlette                         0.47.2
sympy                             1.14.0
termcolor                         3.1.0
tiktoken                          0.9.0
timm                              1.0.19
tokenizers                        0.21.2
torch                             2.7.1
torchaudio                        2.7.1
torchvision                       0.22.1
tqdm                              4.67.1
transformers                      4.53.3
triton                            3.3.1
typer                             0.16.0
typing_extensions                 4.14.1
typing-inspection                 0.4.1
tzdata                            2025.2
urllib3                           2.5.0
uvicorn                           0.35.0
uvloop                            0.21.0
vllm                              0.10.0
watchfiles                        1.1.0
websockets                        15.0.1
wheel                             0.45.1
xformers                          0.0.31
xgrammar                          0.1.21
yapf                              0.43.0
yarl                              1.20.1

Error traceback

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions