Skip to content

Commit d53575a

Browse files
authored
[ci] fix gh200 tests (#11919)
Signed-off-by: youkaichao <[email protected]>
1 parent 61af633 commit d53575a

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/model_executor/model_loader/weight_utils.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,9 @@
2929

3030
try:
3131
from runai_model_streamer import SafetensorsStreamer
32-
except ImportError:
32+
except (ImportError, OSError):
33+
# see https://github.com/run-ai/runai-model-streamer/issues/26
34+
# OSError will be raised on arm64 platform
3335
runai_model_streamer = PlaceholderModule(
3436
"runai_model_streamer") # type: ignore[assignment]
3537
SafetensorsStreamer = runai_model_streamer.placeholder_attr(

0 commit comments

Comments
 (0)