Skip to content

Commit 7770df2

Browse files
minosfuturertourgeman
authored andcommitted
Handle triton kernel import exception (vllm-project#25319)
Signed-off-by: Ming Yang <[email protected]>
1 parent 8432a5b commit 7770df2

File tree

1 file changed

+8
-3
lines changed
  • vllm/model_executor/layers/fused_moe

1 file changed

+8
-3
lines changed

vllm/model_executor/layers/fused_moe/config.py

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -14,11 +14,16 @@
1414
from vllm.utils import cdiv, has_triton_kernels
1515
from vllm.utils.flashinfer import has_flashinfer_cutlass_fused_moe
1616

17-
if has_triton_kernels():
18-
from triton_kernels.matmul_ogs import PrecisionConfig
19-
2017
logger = init_logger(__name__)
2118

19+
if has_triton_kernels():
20+
try:
21+
from triton_kernels.matmul_ogs import PrecisionConfig
22+
except ImportError:
23+
logger.error(
24+
"Failed to import Triton kernels. Please make sure your triton "
25+
"version is compatible.")
26+
2227

2328
def _get_config_dtype_str(
2429
dtype: torch.dtype,

0 commit comments

Comments
 (0)