Skip to content

Commit 331d526

Browse files
minosfuturechoprahetarth
authored andcommitted
Handle triton kernel import exception (vllm-project#25319)
Signed-off-by: Ming Yang <[email protected]>
1 parent 407839b commit 331d526

File tree

1 file changed

+8
-3
lines changed
  • vllm/model_executor/layers/fused_moe

1 file changed

+8
-3
lines changed

vllm/model_executor/layers/fused_moe/config.py

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -14,11 +14,16 @@
1414
from vllm.utils import cdiv, has_triton_kernels
1515
from vllm.utils.flashinfer import has_flashinfer_cutlass_fused_moe
1616

17-
if has_triton_kernels():
18-
from triton_kernels.matmul_ogs import PrecisionConfig
19-
2017
logger = init_logger(__name__)
2118

19+
if has_triton_kernels():
20+
try:
21+
from triton_kernels.matmul_ogs import PrecisionConfig
22+
except ImportError:
23+
logger.error(
24+
"Failed to import Triton kernels. Please make sure your triton "
25+
"version is compatible.")
26+
2227

2328
def _get_config_dtype_str(
2429
dtype: torch.dtype,

0 commit comments

Comments
 (0)