Skip to content

Commit 487678d

Browse files
authored
[Bugfix][Hardware][CPU] Fix CPU model input for decode (#9044)
1 parent cb3b2b9 commit 487678d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/worker/cpu_model_runner.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -133,7 +133,7 @@ def build(self) -> ModelInputForCPU:
133133
(input_tokens, input_positions,
134134
attn_metadata) = self._prepare_decode(
135135
self.seq_group_metadata_list)
136-
seq_lens = []
136+
seq_lens = None
137137

138138
return self.model_input_cls(
139139
input_tokens=input_tokens,

0 commit comments

Comments
 (0)