Skip to content

Commit 7675e30

Browse files
WoosukKwonjimpang
authored andcommitted
[Bugfix][Neuron] Fix soft prompt method error in NeuronExecutor (vllm-project#6313)
1 parent 8885b8b commit 7675e30

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

vllm/executor/neuron_executor.py

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -70,6 +70,22 @@ def pin_lora(self, lora_id: int) -> bool:
7070
def list_loras(self) -> Set[int]:
7171
return self.driver_worker.list_loras()
7272

73+
def add_prompt_adapter(self, prompt_adapter_request) -> bool:
74+
raise NotImplementedError(
75+
"Soft prompt is currently not supported by the Neuron backend.")
76+
77+
def remove_prompt_adapter(self, prompt_adapter_id: int) -> bool:
78+
raise NotImplementedError(
79+
"Soft prompt is currently not supported by the Neuron backend.")
80+
81+
def pin_prompt_adapter(self, prompt_adapter_id: int) -> bool:
82+
raise NotImplementedError(
83+
"Soft prompt is currently not supported by the Neuron backend.")
84+
85+
def list_prompt_adapters(self) -> Set[int]:
86+
raise NotImplementedError(
87+
"Soft prompt is currently not supported by the Neuron backend.")
88+
7389
def check_health(self) -> None:
7490
# NeuronExecutor will always be healthy as long as
7591
# it's running.

0 commit comments

Comments
 (0)