-
-
Notifications
You must be signed in to change notification settings - Fork 11.8k
Fix lora tests failure in TPU CI due to the removal of LoRA bias #26723
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix lora tests failure in TPU CI due to the removal of LoRA bias #26723
Conversation
Signed-off-by: Xiongfei Wei <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request addresses a failure in the lora_test on TPU within the vLLM project, which was introduced by a recent pull request. The fix involves removing the bias argument from the _original_set_lora call in vllm/v1/worker/tpu_model_runner.py. This change is intended to resolve the TPU CI failure.
Signed-off-by: Xiongfei Wei <[email protected]>
yaochengji
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks for the fix!
|
Thank you for this fixing |
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]> Signed-off-by: 1994 <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]> Signed-off-by: Dhruvil Bhatt <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]> Signed-off-by: bbartels <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]> Signed-off-by: xuebwang-amd <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]> Signed-off-by: xuebwang-amd <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]> Signed-off-by: 0xrushi <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]> Signed-off-by: 0xrushi <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]>
…m-project#26723) Signed-off-by: Xiongfei Wei <[email protected]>
Purpose
#25807 seems to break the lora_test on TPU in vLLM. Here is the CI result. This PR intends to fix the TPU CI failure.
cc @ashwin-phadke @jeejeelee @yaochengji
Test Plan
TPU CI
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.