Skip to content

Conversation

RedHitMark
Copy link
Contributor

Inspired by #127 and #130 prs by @sven-knoblauch I have fixed the lora (currently bugged as stated in #162 issue) and multi lora support.

In addition, I have updated the README.md with the LORA_MODULES env var.

@Cloakless
Copy link

Cloakless commented May 12, 2025

Can this be merged? Hotfixing my containers to hack lora support is a pain

@paulwoodward
Copy link

+1 for merge

@ozziek
Copy link

ozziek commented May 14, 2025

Had a similar problem, ended up forking and patching with this commit (which seems to be working great!)

My fork and the associated container in case its helpful to anyone: https://github.com/kirkbyo/worker-vllm

@pandyamarut pandyamarut merged commit 23e8ecf into runpod-workers:main May 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants