Skip to content

jberkhahn/filesystem_resolver

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Filesystem Resolver

This is a vLLM general plugin for dynamically discovered LoRA adapters from a local directory. To use, set VLLM_PLUGIN_LORA_CACHE_DIR to a local directory. When vLLM receives a request for a LoRA adapter foobar it doesn't currently recognize, it will look in that local directory for a subdirectory foobar containing a LoRA adapter. If such an adapter exists, it will load that adapter, and then service the request as normal. That adapter will then be available for future requests as normal.

Testing

HF_TOKEN must be set for the tests to run.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages