[New Model]: Issac 0.1

[ywang96]

The model to consider.

Support https://huggingface.co/PerceptronAI/Isaac-0.1 on vLLM

The closest model vllm already supports.

No response

What's your difficulty of supporting the model you want?

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[ZJY0516]

/assign

[Isotr0py]

@ZJY0516 Note that this model is potentially already compatible with existing Transformers backend, if so, we should simply use that. We should only bring this into vLLM when Transformers backend incompatible.

[oscardev256]

I tried checking compatibility with the Transformers backend using the example in https://docs.vllm.ai/en/latest/models/supported_models.html#transformers

For Isaac 0.1, I modified the template as follows:

!pip install perceptron
from vllm import LLM
model = "PerceptronAI/Isaac-0.1"
llm = LLM(model=model, trust_remote_code=True)
llm.apply_model(lambda model: print(type(model)))

That failed with:
(EngineCore_DP0 pid=16135) ValueError: Unrecognized configuration class <class 'transformers_modules.PerceptronAI.Isaac-0.1.c10d94a331170196df683cbda65ca16b6ac96766.modular_isaac.IsaacConfig'> for this kind of AutoModel: AutoModel.

So it looks like the model isn't currently compatible with the Transformers backend and needs to be brought over to vLLM. Open to collaborating on porting this model.

vLLM versions attempted:

• 0.10.2
• 0.11.0rc2.dev97+g5db1870bb