[New Model]: Jamba (MoE Mamba from AI21)

[creatorrr]

The model to consider.

https://huggingface.co/ai21labs/Jamba-v0.1

The closest model vllm already supports.

No response

What's your difficulty of supporting the model you want?

Jamba is a new model and interesting hybrid architecture MoE Mamba model that look very promising.

https://www.ai21.com/blog/announcing-jamba

[Playerrrrr]

pretty please

[drewskidang]

Plsss

[creatorrr]

Jamba is a really interesting model. It’s an MoE+Transformer+Mamba hybrid so I’m not sure how that would work with vllm. I’d love to add support for it.

thoughts / pointers? @WoosukKwon @zhuohan123

[mzusman]

#4115

[DarkLight1337]

Closed as completed by #4115.