For multi-modal models to work after (but not including) vLLM v0.11.0, you need to update the model runner according to https://github.com/vllm-project/vllm/pull/16229