diff --git a/docs/source/models/supported_models.md b/docs/source/models/supported_models.md index ff28fde5b7ff..1fde1761672e 100644 --- a/docs/source/models/supported_models.md +++ b/docs/source/models/supported_models.md @@ -59,6 +59,10 @@ llm.apply_model(lambda model: print(type(model))) If it is `TransformersModel` then it means it's based on Transformers! +:::{tip} +You can force the use of `TransformersModel` by setting `model_impl="transformers"` for or `--model-impl transformers` for the . +::: + :::{note} vLLM may not fully optimise the Transformers implementation so you may see degraded performance if comparing a native model to a Transformers model in vLLM. :::