-
-
Notifications
You must be signed in to change notification settings - Fork 10.6k
Officially support SmolLM3 using the Transformers backend #22665
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Harry Mellor <[email protected]>
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request adds official support for the SmolLM3 model using the Transformers backend. The changes include updating the documentation to list SmolLM3 as a supported model, adding it to the model registry to enable official support via the generic Transformers wrapper, and including it in the test registry. The changes are straightforward and appear correct. I have no major concerns.
…ct#22665) Signed-off-by: Harry Mellor <[email protected]> Signed-off-by: Paul Pak <[email protected]>
…ct#22665) Signed-off-by: Harry Mellor <[email protected]> Signed-off-by: Diego-Castan <[email protected]>
…ct#22665) Signed-off-by: Harry Mellor <[email protected]>
…ct#22665) Signed-off-by: Harry Mellor <[email protected]>
…ct#22665) Signed-off-by: Harry Mellor <[email protected]> Signed-off-by: Xiao Yu <[email protected]>
…ct#22665) Signed-off-by: Harry Mellor <[email protected]>
Adds support for SmolLM3 by: