-
-
Notifications
You must be signed in to change notification settings - Fork 11.5k
[Build] Update Xgrammar to 0.1.25 #25467
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Build] Update Xgrammar to 0.1.25 #25467
Conversation
Signed-off-by: chaunceyjiang <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request updates the xgrammar dependency to version 0.1.25 and adapts the codebase to the new API. The changes in vllm/v1/structured_output/backend_xgrammar.py correctly use xgr.StructuralTag.from_legacy_structural_tag to create a StructuralTag object, which is now required by the updated library functions. The changes are straightforward, necessary for the version bump, and appear correct. I have no further comments.
Signed-off-by: chaunceyjiang <[email protected]>
Signed-off-by: chaunceyjiang <[email protected]>
) Signed-off-by: chaunceyjiang <[email protected]> Co-authored-by: Chauncey <[email protected]>
Signed-off-by: chaunceyjiang <[email protected]> Signed-off-by: yewentao256 <[email protected]>
Signed-off-by: chaunceyjiang <[email protected]> Signed-off-by: gaojc <[email protected]>
Signed-off-by: chaunceyjiang <[email protected]> Signed-off-by: xuebwang-amd <[email protected]>
Signed-off-by: chaunceyjiang <[email protected]>
Signed-off-by: chaunceyjiang <[email protected]>
Signed-off-by: chaunceyjiang <[email protected]> Signed-off-by: xuebwang-amd <[email protected]>
Signed-off-by: chaunceyjiang <[email protected]>
Purpose
v0.1.25 brings the structural tag. It also fixes a couple of problems regarding JSON schema and py.typed. It enhances the speed of grammar compilation and mask generation.
The new version of structural tags lays the foundation for refactoring the tool parser.
https://xgrammar.mlc.ai/docs/tutorials/structural_tag.html#example-1-tool-calling
Test Plan
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.