-
Notifications
You must be signed in to change notification settings - Fork 31.3k
[core] Fix quark #42457
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
[core] Fix quark #42457
Conversation
SunMarc
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's go
| quant_state = target_key.split("_", 1)[-1] | ||
| # print(f"full_layer_name: {full_layer_name}") | ||
|
|
||
| sub_module_state = full_layer_name.rsplit(".", 1)[0] + "." + param + "_quantizer" + "." + quant_state |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
pls explain
| EXPECTED_OUTPUTS.add("Today I am in Paris and I am enjoying my day off! The sun is shining, the birds are") | ||
| EXPECTED_OUTPUTS.add("Today I am in Paris and I'm here to tell you about it. It's a beautiful day,") | ||
| EXPECTED_OUTPUTS.add("Today I am in Paris and I am not in Paris at all! I am not in Paris, but") | ||
| EXPECTED_OUTPUTS.add("Today I am in Paris and I am in Paris, but I am not in Paris\nToday I am") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
any idea why this changed ? the most likely culprit is the dtype we loaded the param but not sure
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
| converters = [] | ||
| for key in CHECKPOINT_KEYS.keys(): | ||
| converters.append( | ||
| WeightConverter(source_keys=[key], target_keys=key, operations=[QuarkDeserialize(self)]) | ||
| ) | ||
| return converters |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
beautiful
SunMarc
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks !
|
[For maintainers] Suggested jobs to run (before merge) run-slow: quark_integration |
What does this PR do?
Fix Quark after weight refactor, all tests passing locally