-
Notifications
You must be signed in to change notification settings - Fork 7.1k
Open
Labels
module: models.quantizationIssues related to the quantizable/quantized modelsIssues related to the quantizable/quantized modelsquestion
Description
🚀 The feature
hi, thanks for your great work. I hope to be able to add quantized vit model (for ptq or qat).
Motivation, pitch
In 'torchvision/models/quantization', there are several quantized model (Eager Mode Quantization) that is very useful for me to learn quantization. In recent years, Transformer model is very popular. I want to learn how to quantized Transformer model, e.g Vision Transformer, Swin Transformer etc, using pytorch official tools like Eager Mode Quantization. I also tried to modify it myself, but failed. I don't know how to quantify 'pos_embedding' (nn.Parameter) and nn.MultiheadAttention module. look forward to your reply.
Alternatives
No response
Additional context
No response
Metadata
Metadata
Assignees
Labels
module: models.quantizationIssues related to the quantizable/quantized modelsIssues related to the quantizable/quantized modelsquestion