When reload quanted model, i found bias, qweight all are zero tensor.
You can run examples/quantization/basic_usage_wikitext2.py by changing code like this to reproduce it:
# use qwen2 model
pretrained_model_id = "Qwen2.5-3B-Instruct"
quantized_model_id = "Qwen2.5-3B-Instruct-int4-gptq-by-wikitext-test"
quantize_config = QuantizeConfig(
bits=4,
group_size=-1, # change group_size from 128 to -1 for reproducing
)