You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Relax XNN quantized conv1d test tolerances (#15666)
### Summary
The test_qs8_conv1d_batchnorm_seq test is periodically failing in CI due
to being out of tolerance. From looking at the numbers, I believe this
is due to an overly tight tolerance when quantizing. The error reported
in
https://github.com/pytorch/executorch/actions/runs/19147331216/job/54728231147#step:9:19945,
for example, is 0.03, which seems large, but given that the output range
is 6, that's roughly 1/200th. With 8-bit quant, that's not unreasonable.
I've updated the tolerance in the test to reflect this.
0 commit comments