500 internal server error in web arena, leading to skewed results

[sassrf]

Frequently, one of the results fails to generate. As seen in the screenshot, the left side failed to generate and there is no code, no error and no preview. It would be easy to simply upvote the right side model, but if this is due to a fault of LMArena (rate limiting for example), and not the model, then it will lead to skewed results.

This issue seems to be caused by a 500 internal server error.

[infwinston]

dont worry if error like this occur the vote won't count

[heinosasshallik]

Would it be possible to add automatic retrying, or automatically switch to a different model? It happens extremely frequently and wastes a lot of time