[Bug]: Mismatch of tqdm when n > 1

[MraDonkey]

Your current environment

The progress of tqdm seems to be mismatched when n is not equal to 1. For example, if I run vllm on a dataset consisting of 1000 examples and set n = 5, tqdm displays as 0-5000, while it actually finishes when tqdm is loaded to 1000.

Model Input Dumps

🐛 Describe the bug

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[mertunsall]

I have the same bug - I looked in the source code for a bit but couldn't identify the change that caused this bug.

[li-55555]

same bug

[wenlongzhao094]

Same issue as #11519 .

With v0.6.0, tqdm shows the number of prompts and a fast "est. speed input".

With v0.6.6, tqdm shows (the number of prompts x the number of generations per prompt) and a very slow "est. speed input".