[Feature]: Beam Search with Temperature > 0

[ekurtulus]

🚀 The feature, motivation and pitch

Huggingface generation interface allows beam search with nonzero temperature, allowing to generate more diverse beam search. The current version with zero temperature does not allow that flexibility.

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[youkaichao]

is it still beam search then?

[ekurtulus]

Conceptually, yes. Even if we assume that it isn't, it is useful to generate more diverse responses.

[youkaichao]

added in #8928