Model list update dynamically

[ran-haim]

The ability to refresh the model list dynamically without the need of restarting the chat-ui pod.
maybe listen to a conf file, and if it changes the models list will update - it will need to be in a common volume (if there are multiple instances).
A better way would be to grab it from /v1/models from a URL user provides on deployment.

[nsarrazin]

I think we could maybe support an alternative MODELS_URL instead of MODELS, not sure if there would be enough info there to generate the list of models but could be a nice feature if that was the case. Would that suit you?

We need to look deeper to see if there are some unforeseen issues when doing this... I would love to hear from others if this is a feature you would like to see, in order to know how to prioritize this 😄

[ran-haim]

I actually wouldn't mind implementing a models_list endpoint that will return the format that is currently used in the MODELS env variable.

from the user point of view, I think it should work basically like it is done in openwebui - though there it is more coupled with ollama.