Skip to content

Bootstrap provider models on addition & implement mux endpoints #826

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jan 30, 2025

Conversation

JAORMX
Copy link
Contributor

@JAORMX JAORMX commented Jan 29, 2025

When adding a provider via the API, this bootstrap the available models
for a provider.

Signed-off-by: Juan Antonio Osorio [email protected]

@JAORMX JAORMX requested a review from aponcedeleonch January 29, 2025 14:51
@JAORMX JAORMX force-pushed the models-provider-add branch from 1a48720 to c5aa12a Compare January 29, 2025 15:21
@JAORMX JAORMX force-pushed the models-provider-add branch 5 times, most recently from 0134cd7 to c93ff69 Compare January 29, 2025 19:12
@JAORMX JAORMX changed the title Bootstrap provider models on addition Bootstrap provider models on addition & implement mux endpoints Jan 30, 2025
When adding a provider via the API, this bootstrap the available models
for a provider.

Signed-off-by: Juan Antonio Osorio <[email protected]>
Signed-off-by: Juan Antonio Osorio <[email protected]>
Signed-off-by: Juan Antonio Osorio <[email protected]>
@JAORMX JAORMX force-pushed the models-provider-add branch from 8080ba4 to d53564c Compare January 30, 2025 07:27
@JAORMX JAORMX requested a review from aponcedeleonch January 30, 2025 07:27
@JAORMX JAORMX force-pushed the models-provider-add branch from faf6bca to b962807 Compare January 30, 2025 07:35
@JAORMX JAORMX merged commit f1cf462 into main Jan 30, 2025
4 checks passed
@JAORMX JAORMX deleted the models-provider-add branch January 30, 2025 07:39
lukehinds pushed a commit that referenced this pull request Jan 31, 2025
* Bootstrap provider models on addition

When adding a provider via the API, this bootstrap the available models
for a provider.

Signed-off-by: Juan Antonio Osorio <[email protected]>

* Implement muxes CRUD

Signed-off-by: Juan Antonio Osorio <[email protected]>

* Fix linter issues

Signed-off-by: Juan Antonio Osorio <[email protected]>

* Remove `models` implementation from llama-cpp

Signed-off-by: Juan Antonio Osorio <[email protected]>

---------

Signed-off-by: Juan Antonio Osorio <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants