Skip to content

tutorials : list for llama.cpp #13523

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
6 tasks
ggerganov opened this issue May 14, 2025 · 3 comments
Open
6 tasks

tutorials : list for llama.cpp #13523

ggerganov opened this issue May 14, 2025 · 3 comments
Labels
good first issue Good for newcomers help wanted Extra attention is needed roadmap Part of a roadmap project

Comments

@ggerganov
Copy link
Member

ggerganov commented May 14, 2025

Project: ggml-org : tutorials

List:

TODO:

Simply search for "How to" in the Discussions: https://github.com/ggml-org/llama.cpp/discussions?discussions_q=is%3Aopen+How+to

Contributions for writing tutorials are welcome!

@ggerganov ggerganov converted this from a draft issue May 14, 2025
@ggerganov ggerganov changed the title tutorial : compute embeddings using llama.cpp tutorials : list May 14, 2025
@ggerganov ggerganov changed the title tutorials : list tutorials : llama.cpp May 14, 2025
@ggerganov ggerganov changed the title tutorials : llama.cpp tutorials : list for llama.cpp May 14, 2025
@ggerganov ggerganov added roadmap Part of a roadmap project help wanted Extra attention is needed good first issue Good for newcomers labels May 14, 2025
@ngxson
Copy link
Collaborator

ngxson commented May 14, 2025

Re. the UI stuff, as explained on this comment, I think frontend development in llama.cpp is no longer a beginner-friendly task as it used to be. The problem is that frontend development can be very hard to get it right (too many approaches to do the same thing.) Nowadays, I only accept PRs that follow modern web dev practices, especially practices on ReactJS and Typescript.

However, I think tutorial to document "llama.cpp-specific" setups, like how to build and bundle it with the binary, can be useful, as this is not common frontend dev knowledge.

@ggerganov
Copy link
Member Author

Ok, I removed the TODO. Btw feel free to edit directly the OP. I just added a few examples for potential tutorials to get things going.

@smahs
Copy link

smahs commented May 17, 2025

On prompt caching

@ggerganov ggerganov pinned this issue May 20, 2025
@ggerganov ggerganov moved this to In Progress in ggml-org : tutorials May 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers help wanted Extra attention is needed roadmap Part of a roadmap project
Projects
Status: In Progress
Development

No branches or pull requests

3 participants