Skip to content

Conversation

danbev
Copy link
Member

@danbev danbev commented Aug 22, 2024

@mofosyne mofosyne added the Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix label Aug 30, 2024
Copy link
Collaborator

@mofosyne mofosyne left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if you could spot other typos or improvements you can make around that area, always bit iffy of single typo commit fixes. But approved anyway and defer to other's judgement.

@danbev
Copy link
Member Author

danbev commented Aug 30, 2024

I wonder if you could spot other typos or improvements you can make around that area, always bit iffy of single typo commit fixes.

I just came across this when going through the unigram tokenizer. I'm about to look closer at the workpiece tokenizer and if I find anything there I'll update this.
But I'm also happy to close this if it is annoying. It's just that I forget these if I don't "fix" them straight away.

@ggerganov ggerganov merged commit 49271ef into ggml-org:master Aug 31, 2024
52 checks passed
dsx1986 pushed a commit to dsx1986/llama.cpp that referenced this pull request Oct 29, 2024
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 15, 2024
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 18, 2024
@danbev danbev deleted the llama-vocab-typo branch August 13, 2025 09:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants