Skip to content

Make convert-pt-to-ggml.py backwards compatible with older vocab.json tokenizer files#1001

Merged
ggerganov merged 2 commits intoggml-org:masterfrom
akashmjn:ggml-convert-hf_tok
Jun 25, 2023
Merged

Make convert-pt-to-ggml.py backwards compatible with older vocab.json tokenizer files#1001
ggerganov merged 2 commits intoggml-org:masterfrom
akashmjn:ggml-convert-hf_tok

Commits

Commits on Jun 11, 2023