Skip to content

Commit 043f298

Browse files
author
Joan Martinez
committed
fix: fix infinite recursion
1 parent d9e2903 commit 043f298

File tree

2 files changed

+6
-9
lines changed

2 files changed

+6
-9
lines changed

examples/server/tests/features/embeddings.feature

Lines changed: 1 addition & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -16,17 +16,10 @@ Feature: llama.cpp server
1616
Then the server is starting
1717
Then the server is healthy
1818

19-
Scenario: Embedding
20-
When embeddings are computed for:
21-
"""
22-
What is the capital of Bulgaria ?
23-
"""
24-
Then embeddings are generated
25-
2619
Scenario: Tokenize / Detokenize complex
2720
When tokenizing:
2821
"""
29-
España is a èspciâl café über naïve résumé cañón élite cañas Barça 例子 東京 こんにちは 你好 中国
22+
España is your's mine's l'heure èspciâl café über naïve résumé cañón élite cañas Barça 例子 東京 こんにちは 你好 中国
3023
"""
3124
Then tokens can be detokenize and is equivalent False
3225

unicode.cpp

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -496,7 +496,11 @@ std::vector<uint32_t> canonical_decomposition_cpts(std::vector<uint32_t> & cpts,
496496
if (it.first != it.second) {
497497
uint offset = 0;
498498
for (auto jt = it.first; jt != it.second; jt++) {
499-
cpts.emplace(cpts.begin() + i + offset, jt->second);
499+
if (offset == 0) {
500+
cpts[i] = jt->second;
501+
} else {
502+
cpts.emplace(cpts.begin() + i + offset, jt->second);
503+
}
500504
offset++;
501505
}
502506
const auto & inner_result = canonical_decomposition_cpts(cpts, i);

0 commit comments

Comments
 (0)