Skip to content

Commit 982bfce

Browse files
committed
quantize : add Q5_0 and Q5_1 to map
1 parent 8e936ad commit 982bfce

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

examples/quantize/quantize.cpp

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,8 @@ static const std::map<std::string, enum llama_ftype> LLAMA_FTYPE_MAP = {
1010
{"q4_1", LLAMA_FTYPE_MOSTLY_Q4_1},
1111
{"q4_2", LLAMA_FTYPE_MOSTLY_Q4_2},
1212
{"q4_3", LLAMA_FTYPE_MOSTLY_Q4_3},
13+
{"q5_0", LLAMA_FTYPE_MOSTLY_Q5_0},
14+
{"q5_1", LLAMA_FTYPE_MOSTLY_Q5_1},
1315
{"q8_0", LLAMA_FTYPE_MOSTLY_Q8_0},
1416
};
1517

0 commit comments

Comments
 (0)