Skip to content

Commit 0629a79

Browse files
committed
Disable new mixmul for text generation
1 parent 0a29fe9 commit 0629a79

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

sgemm.cpp

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1243,6 +1243,10 @@ class MixMul {
12431243
assert(params->ith < params->nth);
12441244
assert(plan->type == GGML_TYPE_I32);
12451245

1246+
// doesn't help for token generation
1247+
if (n < 2)
1248+
return false;
1249+
12461250
// supported types
12471251
if (result->type != GGML_TYPE_F32)
12481252
return false;

0 commit comments

Comments
 (0)