Skip to content

Commit ca7bd66

Browse files
ggerganovjordankanter
authored andcommitted
ggml : fix IQ3_S AVX implementation (ggml-org#5834)
ggml-ci
1 parent 3fcc749 commit ca7bd66

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ggml-quants.c

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10231,7 +10231,7 @@ void ggml_vec_dot_iq3_s_q8_K (int n, float * GGML_RESTRICT s, size_t bs, const v
1023110231
//const __m256i q2_2 = _mm256_i32gather_epi32((const int *)iq3s_grid, idx.vec[1], 4);
1023210232
const __m256i q2_1 = _mm256_set_epi32(
1023310233
iq3s_grid[idx.index[7]], iq3s_grid[idx.index[6]], iq3s_grid[idx.index[5]], iq3s_grid[idx.index[4]],
10234-
iq3s_grid[idx.index[3]], iq3s_grid[idx.index[1]], iq3s_grid[idx.index[1]], iq3s_grid[idx.index[0]]
10234+
iq3s_grid[idx.index[3]], iq3s_grid[idx.index[2]], iq3s_grid[idx.index[1]], iq3s_grid[idx.index[0]]
1023510235
);
1023610236
const __m256i q2_2 = _mm256_set_epi32(
1023710237
iq3s_grid[idx.index[15]], iq3s_grid[idx.index[14]], iq3s_grid[idx.index[13]], iq3s_grid[idx.index[12]],

0 commit comments

Comments
 (0)