Skip to content

Commit 7d9ed7b

Browse files
committed
Bump memory buffer
1 parent 0c68033 commit 7d9ed7b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

main.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -529,7 +529,7 @@ bool llama_eval(
529529

530530
const int d_key = n_embd/n_head;
531531

532-
static size_t buf_size = 256u*1024*1024;
532+
static size_t buf_size = 512u*1024*1024;
533533
static void * buf = malloc(buf_size);
534534

535535
if (mem_per_token > 0 && mem_per_token*N > buf_size) {

0 commit comments

Comments
 (0)