Skip to content

Commit 107980d

Browse files
authored
examples : add -n to alpaca and gpt4all scripts (abetlen#706)
1 parent 585d91a commit 107980d

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

examples/alpaca.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,4 +7,4 @@
77
cd `dirname $0`
88
cd ..
99

10-
./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7
10+
./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt --ctx_size 2048 -n -1 -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7

examples/gpt4all.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,6 @@ cd ..
1010
./main --color --instruct --threads 4 \
1111
--model ./models/gpt4all-7B/gpt4all-lora-quantized.bin \
1212
--file ./prompts/alpaca.txt \
13-
--batch_size 8 --ctx_size 2048 \
13+
--batch_size 8 --ctx_size 2048 -n -1 \
1414
--repeat_last_n 64 --repeat_penalty 1.3 \
1515
--n_predict 128 --temp 0.1 --top_k 40 --top_p 0.95

0 commit comments

Comments
 (0)