Skip to content

Commit 73643f5

Browse files
gitignore : changes for Poetry users + chat examples (#2284)
A fix in Makefile for FreeBSD users. In the platfrom x86_64 is amd64. This fix resolve compilation using CFLAGS and CXXFLAGS with -march=native and -mtune=native Add two examples for interactive mode using Llama2 models (thx TheBloke for models) Co-authored-by: Georgi Gerganov <[email protected]>
1 parent a814d04 commit 73643f5

File tree

4 files changed

+43
-2
lines changed

4 files changed

+43
-2
lines changed

.gitignore

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -62,11 +62,16 @@ perf-*.txt
6262

6363
examples/jeopardy/results.txt
6464

65+
66+
pyproject.toml
67+
poetry.lock
68+
poetry.toml
69+
6570
# Test binaries
6671
tests/test-double-float
6772
tests/test-grad0
6873
tests/test-opt
6974
tests/test-quantize-fns
7075
tests/test-quantize-perf
7176
tests/test-sampling
72-
tests/test-tokenizer-0
77+
tests/test-tokenizer-0

Makefile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -127,7 +127,7 @@ endif
127127
# Architecture specific
128128
# TODO: probably these flags need to be tweaked on some architectures
129129
# feel free to update the Makefile for your architecture and send a pull request or issue
130-
ifeq ($(UNAME_M),$(filter $(UNAME_M),x86_64 i686))
130+
ifeq ($(UNAME_M),$(filter $(UNAME_M),x86_64 i686 amd64))
131131
# Use all CPU extensions that are available:
132132
CFLAGS += -march=native -mtune=native
133133
CXXFLAGS += -march=native -mtune=native

examples/llama2-13b.sh

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
#!/bin/bash
2+
3+
#
4+
# Temporary script - will be removed in the future
5+
#
6+
7+
cd `dirname $0`
8+
cd ..
9+
10+
./main -m models/available/Llama2/13B/llama-2-13b.ggmlv3.q4_0.bin \
11+
--color \
12+
--ctx_size 2048 \
13+
-n -1 \
14+
-ins -b 256 \
15+
--top_k 10000 \
16+
--temp 0.2 \
17+
--repeat_penalty 1.1 \
18+
-t 8

examples/llama2.sh

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
#!/bin/bash
2+
3+
#
4+
# Temporary script - will be removed in the future
5+
#
6+
7+
cd `dirname $0`
8+
cd ..
9+
10+
./main -m models/available/Llama2/7B/llama-2-7b.ggmlv3.q4_0.bin \
11+
--color \
12+
--ctx_size 2048 \
13+
-n -1 \
14+
-ins -b 256 \
15+
--top_k 10000 \
16+
--temp 0.2 \
17+
--repeat_penalty 1.1 \
18+
-t 8

0 commit comments

Comments
 (0)