Skip to content

Commit 324e823

Browse files
committed
readme : add example for main
1 parent e33002d commit 324e823

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

README.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -255,7 +255,11 @@ Using Metal allows the computation to be executed on the GPU for Apple devices:
255255
```
256256

257257
When built with Metal support, you can enable GPU inference with the `--gpu-layers|-ngl` command-line argument.
258-
Any value larger than 0 will offload the computation to the GPU.
258+
Any value larger than 0 will offload the computation to the GPU. For example:
259+
260+
```bash
261+
./main -m ./models/7B/ggml-model-q4_0.bin -n 128 -ngl 1
262+
```
259263

260264
### BLAS Build
261265

0 commit comments

Comments
 (0)