Skip to content

Commit 4a7129a

Browse files
authored
Remove obsolete information from README
1 parent 6b6dbc8 commit 4a7129a

File tree

1 file changed

+1
-9
lines changed

1 file changed

+1
-9
lines changed

README.md

Lines changed: 1 addition & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ Inference of [LLaMA](https://arxiv.org/abs/2302.13971) model in pure C/C++
1717
The main goal is to run the model using 4-bit quantization on a MacBook
1818

1919
- Plain C/C++ implementation without dependencies
20-
- Apple silicon first-class citizen - optimized via ARM NEON
20+
- Apple silicon first-class citizen - optimized via ARM NEON and Accelerate framework
2121
- AVX2 support for x86 architectures
2222
- Mixed F16 / F32 precision
2323
- 4-bit quantization support
@@ -323,14 +323,6 @@ or with light image:
323323
docker run -v /llama/models:/models ghcr.io/ggerganov/llama.cpp:light -m /models/7B/ggml-model-q4_0.bin -p "Building a website can be done in 10 simple steps:" -n 512
324324
```
325325

326-
## Limitations
327-
328-
- Probably the token sampling can be improved
329-
- The Accelerate framework is actually currently unused since I found that for tensor shapes typical for the Decoder,
330-
there is no benefit compared to the ARM_NEON intrinsics implementation. Of course, it's possible that I simply don't
331-
know how to utilize it properly. But in any case, you can even disable it with `LLAMA_NO_ACCELERATE=1 make` and the
332-
performance will be the same, since no BLAS calls are invoked by the current implementation
333-
334326
### Contributing
335327

336328
- Contributors can open PRs

0 commit comments

Comments
 (0)