error loading model: unexpectedly reached end of file

[jaymon0703]

Any ideas why i may be getting this error when models directory has the model?

[jaymon0703]

Please see #399 for environment and context

[Azeirah]

I don't understand. I ran the commands in the last post in the referenced issue and I'm still getting "error loading m omdel: unexpectedly reached end of file".

My model exists at the specified path. I built with cuBLAS, FORCE_CMAKE=1

[jaymon0703]

Hi @Azeirah - Try using just !CMAKE_ARGS="-DLLAMA_CUBLAS=on" FORCE_CMAKE=1 pip install --upgrade --force-reinstall llama-cpp-python --no-cache-dir --user and make sure you are using a compatible model...like this one works for me - https://huggingface.co/TheBloke/LLaMa-7B-GGML/resolve/main/llama-7b.ggmlv3.q4_0.bin