Skip to content

[BUG] Using --no-mmap --mlock crashes the server #5023

@ibehnam

Description

@ibehnam

Something about the latest commits has messed with the server. The same command to start the server now exits like this:

GGML_ASSERT: llama.cpp:1064: addr == NULL && size == 0
fish: Job 1, './server -m "/Users/behnam/Down…' terminated by signal SIGABRT (Abort)
  • How to reproduce

Upgrade to the latest commit and do:

./server -m "<gguf model>" --ctx-size 4096 --threads 8 -ngl 128 --port 8080 --mlock --no-mmap
  • Using --mlock or --no-mmap alone doesn't crash the server.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions