local-ai fatal error: unexpected signal during runtime execution

[luoweb]

LocalAI version:

(base) block@192 LocalAI % ./local-ai --version
LocalAI version LocalAI v1.20.1-1-g3829aba-dirty (3829aba)

Environment, CPU architecture, OS, and Version:

Mac OS 13.4 M2 Pro

Describe the bug

test the localai-embeddings as https://docs.flowiseai.com/embeddings/localai-embeddings, local-ai process always exited

To Reproduce

localai-embeddings:

backend: bert-embeddings
embeddings: true
name: text-embedding-ada-002
parameters:
  model: bert-MiniLM-L6-v2q4_1.bin

test the localai-embeddings as https://docs.flowiseai.com/embeddings/localai-embeddings, local-ai process always exited

Expected behavior

./local-ai --models-path /Users/block/code/data/models --debug true

Logs

6:03PM DBG Parameter Config: &{OpenAIRequest:{Model:open-llama-7B-open-instruct.ggmlv3.q4_1.bin File: Language: ResponseFormat: Size: Prompt:<nil> Instruction: Input:<nil> Stop:<nil> Messages:[] Stream:false Echo:false TopP:1 TopK:80 Temperature:0.9 Maxtokens:0 N:0 Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 Seed:0 Mode:0 Step:0 TypicalP:0} Name:gpt-3.5-turbo StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:1024 F16:false NUMA:false Threads:6 Debug:true Roles:map[] Embeddings:false Backend: TemplateConfig:{Completion: Chat: Edit:} MirostatETA:0 MirostatTAU:0 Mirostat:0 NGPULayers:0 MMap:false MMlock:false LowVRAM:false TensorSplit: MainGPU: ImageGenerationAssets: PromptCachePath: PromptCacheAll:false PromptCacheRO:false PromptStrings:[] InputStrings:[] InputToken:[]}
6:03PM DBG Loading model 'open-llama-7B-open-instruct.ggmlv3.q4_1.bin' greedly
6:03PM DBG Model 'open-llama-7B-open-instruct.ggmlv3.q4_1.bin' already loaded
fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x2 addr=0x70058b020 pc=0x102e55140]

runtime stack:
runtime.throw({0x102fc8729?, 0x3cbb592d0?})
	/usr/local/go/src/runtime/panic.go:1047 +0x40 fp=0x17264e930 sp=0x17264e900 pc=0x10283d920
runtime.sigpanic()
	/usr/local/go/src/runtime/signal_unix.go:821 +0x244 fp=0x17264e970 sp=0x17264e930 pc=0x102854274

goroutine 29 [syscall, 1 minutes]:
runtime.cgocall(0x102df0464, 0x140005ca0f8)
	/usr/local/go/src/runtime/cgocall.go:157 +0x54 fp=0x140005ca0c0 sp=0x140005ca080 pc=0x10280d4a4
github.com/go-skynet/go-llama%2ecpp._Cfunc_llama_predict(0x14f604b90, 0x15000c400, 0x140068c6000, 0x1)
	_cgo_gotypes.go:224 +0x38 fp=0x140005ca0f0 sp=0x140005ca0c0 pc=0x102c30c18
github.com/go-skynet/go-llama%2ecpp.(*LLama).Predict.func2(0x1400065e000?, 0x140005ca2f0?, {0x140068c6000, 0x0?, 0x1?}, 0x14000156aa0?)
	/Users/block/code/llm/LocalAI/go-llama/llama.go:211 +0x90 fp=0x140005ca140 sp=0x140005ca0f0 pc=0x102c32e40
github.com/go-skynet/go-llama%2ecpp.(*LLama).Predict(0x1400012eca8, {0x1400065e000, 0x1f98}, {0x14000156aa0, 0xe, 0x0?})
	/Users/block/code/llm/LocalAI/go-llama/llama.go:211 +0x26c fp=0x140005ca400 sp=0x140005ca140 pc=0x102c32b1c
github.com/go-skynet/LocalAI/api.ModelInference.func12()
	/Users/block/code/llm/LocalAI/api/prediction.go:543 +0xa4 fp=0x140005ca730 sp=0x140005ca400 pc=0x102dc1f54
github.com/go-skynet/LocalAI/api.ModelInference.func14()
	/Users/block/code/llm/LocalAI/api/prediction.go:585 +0x244 fp=0x140005ca7f0 sp=0x140005ca730 pc=0x102dc1b64
github.com/go-skynet/LocalAI/api.ComputeChoices({0x1400065e000, 0x1f98}, 0x14000000c80, 0x14000321340, 0x140001fcd40?, 0x102fa6801?, 0x1041d5b68, 0x200?)
	/Users/block/code/llm/LocalAI/api/prediction.go:609 +0x1a0 fp=0x140005cb0b0 sp=0x140005ca7f0 pc=0x102dc41d0
github.com/go-skynet/LocalAI/api.chatEndpoint.func2(0x140003202c0)
	/Users/block/code/llm/LocalAI/api/openai.go:461 +0x6f8 fp=0x140005cb260 sp=0x140005cb0b0 pc=0x102dbbb38
github.com/gofiber/fiber/v2.(*App).next(0x1400010db00, 0x140003202c0)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:144 +0x184 fp=0x140005cb310 sp=0x140005cb260 pc=0x102bfb164
github.com/gofiber/fiber/v2.(*Ctx).Next(0x0?)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/ctx.go:913 +0x5c fp=0x140005cb330 sp=0x140005cb310 pc=0x102be81bc
github.com/gofiber/fiber/v2/middleware/recover.New.func1(0x140005cb3c8?)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/middleware/recover/recover.go:43 +0xa4 fp=0x140005cb3b0 sp=0x140005cb330 pc=0x102c07054
github.com/gofiber/fiber/v2.(*Ctx).Next(0x140001e3e60?)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/ctx.go:910 +0x48 fp=0x140005cb3d0 sp=0x140005cb3b0 pc=0x102be81a8
github.com/gofiber/fiber/v2/middleware/logger.New.func3(0x140003202c0)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/middleware/logger/logger.go:122 +0x2dc fp=0x140005cbb00 sp=0x140005cb3d0 pc=0x102c01e1c
github.com/gofiber/fiber/v2.(*App).next(0x1400010db00, 0x140003202c0)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:144 +0x184 fp=0x140005cbbb0 sp=0x140005cbb00 pc=0x102bfb164
github.com/gofiber/fiber/v2.(*App).handler(0x1400010db00, 0x102b6b420?)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:171 +0x74 fp=0x140005cbc10 sp=0x140005cbbb0 pc=0x102bfb344
github.com/gofiber/fiber/v2.(*App).handler-fm(0x140000c0000?)
	<autogenerated>:1 +0x30 fp=0x140005cbc30 sp=0x140005cbc10 pc=0x102bfffb0
github.com/valyala/fasthttp.(*Server).serveConn(0x140002cc200, {0x1041e1440?, 0x14000132310})
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:2363 +0xdd0 fp=0x140005cbea0 sp=0x140005cbc30 pc=0x102b6b470
github.com/valyala/fasthttp.(*Server).serveConn-fm({0x1041e1440?, 0x14000132310?})
	<autogenerated>:1 +0x3c fp=0x140005cbed0 sp=0x140005cbea0 pc=0x102b7a43c
github.com/valyala/fasthttp.(*workerPool).workerFunc(0x14000156c80, 0x140000be020)
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:224 +0x70 fp=0x140005cbf90 sp=0x140005cbed0 pc=0x102b75e50
github.com/valyala/fasthttp.(*workerPool).getCh.func1()
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:196 +0x38 fp=0x140005cbfd0 sp=0x140005cbf90 pc=0x102b75b58
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140005cbfd0 sp=0x140005cbfd0 pc=0x10286f404
created by github.com/valyala/fasthttp.(*workerPool).getCh
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:195 +0x220

goroutine 1 [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x140005cf1d0 sp=0x140005cf1b0 pc=0x102840374
runtime.netpollblock(0x140005cf268?, 0x28e5724?, 0x1?)
	/usr/local/go/src/runtime/netpoll.go:527 +0x158 fp=0x140005cf210 sp=0x140005cf1d0 pc=0x1028398e8
internal/poll.runtime_pollWait(0x12bff5f00, 0x72)
	/usr/local/go/src/runtime/netpoll.go:306 +0xa0 fp=0x140005cf240 sp=0x140005cf210 pc=0x1028694a0
internal/poll.(*pollDesc).wait(0x140000a8200?, 0x10281faf4?, 0x0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x140005cf270 sp=0x140005cf240 pc=0x1028e0d68
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x140000a8200)
	/usr/local/go/src/internal/poll/fd_unix.go:614 +0x250 fp=0x140005cf320 sp=0x140005cf270 pc=0x1028e5810
net.(*netFD).accept(0x140000a8200)
	/usr/local/go/src/net/fd_unix.go:172 +0x28 fp=0x140005cf3e0 sp=0x140005cf320 pc=0x102963028
net.(*TCPListener).accept(0x1400000e0f0)
	/usr/local/go/src/net/tcpsock_posix.go:148 +0x28 fp=0x140005cf410 sp=0x140005cf3e0 pc=0x102978658
net.(*TCPListener).Accept(0x1400000e0f0)
	/usr/local/go/src/net/tcpsock.go:297 +0x2c fp=0x140005cf450 sp=0x140005cf410 pc=0x1029777cc
github.com/valyala/fasthttp.acceptConn(0x140002cc200, {0x1041dddb0, 0x1400000e0f0}, 0x140005cf668)
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:1928 +0x44 fp=0x140005cf530 sp=0x140005cf450 pc=0x102b69d44
github.com/valyala/fasthttp.(*Server).Serve(0x140002cc200, {0x1041dddb0?, 0x1400000e0f0})
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:1821 +0x4f0 fp=0x140005cf690 sp=0x140005cf530 pc=0x102b69500
github.com/gofiber/fiber/v2.(*App).Listen(0x1400010db00, {0x102fa648e?, 0x7?})
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/listen.go:88 +0x104 fp=0x140005cf6f0 sp=0x140005cf690 pc=0x102bf32e4
main.main.func1(0x1400029bbb8?)
	/Users/block/code/llm/LocalAI/main.go:161 +0x5a8 fp=0x140005cf9b0 sp=0x140005cf6f0 pc=0x102defbb8
github.com/urfave/cli/v2.(*Command).Run(0x140002ce160, 0x14000162f00, {0x14000108050, 0x5, 0x5})
	/Users/block/go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/command.go:274 +0x75c fp=0x140005cfc40 sp=0x140005cf9b0 pc=0x102ddebec
github.com/urfave/cli/v2.(*App).RunContext(0x140002ca000, {0x1041de2b8?, 0x14000120018}, {0x14000108050, 0x5, 0x5})
	/Users/block/go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/app.go:332 +0x604 fp=0x140005cfcb0 sp=0x140005cfc40 pc=0x102ddb9d4
github.com/urfave/cli/v2.(*App).Run(...)
	/Users/block/go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/app.go:309
main.main()
	/Users/block/code/llm/LocalAI/main.go:165 +0x11bc fp=0x140005cff70 sp=0x140005cfcb0 pc=0x102def57c
runtime.main()
	/usr/local/go/src/runtime/proc.go:250 +0x248 fp=0x140005cffd0 sp=0x140005cff70 pc=0x10283ff48
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140005cffd0 sp=0x140005cffd0 pc=0x10286f404

goroutine 2 [force gc (idle), 1 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000064fa0 sp=0x14000064f80 pc=0x102840374
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:387
runtime.forcegchelper()
	/usr/local/go/src/runtime/proc.go:305 +0xb8 fp=0x14000064fd0 sp=0x14000064fa0 pc=0x1028401b8
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000064fd0 sp=0x14000064fd0 pc=0x10286f404
created by runtime.init.6
	/usr/local/go/src/runtime/proc.go:293 +0x24

goroutine 18 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000060760 sp=0x14000060740 pc=0x102840374
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:387
runtime.bgsweep(0x0?)
	/usr/local/go/src/runtime/mgcsweep.go:319 +0x110 fp=0x140000607b0 sp=0x14000060760 pc=0x10282d110
runtime.gcenable.func1()
	/usr/local/go/src/runtime/mgc.go:178 +0x28 fp=0x140000607d0 sp=0x140000607b0 pc=0x102821bb8
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140000607d0 sp=0x140000607d0 pc=0x10286f404
created by runtime.gcenable
	/usr/local/go/src/runtime/mgc.go:178 +0x74

goroutine 19 [GC scavenge wait]:
runtime.gopark(0x6bf3e8?, 0x6553f100?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000060f50 sp=0x14000060f30 pc=0x102840374
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:387
runtime.(*scavengerState).park(0x10468c120)
	/usr/local/go/src/runtime/mgcscavenge.go:400 +0x5c fp=0x14000060f80 sp=0x14000060f50 pc=0x10282af1c
runtime.bgscavenge(0x0?)
	/usr/local/go/src/runtime/mgcscavenge.go:633 +0xac fp=0x14000060fb0 sp=0x14000060f80 pc=0x10282b4fc
runtime.gcenable.func2()
	/usr/local/go/src/runtime/mgc.go:179 +0x28 fp=0x14000060fd0 sp=0x14000060fb0 pc=0x102821b58
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000060fd0 sp=0x14000060fd0 pc=0x10286f404
created by runtime.gcenable
	/usr/local/go/src/runtime/mgc.go:179 +0xb8

goroutine 34 [finalizer wait, 1 minutes]:
runtime.gopark(0x140000645a8?, 0x102816730?, 0xa0?, 0x15?, 0x104c58a90?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000064580 sp=0x14000064560 pc=0x102840374
runtime.runfinq()
	/usr/local/go/src/runtime/mfinal.go:193 +0x10c fp=0x140000647d0 sp=0x14000064580 pc=0x102820c4c
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140000647d0 sp=0x140000647d0 pc=0x10286f404
created by runtime.createfing
	/usr/local/go/src/runtime/mfinal.go:163 +0x84

goroutine 35 [GC worker (idle), 1 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000336740 sp=0x14000336720 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x140003367d0 sp=0x14000336740 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140003367d0 sp=0x140003367d0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 20 [GC worker (idle), 1 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000061740 sp=0x14000061720 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x140000617d0 sp=0x14000061740 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140000617d0 sp=0x140000617d0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 21 [GC worker (idle)]:
runtime.gopark(0x1049715a0?, 0x1?, 0x69?, 0x34?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000061f40 sp=0x14000061f20 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x14000061fd0 sp=0x14000061f40 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000061fd0 sp=0x14000061fd0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 22 [GC worker (idle)]:
runtime.gopark(0xac3ae741af9d?, 0x3?, 0x94?, 0x11?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000062740 sp=0x14000062720 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x140000627d0 sp=0x14000062740 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140000627d0 sp=0x140000627d0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 36 [GC worker (idle), 1 minutes]:
runtime.gopark(0xac3ae740ff05?, 0x1?, 0xd8?, 0xb7?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000336f40 sp=0x14000336f20 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x14000336fd0 sp=0x14000336f40 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000336fd0 sp=0x14000336fd0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 23 [GC worker (idle), 1 minutes]:
runtime.gopark(0xac37cf8e4ece?, 0x3?, 0x84?, 0xe4?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000062f40 sp=0x14000062f20 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x14000062fd0 sp=0x14000062f40 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000062fd0 sp=0x14000062fd0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 50 [GC worker (idle)]:
runtime.gopark(0xac3ae742801c?, 0x3?, 0x76?, 0x9?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000332740 sp=0x14000332720 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x140003327d0 sp=0x14000332740 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140003327d0 sp=0x140003327d0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 24 [GC worker (idle), 1 minutes]:
runtime.gopark(0x1049715a0?, 0x3?, 0x70?, 0x11?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000063740 sp=0x14000063720 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x140000637d0 sp=0x14000063740 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140000637d0 sp=0x140000637d0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 25 [GC worker (idle), 1 minutes]:
runtime.gopark(0x1049715a0?, 0x1?, 0x5d?, 0x1e?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000063f40 sp=0x14000063f20 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x14000063fd0 sp=0x14000063f40 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000063fd0 sp=0x14000063fd0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 51 [GC worker (idle)]:
runtime.gopark(0xac3ae7425aad?, 0x3?, 0xc6?, 0xd9?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000332f40 sp=0x14000332f20 pc=0x102840374
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xec fp=0x14000332fd0 sp=0x14000332f40 pc=0x102823afc
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000332fd0 sp=0x14000332fd0 pc=0x10286f404
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x28

goroutine 26 [select, 1 minutes]:
runtime.gopark(0x140003396a8?, 0x2?, 0x0?, 0x0?, 0x1400033966c?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000072c30 sp=0x14000072c10 pc=0x102840374
runtime.selectgo(0x14000072ea8, 0x14000339668, 0x0?, 0x0, 0x0?, 0x1)
	/usr/local/go/src/runtime/select.go:327 +0x690 fp=0x14000072d50 sp=0x14000072c30 pc=0x102850650
github.com/go-skynet/LocalAI/api.(*galleryApplier).start.func1()
	/Users/block/code/llm/LocalAI/api/gallery.go:78 +0xa8 fp=0x14000072fd0 sp=0x14000072d50 pc=0x102db8398
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000072fd0 sp=0x14000072fd0 pc=0x10286f404
created by github.com/go-skynet/LocalAI/api.(*galleryApplier).start
	/Users/block/code/llm/LocalAI/api/gallery.go:76 +0xa0

goroutine 27 [sleep]:
runtime.gopark(0xac481b548785?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000339ef0 sp=0x14000339ed0 pc=0x102840374
time.Sleep(0x12a05f200)
	/usr/local/go/src/runtime/time.go:195 +0x118 fp=0x14000339f30 sp=0x14000339ef0 pc=0x10286c078
github.com/valyala/fasthttp.(*FS).initRequestHandler.func1()
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/fs.go:482 +0xfc fp=0x14000339fd0 sp=0x14000339f30 pc=0x102b3a6ec
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000339fd0 sp=0x14000339fd0 pc=0x10286f404
created by github.com/valyala/fasthttp.(*FS).initRequestHandler
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/fs.go:459 +0x48c

goroutine 28 [sleep]:
runtime.gopark(0xac481b5483c7?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x140003336f0 sp=0x140003336d0 pc=0x102840374
time.Sleep(0x12a05f200)
	/usr/local/go/src/runtime/time.go:195 +0x118 fp=0x14000333730 sp=0x140003336f0 pc=0x10286c078
github.com/valyala/fasthttp.(*FS).initRequestHandler.func1()
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/fs.go:482 +0xfc fp=0x140003337d0 sp=0x14000333730 pc=0x102b3a6ec
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140003337d0 sp=0x140003337d0 pc=0x10286f404
created by github.com/valyala/fasthttp.(*FS).initRequestHandler
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/fs.go:459 +0x48c

goroutine 3 [sleep]:
runtime.gopark(0xac46f13bbe1d?, 0x102b7519c?, 0xb0?, 0x6c?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000338740 sp=0x14000338720 pc=0x102840374
time.Sleep(0x2540be400)
	/usr/local/go/src/runtime/time.go:195 +0x118 fp=0x14000338780 sp=0x14000338740 pc=0x10286c078
github.com/valyala/fasthttp.(*workerPool).Start.func2()
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:67 +0x54 fp=0x140003387d0 sp=0x14000338780 pc=0x102b75184
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x140003387d0 sp=0x140003387d0 pc=0x10286f404
created by github.com/valyala/fasthttp.(*workerPool).Start
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:59 +0xdc

goroutine 30 [sleep]:
runtime.gopark(0xac48ad7aa531?, 0x1040ee9a0?, 0x60?, 0xe9?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x14000079f70 sp=0x14000079f50 pc=0x102840374
time.Sleep(0x3b9aca00)
	/usr/local/go/src/runtime/time.go:195 +0x118 fp=0x14000079fb0 sp=0x14000079f70 pc=0x10286c078
github.com/valyala/fasthttp.updateServerDate.func1()
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/header.go:2274 +0x24 fp=0x14000079fd0 sp=0x14000079fb0 pc=0x102b76304
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x14000079fd0 sp=0x14000079fd0 pc=0x10286f404
created by github.com/valyala/fasthttp.updateServerDate
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/header.go:2272 +0x28

goroutine 4 [sync.Mutex.Lock]:
runtime.gopark(0x104695f40?, 0x10285ce4c?, 0xe0?, 0x47?, 0x10285c7b4?)
	/usr/local/go/src/runtime/proc.go:381 +0xe4 fp=0x1400028e640 sp=0x1400028e620 pc=0x102840374
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:387
runtime.semacquire1(0x1400032d434, 0x7d?, 0x3, 0x1, 0xec?)
	/usr/local/go/src/runtime/sema.go:160 +0x21c fp=0x1400028e6a0 sp=0x1400028e640 pc=0x10285157c
sync.runtime_SemacquireMutex(0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/sema.go:77 +0x28 fp=0x1400028e6e0 sp=0x1400028e6a0 pc=0x10286b0b8
sync.(*Mutex).lockSlow(0x1400032d430)
	/usr/local/go/src/sync/mutex.go:171 +0x178 fp=0x1400028e730 sp=0x1400028e6e0 pc=0x102879148
sync.(*Mutex).Lock(...)
	/usr/local/go/src/sync/mutex.go:90
github.com/go-skynet/LocalAI/api.ModelInference.func14()
	/Users/block/code/llm/LocalAI/api/prediction.go:582 +0x210 fp=0x1400028e7f0 sp=0x1400028e730 pc=0x102dc1b30
github.com/go-skynet/LocalAI/api.ComputeChoices({0x1400027e000, 0x1e66}, 0x14000000140, 0x14000320840, 0x140001fc800?, 0x10281fe01?, 0x1041d5b68, 0x200?)
	/Users/block/code/llm/LocalAI/api/prediction.go:609 +0x1a0 fp=0x1400028f0b0 sp=0x1400028e7f0 pc=0x102dc41d0
github.com/go-skynet/LocalAI/api.chatEndpoint.func2(0x14000320580)
	/Users/block/code/llm/LocalAI/api/openai.go:461 +0x6f8 fp=0x1400028f260 sp=0x1400028f0b0 pc=0x102dbbb38
github.com/gofiber/fiber/v2.(*App).next(0x1400010db00, 0x14000320580)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:144 +0x184 fp=0x1400028f310 sp=0x1400028f260 pc=0x102bfb164
github.com/gofiber/fiber/v2.(*Ctx).Next(0x70?)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/ctx.go:913 +0x5c fp=0x1400028f330 sp=0x1400028f310 pc=0x102be81bc
github.com/gofiber/fiber/v2/middleware/recover.New.func1(0x0?)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/middleware/recover/recover.go:43 +0xa4 fp=0x1400028f3b0 sp=0x1400028f330 pc=0x102c07054
github.com/gofiber/fiber/v2.(*Ctx).Next(0x140001e3e60?)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/ctx.go:910 +0x48 fp=0x1400028f3d0 sp=0x1400028f3b0 pc=0x102be81a8
github.com/gofiber/fiber/v2/middleware/logger.New.func3(0x14000320580)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/middleware/logger/logger.go:122 +0x2dc fp=0x1400028fb00 sp=0x1400028f3d0 pc=0x102c01e1c
github.com/gofiber/fiber/v2.(*App).next(0x1400010db00, 0x14000320580)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:144 +0x184 fp=0x1400028fbb0 sp=0x1400028fb00 pc=0x102bfb164
github.com/gofiber/fiber/v2.(*App).handler(0x1400010db00, 0x102b6b420?)
	/Users/block/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:171 +0x74 fp=0x1400028fc10 sp=0x1400028fbb0 pc=0x102bfb344
github.com/gofiber/fiber/v2.(*App).handler-fm(0x140000c0600?)
	<autogenerated>:1 +0x30 fp=0x1400028fc30 sp=0x1400028fc10 pc=0x102bfffb0
github.com/valyala/fasthttp.(*Server).serveConn(0x140002cc200, {0x1041e1440?, 0x14000132030})
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:2363 +0xdd0 fp=0x1400028fea0 sp=0x1400028fc30 pc=0x102b6b470
github.com/valyala/fasthttp.(*Server).serveConn-fm({0x1041e1440?, 0x14000132030?})
	<autogenerated>:1 +0x3c fp=0x1400028fed0 sp=0x1400028fea0 pc=0x102b7a43c
github.com/valyala/fasthttp.(*workerPool).workerFunc(0x14000156c80, 0x140000be120)
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:224 +0x70 fp=0x1400028ff90 sp=0x1400028fed0 pc=0x102b75e50
github.com/valyala/fasthttp.(*workerPool).getCh.func1()
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:196 +0x38 fp=0x1400028ffd0 sp=0x1400028ff90 pc=0x102b75b58
runtime.goexit()
	/usr/local/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x1400028ffd0 sp=0x1400028ffd0 pc=0x10286f404
created by github.com/valyala/fasthttp.(*workerPool).getCh
	/Users/block/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:195 +0x220
(base) block@192 LocalAI % 

Additional context

[luoweb]

the issue solved when rebuilt without BUILD_TYPE=metal, I think this is a bug with BUILD_TYPE=metal, Maybe the binary ingegate the build flag like the build version

[programmerq]

I also ran into this, but I had a slightly different error. The process crashes as soon as I try to use an api endpoint that requires loading of the model. For example:

% curl http://127.0.0.1:8080/v1/completions -H "Content-Type: application/json" -d '{
     "model": "ggml-gpt4all-j.bin",
     "prompt": "A long time ago in a galaxy far, far away",
     "temperature": 0.7
   }'
curl: (52) Empty reply from server

curl sees the server close the connection with no content, and the following SIGILL: illegal instruction output appears in the container where local-ai is running.

Full output

SIGILL: illegal instruction
PC=0xb9e675 m=5 sigcode=2
signal arrived during cgo execution
instruction bytes: 0xc4 0xe2 0x71 0xa9 0x15 0x62 0xb6 0xa7 0x0 0xc5 0xfa 0x11 0x4c 0x24 0x10 0xc5

goroutine 8 [syscall]:
runtime.cgocall(0xad56e0, 0xc0002a87f8)
	/usr/local/go/src/runtime/cgocall.go:157 +0x5c fp=0xc0002a87d0 sp=0xc0002a8798 pc=0x44a87c
github.com/go-skynet/go-llama%2ecpp._Cfunc_load_model(0x7fd740000b60, 0x200, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	_cgo_gotypes.go:232 +0x4d fp=0xc0002a87f8 sp=0xc0002a87d0 pc=0x8ea36d
github.com/go-skynet/go-llama%2ecpp.New({0xc00010e1e0, 0x1a}, {0xc000048380, 0x5, 0xc00021d701?})
	/build/go-llama/llama.go:26 +0x267 fp=0xc0002a8900 sp=0xc0002a87f8 pc=0x8eaaa7
github.com/go-skynet/LocalAI/pkg/model.llamaLM.func1({0xc00010e1e0?, 0xe14f8b?})
	/build/pkg/model/initializers.go:124 +0x2a fp=0xc0002a8938 sp=0xc0002a8900 pc=0x8f088a
github.com/go-skynet/LocalAI/pkg/model.(*ModelLoader).LoadModel(0xc00021de90, {0xc000042420, 0x12}, 0xc0002b20e0)
	/build/pkg/model/loader.go:127 +0x1fe fp=0xc0002a8a30 sp=0xc0002a8938 pc=0x8f2a1e
github.com/go-skynet/LocalAI/pkg/model.(*ModelLoader).BackendLoader(0xc00021de90, {0xdf743e, 0x5}, {0xc000042420, 0x12}, {0xc000048380, 0x5, 0x8}, 0x4, {0xe0a2f0, ...})
	/build/pkg/model/initializers.go:150 +0x356 fp=0xc0002a8b48 sp=0xc0002a8a30 pc=0x8f0f16
github.com/go-skynet/LocalAI/pkg/model.(*ModelLoader).GreedyLoader(0xc00021de90, {0xc000042420, 0x12}, {0xc000048380, 0x5, 0x8}, 0x0?, {0xe0a2f0, 0x19})
	/build/pkg/model/initializers.go:206 +0x3c5 fp=0xc0002a8ca0 sp=0xc0002a8b48 pc=0x8f1a25
github.com/go-skynet/LocalAI/api.ModelInference({_, _}, _, {{{0xc000042420, 0x12}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}, ...}, ...}, ...)
	/build/api/prediction.go:263 +0x158 fp=0xc0002a8fa0 sp=0xc0002a8ca0 pc=0xaa1ab8
github.com/go-skynet/LocalAI/api.ComputeChoices({0xc00003a3c0, 0x29}, 0xc0000ec140, 0xc0000d4b00, 0xc0000374e0?, 0x0?, 0x1539db0, 0x200?)
	/build/api/prediction.go:603 +0x125 fp=0xc0002a9860 sp=0xc0002a8fa0 pc=0xaa5a85
github.com/go-skynet/LocalAI/api.completionEndpoint.func2(0xc0000d4580)
	/build/api/openai.go:265 +0x95a fp=0xc0002a99f0 sp=0xc0002a9860 pc=0xa99e9a
github.com/gofiber/fiber/v2.(*App).next(0xc0000db680, 0xc0000d4580)
	/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:144 +0x1bf fp=0xc0002a9a98 sp=0xc0002a99f0 pc=0x8aefbf
github.com/gofiber/fiber/v2.(*Ctx).Next(0xf?)
	/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/ctx.go:913 +0x53 fp=0xc0002a9ab8 sp=0xc0002a9a98 pc=0x899a13
github.com/gofiber/fiber/v2/middleware/recover.New.func1(0xd444a0?)
	/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/middleware/recover/recover.go:43 +0xcb fp=0xc0002a9b30 sp=0xc0002a9ab8 pc=0x8bbe2b
github.com/gofiber/fiber/v2.(*App).next(0xc0000db680, 0xc0000d4580)
	/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:144 +0x1bf fp=0xc0002a9bd8 sp=0xc0002a9b30 pc=0x8aefbf
github.com/gofiber/fiber/v2.(*App).handler(0xc0000db680, 0x4d2e77?)
	/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/router.go:171 +0x87 fp=0xc0002a9c38 sp=0xc0002a9bd8 pc=0x8af207
github.com/gofiber/fiber/v2.(*App).handler-fm(0xc0002fc000?)
	<autogenerated>:1 +0x2c fp=0xc0002a9c58 sp=0xc0002a9c38 pc=0x8b442c
github.com/valyala/fasthttp.(*Server).serveConn(0xc000038600, {0x15ecf18?, 0xc0000c8000})
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:2363 +0x11d3 fp=0xc0002a9ec8 sp=0xc0002a9c58 pc=0x811653
github.com/valyala/fasthttp.(*Server).serveConn-fm({0x15ecf18?, 0xc0000c8000?})
	<autogenerated>:1 +0x39 fp=0xc0002a9ef0 sp=0xc0002a9ec8 pc=0x820f19
github.com/valyala/fasthttp.(*workerPool).workerFunc(0xc0000c6c80, 0xc0002b2040)
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:224 +0xa9 fp=0xc0002a9fa0 sp=0xc0002a9ef0 pc=0x81d149
github.com/valyala/fasthttp.(*workerPool).getCh.func1()
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:196 +0x38 fp=0xc0002a9fe0 sp=0xc0002a9fa0 pc=0x81ceb8
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0002a9fe8 sp=0xc0002a9fe0 pc=0x4ad9c1
created by github.com/valyala/fasthttp.(*workerPool).getCh
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:195 +0x1b0

goroutine 1 [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc0002ad1d8 sp=0xc0002ad1b8 pc=0x47e7f6
runtime.netpollblock(0xc0002ad268?, 0x449f0f?, 0x0?)
	/usr/local/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0002ad210 sp=0xc0002ad1d8 pc=0x476ff7
internal/poll.runtime_pollWait(0x7fd7527db618, 0x72)
	/usr/local/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0002ad230 sp=0xc0002ad210 pc=0x4a8269
internal/poll.(*pollDesc).wait(0xc000530200?, 0x100000005?, 0x0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0002ad258 sp=0xc0002ad230 pc=0x525ab2
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000530200)
	/usr/local/go/src/internal/poll/fd_unix.go:614 +0x2bd fp=0xc0002ad300 sp=0xc0002ad258 pc=0x52b3bd
net.(*netFD).accept(0xc000530200)
	/usr/local/go/src/net/fd_unix.go:172 +0x35 fp=0xc0002ad3b8 sp=0xc0002ad300 pc=0x5ad875
net.(*TCPListener).accept(0xc000012660)
	/usr/local/go/src/net/tcpsock_posix.go:148 +0x25 fp=0xc0002ad3e0 sp=0xc0002ad3b8 pc=0x5c3c25
net.(*TCPListener).Accept(0xc000012660)
	/usr/local/go/src/net/tcpsock.go:297 +0x3d fp=0xc0002ad410 sp=0xc0002ad3e0 pc=0x5c2d1d
github.com/valyala/fasthttp.acceptConn(0xc000038600, {0x15e9830, 0xc000012660}, 0xc0002ad608)
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:1928 +0x62 fp=0xc0002ad4f0 sp=0xc0002ad410 pc=0x80fb22
github.com/valyala/fasthttp.(*Server).Serve(0xc000038600, {0x15e9830?, 0xc000012660})
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/server.go:1821 +0x4f4 fp=0xc0002ad638 sp=0xc0002ad4f0 pc=0x80f134
github.com/gofiber/fiber/v2.(*App).Listen(0xc0000db680, {0xdf6ccd?, 0x7?})
	/go/pkg/mod/github.com/gofiber/fiber/v2@v2.47.0/listen.go:88 +0x11d fp=0xc0002ad698 sp=0xc0002ad638 pc=0x8a601d
main.main.func1(0xc000288160?)
	/build/main.go:161 +0x825 fp=0xc0002ad950 sp=0xc0002ad698 pc=0xad4e05
github.com/urfave/cli/v2.(*Command).Run(0xc000288160, 0xc000048f80, {0xc000036250, 0x1, 0x1})
	/go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/command.go:274 +0x9eb fp=0xc0002adbf0 sp=0xc0002ad950 pc=0xac1ecb
github.com/urfave/cli/v2.(*App).RunContext(0xc000286000, {0x15e9d38?, 0xc00003c0d0}, {0xc000036250, 0x1, 0x1})
	/go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/app.go:332 +0x616 fp=0xc0002adc60 sp=0xc0002adbf0 pc=0xabe7f6
github.com/urfave/cli/v2.(*App).Run(...)
	/go/pkg/mod/github.com/urfave/cli/v2@v2.25.7/app.go:309
main.main()
	/build/main.go:165 +0x12b6 fp=0xc0002adf80 sp=0xc0002adc60 pc=0xad4516
runtime.main()
	/usr/local/go/src/runtime/proc.go:250 +0x207 fp=0xc0002adfe0 sp=0xc0002adf80 pc=0x47e3c7
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0002adfe8 sp=0xc0002adfe0 pc=0x4ad9c1

goroutine 2 [force gc (idle), 2 minutes]:
runtime.gopark(0x3e253209519?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006afb0 sp=0xc00006af90 pc=0x47e7f6
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:387
runtime.forcegchelper()
	/usr/local/go/src/runtime/proc.go:305 +0xb0 fp=0xc00006afe0 sp=0xc00006afb0 pc=0x47e630
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006afe8 sp=0xc00006afe0 pc=0x4ad9c1
created by runtime.init.6
	/usr/local/go/src/runtime/proc.go:293 +0x25

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006b780 sp=0xc00006b760 pc=0x47e7f6
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:387
runtime.bgsweep(0x0?)
	/usr/local/go/src/runtime/mgcsweep.go:319 +0xde fp=0xc00006b7c8 sp=0xc00006b780 pc=0x46a8fe
runtime.gcenable.func1()
	/usr/local/go/src/runtime/mgc.go:178 +0x26 fp=0xc00006b7e0 sp=0xc00006b7c8 pc=0x45fb46
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006b7e8 sp=0xc00006b7e0 pc=0x4ad9c1
created by runtime.gcenable
	/usr/local/go/src/runtime/mgc.go:178 +0x6b

goroutine 4 [GC scavenge wait]:
runtime.gopark(0x3c663232299?, 0x125012?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006bf70 sp=0xc00006bf50 pc=0x47e7f6
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:387
runtime.(*scavengerState).park(0x1b0e220)
	/usr/local/go/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc00006bfa0 sp=0xc00006bf70 pc=0x4687b3
runtime.bgscavenge(0x0?)
	/usr/local/go/src/runtime/mgcscavenge.go:633 +0x65 fp=0xc00006bfc8 sp=0xc00006bfa0 pc=0x468da5
runtime.gcenable.func2()
	/usr/local/go/src/runtime/mgc.go:179 +0x26 fp=0xc00006bfe0 sp=0xc00006bfc8 pc=0x45fae6
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006bfe8 sp=0xc00006bfe0 pc=0x4ad9c1
created by runtime.gcenable
	/usr/local/go/src/runtime/mgc.go:179 +0xaa

goroutine 5 [finalizer wait, 28 minutes]:
runtime.gopark(0x1a0?, 0x1b0ef00?, 0x60?, 0x78?, 0xc00006a770?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006a628 sp=0xc00006a608 pc=0x47e7f6
runtime.runfinq()
	/usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc00006a7e0 sp=0xc00006a628 pc=0x45eb87
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006a7e8 sp=0xc00006a7e0 pc=0x4ad9c1
created by runtime.createfing
	/usr/local/go/src/runtime/mfinal.go:163 +0x45

goroutine 6 [GC worker (idle), 28 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006c750 sp=0xc00006c730 pc=0x47e7f6
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00006c7e0 sp=0xc00006c750 pc=0x4618b1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006c7e8 sp=0xc00006c7e0 pc=0x4ad9c1
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x25

goroutine 18 [GC worker (idle), 28 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000066750 sp=0xc000066730 pc=0x47e7f6
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000667e0 sp=0xc000066750 pc=0x4618b1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000667e8 sp=0xc0000667e0 pc=0x4ad9c1
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x25

goroutine 34 [GC worker (idle), 28 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00052c750 sp=0xc00052c730 pc=0x47e7f6
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00052c7e0 sp=0xc00052c750 pc=0x4618b1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00052c7e8 sp=0xc00052c7e0 pc=0x4ad9c1
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x25

goroutine 19 [GC worker (idle), 28 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000066f50 sp=0xc000066f30 pc=0x47e7f6
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000066fe0 sp=0xc000066f50 pc=0x4618b1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000066fe8 sp=0xc000066fe0 pc=0x4ad9c1
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x25

goroutine 20 [GC worker (idle), 2 minutes]:
runtime.gopark(0x3e2533fc841?, 0x1?, 0x74?, 0xb5?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000067750 sp=0xc000067730 pc=0x47e7f6
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000677e0 sp=0xc000067750 pc=0x4618b1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000677e8 sp=0xc0000677e0 pc=0x4ad9c1
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x25

goroutine 35 [GC worker (idle), 28 minutes]:
runtime.gopark(0x25b04376ff0?, 0x3?, 0xdf?, 0x2b?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00052cf50 sp=0xc00052cf30 pc=0x47e7f6
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00052cfe0 sp=0xc00052cf50 pc=0x4618b1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00052cfe8 sp=0xc00052cfe0 pc=0x4ad9c1
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x25

goroutine 7 [GC worker (idle), 28 minutes]:
runtime.gopark(0x25b03a42259?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006cf50 sp=0xc00006cf30 pc=0x47e7f6
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00006cfe0 sp=0xc00006cf50 pc=0x4618b1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x4ad9c1
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x25

goroutine 36 [GC worker (idle), 2 minutes]:
runtime.gopark(0x3e2534abaa6?, 0x1?, 0xf6?, 0xd8?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00052d750 sp=0xc00052d730 pc=0x47e7f6
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00052d7e0 sp=0xc00052d750 pc=0x4618b1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00052d7e8 sp=0xc00052d7e0 pc=0x4ad9c1
created by runtime.gcBgMarkStartWorkers
	/usr/local/go/src/runtime/mgc.go:1199 +0x25

goroutine 37 [select, 28 minutes]:
runtime.gopark(0xc00052feb0?, 0x2?, 0x0?, 0x0?, 0xc00052fe74?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00052fc20 sp=0xc00052fc00 pc=0x47e7f6
runtime.selectgo(0xc00052feb0, 0xc00052fe70, 0x0?, 0x0, 0x0?, 0x1)
	/usr/local/go/src/runtime/select.go:327 +0x7be fp=0xc00052fd60 sp=0xc00052fc20 pc=0x48e37e
github.com/go-skynet/LocalAI/api.(*galleryApplier).start.func1()
	/build/api/gallery.go:78 +0xee fp=0xc00052ffe0 sp=0xc00052fd60 pc=0xa9774e
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00052ffe8 sp=0xc00052ffe0 pc=0x4ad9c1
created by github.com/go-skynet/LocalAI/api.(*galleryApplier).start
	/build/api/gallery.go:76 +0xaa

goroutine 38 [sleep]:
runtime.gopark(0x3ecd19d2821?, 0xc0000b4810?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000067f00 sp=0xc000067ee0 pc=0x47e7f6
time.Sleep(0x12a05f200)
	/usr/local/go/src/runtime/time.go:195 +0x135 fp=0xc000067f40 sp=0xc000067f00 pc=0x4aa835
github.com/valyala/fasthttp.(*FS).initRequestHandler.func1()
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/fs.go:482 +0x13c fp=0xc000067fe0 sp=0xc000067f40 pc=0x7dad1c
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x4ad9c1
created by github.com/valyala/fasthttp.(*FS).initRequestHandler
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/fs.go:459 +0x4d6

goroutine 39 [sleep]:
runtime.gopark(0x3ecd17c1e49?, 0xc0000b48c0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000068700 sp=0xc0000686e0 pc=0x47e7f6
time.Sleep(0x12a05f200)
	/usr/local/go/src/runtime/time.go:195 +0x135 fp=0xc000068740 sp=0xc000068700 pc=0x4aa835
github.com/valyala/fasthttp.(*FS).initRequestHandler.func1()
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/fs.go:482 +0x13c fp=0xc0000687e0 sp=0xc000068740 pc=0x7dad1c
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x4ad9c1
created by github.com/valyala/fasthttp.(*FS).initRequestHandler
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/fs.go:459 +0x4d6

goroutine 40 [sleep]:
runtime.gopark(0x3eba470c570?, 0xc00052e788?, 0x85?, 0xdb?, 0xc0000c6cb0?)
	/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00052e758 sp=0xc00052e738 pc=0x47e7f6
time.Sleep(0x2540be400)
	/usr/local/go/src/runtime/time.go:195 +0x135 fp=0xc00052e798 sp=0xc00052e758 pc=0x4aa835
github.com/valyala/fasthttp.(*workerPool).Start.func2()
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:67 +0x56 fp=0xc00052e7e0 sp=0xc00052e798 pc=0x81c616
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00052e7e8 sp=0xc00052e7e0 pc=0x4ad9c1
created by github.com/valyala/fasthttp.(*workerPool).Start
	/go/pkg/mod/github.com/valyala/fasthttp@v1.48.0/workerpool.go:59 +0xdd

rax    0x0
rbx    0x1c25d80
rcx    0x17
rdx    0x0
rdi    0x7fffce182000
rsi    0x10dc
rbp    0x1c45d80
rsp    0x7fd7537fd800
r8     0x777e2c31c2a
r9     0x0
r10    0x7fffce181080
r11    0x7fffce181090
r12    0x1c65d80
r13    0x1c85d80
r14    0x1be5d80
r15    0x0
rip    0xb9e675
rflags 0x10206
cs     0x33
fs     0x0
gs     0x0

This output was from the local-ai binary that was built by the image. If I disable rebuild, then the error has a slightly different instruction bytes string: 0xc4 0xe2 0x71 0xa9 0x15 0x62 0xeb 0x18 0x1 0xc5 0xfa 0x11 0x4c 0x24 0x10 0xc5

In both cases, that string of bytes does appear verbatim in the corresponding local-ai binary.

For example:

grep -obUaP '\xc4\xe2\x71\xa9\x15\x62\xeb\x18\x1\xc5\xfa\x11\x4c\x24\x10\xc5' local-ai
8664597:��q�b���L$�

I built it with BUILD_TYPE= set to an empty value. This is in the quay.io/go-skynet/local-ai:v1.20.1-ffmpeg docker image.

My guess is that local-ai has some code included that my very old processor has a hard time with. The machine has a ton of RAM, and I was hoping to run at least some models. I too ran into this trying to run the gpt4all example. In particular, here's the helm command used, along with my values:

% helm upgrade --install -n ai go-skynet/local-ai --version 2.1.0 --values values.yaml

helm chart values

USER-SUPPLIED VALUES:
affinity: {}
deployment:
  env:
    GALLERIES: '[{"name":"model-gallery", "url":"github:go-skynet/model-gallery/index.yaml"},
      {"url": "github:ci-robbot/localai-huggingface-zoo/index.yaml","name":"huggingface"}]'
    REBUILD: true
    context_size: 512
    threads: 4
  image: quay.io/go-skynet/local-ai:v1.20.1-ffmpeg
  modelsPath: /models
ingress:
  annotations: {}
  className: ""
  enabled: false
  hosts:
  - host: localai.programmerq.net
    paths:
    - path: /
      pathType: ImplementationSpecific
  tls: []
models:
  forceDownload: false
  list:
  - url: https://gpt4all.io/models/ggml-gpt4all-j.bin
  persistence:
    accessModes:
    - ReadWriteOnce
    annotations: {}
    enabled: true
    hostPath:
      enabled: false
      path: /models
    pvc:
      enabled: true
    size: 64Gi
    storageClass: democratic-csi-iscsi
nodeSelector: {}
promptTemplates:
  ggml-gpt4all-j.tmpl: |
    The prompt below is a question to answer, a task to complete, or a conversation to respond to; decide which and write an appropriate response.
    ### Prompt:
    {{.Input}}
    ### Response:
replicaCount: 1
resources:
  limits:
    cpu: 4000m
    memory: 8Gi
  requests:
    cpu: 4000m
    memory: 8Gi
service:
  annotations: {}
  port: 80
  type: LoadBalancer
tolerations: []

cpuinfo for Intel(R) Xeon(R) CPU E5-2648L v2 @ 1.90GHz

processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 62
model name	: Intel(R) Xeon(R) CPU E5-2648L v2 @ 1.90GHz
stepping	: 4
microcode	: 0x42e
cpu MHz		: 1900.000
cache size	: 16384 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq vmx ssse3 cx16 pdcm pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cpuid_fault pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust smep erms xsaveopt arat umip md_clear arch_capabilities
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid shadow_vmcs
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs mmio_unknown
bogomips	: 3800.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

[wojiushixiaobai]

@programmerq Same error.

• link: unexpectedly reached end of fileSIGILL: illegal instruction #288

Intel(R) Xeon(R) CPU E5-2667 v2 @ 3.30GHz

processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 62
model name	: Intel(R) Xeon(R) CPU E5-2667 v2 @ 3.30GHz
stepping	: 4
microcode	: 0x42e
cpu MHz		: 3299.828
cache size	: 25600 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush acpi mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl cpuid tsc_known_freq pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cpuid_fault pti ssbd ibrs ibpb stibp fsgsbase smep erms xsaveopt md_clear flush_l1d
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs itlb_multihit mmio_unknown
bogomips	: 6600.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

[localai-bot]

⚠️⚠️⚠️⚠️⚠️

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

but.... I can also be funny or helpful 😸 and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me,
I don't support (yet) replying!

⚠️⚠️⚠️⚠️⚠️

• I don't know what caused the error in your provided Go execution context, but I can tell you some general tips that could be helpful.

Firstly, the error seems to be caused by a Go program and the FastHTTP library is involved.

If it happens again, I would recommend checking for any logs related to the error, including stack traces, and share them with me.

Another tip would be to ensure that your GOPATH or GOOCD environment variables are set up correctly. Make sure that the necessary GOPATHs have been added, so that it is possible to import local packages correctly.

In addition, if you use a program other than Go in this process, make sure it's configured correctly too.

If I receive more information on your context or specific issue, I can provide a better response next time.

Sources:

• https://github.com/go-skynet/LocalAI/tree/master/examples/slack-qa-bot/deployment.yaml
• https://github.com/go-skynet/LocalAI/tree/master/.github/ISSUE_TEMPLATE/bug_report.md
• https://localai.io/basics/build/index.html