You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This appear to solve ggml-org#153
where error of "ggml_new_tensor_impl: not enough space in the context's memory pool" is thrown in interactive mode.
At least the out of memory error come from `ctx0` used here. Although I am not familiar with the code base enough to tell if this is indeed the cause.
0 commit comments