Skip to content

Commit 8a79c59

Browse files
authored
server : include total "num_slots" in props endpoint (#5349)
1 parent 31e7903 commit 8a79c59

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

examples/server/server.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -432,6 +432,7 @@ struct llama_server_context
432432
}
433433

434434
default_generation_settings_for_props = get_formated_generation(slots.front());
435+
default_generation_settings_for_props["num_slots"] = params.n_parallel;
435436
default_generation_settings_for_props["seed"] = -1;
436437

437438
batch = llama_batch_init(n_ctx, 0, params.n_parallel);

0 commit comments

Comments
 (0)