Skip to content

Commit 689379e

Browse files
updaed
Signed-off-by: [email protected] <[email protected]>
1 parent b1310fd commit 689379e

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/v1/core/sched/scheduler.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -63,7 +63,9 @@ def __init__(
6363
self.scheduler_config.max_num_batched_tokens
6464
self.max_model_len = self.scheduler_config.max_model_len
6565

66-
# create connector
66+
# Create KVConnector for the Scheduler. Note that each Worker
67+
# will have a corresponding KVConnector with Role=WORKER.
68+
# KV Connector pushes/pull of remote KVs for P/D and offloading.
6769
if self.vllm_config.kv_transfer_config is not None:
6870
self.connector = KVConnectorFactory.create_connector(
6971
config=self.vllm_config, role=KVConnectorRole.SCHEDULER)

0 commit comments

Comments
 (0)