Skip to content

Commit 9878734

Browse files
committed
Add await to release main worker thread
1 parent cce3716 commit 9878734

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/guidellm/scheduler/worker.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -190,6 +190,7 @@ async def _process_runner():
190190
pending_sessions: list[RequestSession[RequestT, ResponseT]] = []
191191

192192
while True: # TODO: Exit condition
193+
await asyncio.sleep(0) # Yield control to the event loop
193194
await lock.acquire()
194195

195196
request_session = None

0 commit comments

Comments
 (0)