Skip to content

Commit e387ec2

Browse files
committed
[Bugfix] fix --scheduling-policy=priority & n>1 crashes engine
Signed-off-by: chaunceyjiang <[email protected]>
1 parent f72a817 commit e387ec2

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/v1/core/sched/request_queue.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -147,7 +147,9 @@ def __init__(self) -> None:
147147

148148
def add_request(self, request: Request) -> None:
149149
"""Add a request to the queue according to priority policy."""
150-
heapq.heappush(self._heap, (request.priority, request.arrival_time, request))
150+
heapq.heappush(
151+
self._heap, (request.priority, request.arrival_time, id(request))
152+
)
151153

152154
def pop_request(self) -> Request:
153155
"""Pop a request from the queue according to priority policy."""

0 commit comments

Comments
 (0)