Skip to content

Commit 5e0b15e

Browse files
DarkLight1337cboss6
authored andcommitted
[Bugfix] Fix incompatibility between vllm-project#20452 and vllm-project#24548 (vllm-project#24754)
Signed-off-by: DarkLight1337 <[email protected]> Signed-off-by: bruceszchen <[email protected]>
1 parent 624de6d commit 5e0b15e

File tree

1 file changed

+2
-4
lines changed

1 file changed

+2
-4
lines changed

vllm/v1/executor/utils.py

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,5 @@ def get_and_update_mm_cache(
1919
"""
2020
scheduler_output = args[0]
2121
for request_data in scheduler_output.scheduled_new_reqs:
22-
for i in range(len(request_data.mm_kwargs)):
23-
mm_input = request_data.mm_kwargs[i]
24-
request_data.mm_kwargs[i] = \
25-
receiver_cache.get_and_update_item(mm_input, None)
22+
request_data.mm_features = receiver_cache.get_and_update_features(
23+
request_data.mm_features)

0 commit comments

Comments
 (0)