-
-
Notifications
You must be signed in to change notification settings - Fork 10.2k
[Bugfix] Fix incompatibility between #20452 and #24548 #24754
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…ect#24528 Signed-off-by: DarkLight1337 <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request resolves an incompatibility bug within the v1 executor's handling of multi-modal inputs. The change correctly updates the logic to use the mm_features
attribute instead of the outdated mm_kwargs
, and provides the proper identifier
for cache lookups. This aligns the implementation with recent data structure changes and ensures that multi-modal data is correctly retrieved from the shared memory cache.
Signed-off-by: DarkLight1337 <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM - I think you mean #24548?
Oops, yeah, let me fix the typo |
…ect#24548 (vllm-project#24754) Signed-off-by: DarkLight1337 <[email protected]>
…ect#24548 (vllm-project#24754) Signed-off-by: DarkLight1337 <[email protected]>
…ect#24548 (vllm-project#24754) Signed-off-by: DarkLight1337 <[email protected]>
…ect#24548 (vllm-project#24754) Signed-off-by: DarkLight1337 <[email protected]> Signed-off-by: bbartels <[email protected]>
…ect#24548 (vllm-project#24754) Signed-off-by: DarkLight1337 <[email protected]> Signed-off-by: bruceszchen <[email protected]>
…ect#24548 (vllm-project#24754) Signed-off-by: DarkLight1337 <[email protected]> Signed-off-by: bruceszchen <[email protected]>
Purpose
Fix incompatibility between #20452 and #24528
Test Plan
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.md
andexamples
for a new model.