Skip to content

Pull requests: vllm-project/production-stack

New pull request New
53 Open 435 Closed
53 Open 435 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Adding Support for Sleep Mode for vLLM Container without Command Args
#696 opened Sep 12, 2025 by dumb0002 Loading…
3 tasks done
3
[Bugfix][Router]: loop through model_names
#694 opened Sep 10, 2025 by max-wittig Loading…
3 tasks done
1
1
[bugfix] Add close method for static discovery
#692 opened Sep 9, 2025 by zerofishnoodles Loading…
3 tasks done
1
3
Introduction of /v1/responses endpoint
#691 opened Sep 9, 2025 by sebastiaanvduijn Loading…
1
8
feat: allow for configuration of number of uvicorn workers
#689 opened Sep 9, 2025 by TheCodeWrangler Loading…
8 tasks done
5
[Bugfix] Increase liveness failure threshold for crd
#688 opened Sep 8, 2025 by zerofishnoodles Loading…
3 tasks done
8
[Docs] Correct parameter in transcription API tutorial
#685 opened Sep 7, 2025 by davidgao7 • Draft
3 tasks done
3
[Bugfix] cache server yaml err
#677 opened Sep 4, 2025 by yyzxw Loading…
3 tasks done
1
3
[Misc] Add Makefile to run full pipeline with a single command
#675 opened Sep 3, 2025 by ikaadil Loading…
12
[Router][Feat][Bugfix] Add Swagger UI (OpenAPI) support with Pydantic request models + fix rewrite Content-Length + test
#672 opened Sep 2, 2025 by JaredforReal Loading…
1
9
[Feat][Router] Add TTFT Routing
#670 opened Sep 1, 2025 by chickeyton • Draft
3 tasks
1
30
[Feat][PD] lastest PD support from LMCache with NIXL
#669 opened Aug 28, 2025 by kobe0938 Loading…
3 tasks
15
[Bug][Router] ZombieIP: router routes to model pod that doesn't exist anymore
#666 opened Aug 26, 2025 by jonoillar Loading…
3 tasks
1
25
[CI] Fix bug for PD CI when router is running before vllm instance running
#663 opened Aug 26, 2025 by zerofishnoodles Loading…
3 tasks done
1
[Build] use uv with cache mount for faster docker builds
#657 opened Aug 23, 2025 by Hexoplon Loading…
3 tasks done
3
[Feat][Router] add ability to specify params to drop
#650 opened Aug 20, 2025 by max-wittig Loading…
3 tasks done
6
[Feat][Router] Add simple request migration for vLLM failure
#643 opened Aug 12, 2025 by lucas-tucker Loading…
14
Add max_model_len field support to router
#638 opened Aug 11, 2025 by llm-net Loading…
4
[Router][Improvement] Enhanced Performance Configuration with uvicorn[standard] and uvloop Integration
#636 opened Aug 6, 2025 by ikaadil Loading…
3 tasks done
1
7
[CI/Build] Optimize Docker image size by excluding test and example files (#615)
#627 opened Aug 2, 2025 by ikaadil Loading…
3 tasks done
6
[Feat] Router-side queuing support
#626 opened Aug 2, 2025 by allytotheson Loading…
18
[Feat] Implement workflow-aware routing for multi-agent AI workflows
#625 opened Aug 2, 2025 by hongsw Loading…
6 tasks done
14
feat(helm): Use emptyDir as pvcStorage
#616 opened Jul 29, 2025 by Jimmy-Newtron Loading…
9
[Bugfix] Fix lora operator compatibility with other operator
#597 opened Jul 23, 2025 by zerofishnoodles • Draft
3 tasks done
10
resolve problem dynamic config
#591 opened Jul 21, 2025 by alikhabazian Loading…
3
ProTip! Add no:assignee to see everything that’s not assigned.