Skip to content

Pull requests: vllm-project/production-stack

New pull request New
58 Open 463 Closed
58 Open 463 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Feat] Add production-ready vLLM Nebius MK8s terraform tutorial
#748 opened Nov 1, 2025 by brokedba Loading…
22
Bumping version to 0.1.8
#738 opened Oct 21, 2025 by YuhanLiu11 Loading…
3 tasks
4
[Bugfix] Allow single-label hostnames in URL validation
#737 opened Oct 16, 2025 by osaimi Loading…
3
[Bugfix] Added NULL check for session_key in KvawareRouter
#736 opened Oct 15, 2025 by vjayarag Loading…
3 tasks
3
fix: Exclude content-length from response headers in route_general_transcriptions
#733 opened Oct 13, 2025 by fidoriel Loading…
6
[Bugfix] lmcache server points to wrong file in entrypoint
#730 opened Oct 9, 2025 by Senne-Mennes Loading…
3 tasks done
1
4
[Feat] Allow declaring modelSpec resources directly
#729 opened Oct 9, 2025 by danhubern Loading…
3 tasks done
5
[Feat][Router] Add HashTrie LRU to prevent OOM
#711 opened Sep 22, 2025 by can-sun Loading…
3 tasks done
1
21
[Bugfix][Router] use model_type instead of model_label
#705 opened Sep 19, 2025 by max-wittig Loading…
2 of 3 tasks
6
[Build] Update LMCache dependency to version 0.3.6
#701 opened Sep 17, 2025 by ikaadil Loading…
3 tasks
2
[Bugfix] kv aware routing for lmcache 0.3.5
#697 opened Sep 15, 2025 by zerofishnoodles Loading…
3 tasks done
4
Introduction of /v1/responses endpoint
#691 opened Sep 9, 2025 by sebastiaanvduijn Loading…
1
13
feat: allow for configuration of number of uvicorn workers
#689 opened Sep 9, 2025 by TheCodeWrangler Loading…
8 tasks done
9
[Docs] Correct parameter in transcription API tutorial
#685 opened Sep 7, 2025 by davidgao7 Loading…
3 tasks done
3
[Bugfix] cache server yaml err
#677 opened Sep 4, 2025 by yyzxw Loading…
3 tasks done
1
3
[Misc] Add Makefile to run full pipeline with a single command
#675 opened Sep 3, 2025 by ikaadil Loading…
12
[Router][Feat][Bugfix] Add Swagger UI (OpenAPI) support with Pydantic request models + fix rewrite Content-Length + test
#672 opened Sep 2, 2025 by JaredforReal Loading…
1
9
[Feat][Router] Add TTFT Routing
#670 opened Sep 1, 2025 by chickeyton • Draft
3 tasks
1
48
[Feat][PD] lastest PD support from LMCache with NIXL
#669 opened Aug 28, 2025 by kobe0938 Loading…
3 tasks
17
[Bug][Router] ZombieIP: router routes to model pod that doesn't exist anymore
#666 opened Aug 26, 2025 by jonoillar Loading…
3 tasks
1
25
[CI] Fix bug for PD CI when router is running before vllm instance running
#663 opened Aug 26, 2025 by zerofishnoodles Loading…
3 tasks done
1
[Build] use uv with cache mount for faster docker builds
#657 opened Aug 23, 2025 by Hexoplon Loading…
3 tasks done
3
[Feat][Router] add ability to specify params to drop
#650 opened Aug 20, 2025 by max-wittig Loading…
3 tasks done
6
[Feat][Router] Add simple request migration for vLLM failure
#643 opened Aug 12, 2025 by lucas-tucker Loading…
14
Add max_model_len field support to router
#638 opened Aug 11, 2025 by llm-net Loading…
4
ProTip! What’s not been updated in a month: updated:<2025-10-05.