Skip to content

Pull requests: vllm-project/tpu-inference

New pull request New
57 Open 936 Closed
57 Open 936 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[WIP] [TPU host offload] Setup precompile functions to TPU host offload
#1019 opened Nov 5, 2025 by saikat-royc Loading…
Remove SKIP_JAX_PRECOMPILE
#1018 opened Nov 5, 2025 by kyuyeunk Loading…
1
Remove JAX_RANDOM_WEIGHTS
#1017 opened Nov 5, 2025 by kyuyeunk Loading…
1
Support Embedding Model/Task
#1015 opened Nov 5, 2025 by carlesoctav Loading…
1
2
Fix default value for USE_MOE_EP_KERNEL
#1014 opened Nov 5, 2025 by kyuyeunk Loading…
1
initial commit on compressed-tensors quantization support for fp8
#1011 opened Nov 4, 2025 by qihqi • Draft
1
Add async scheduler test to CI
#1010 opened Nov 4, 2025 by jcyang43 Loading…
1
[GPT-OSS] Load MXFP4 weights directly and dequantize online
#992 opened Oct 31, 2025 by amishacorns Loading…
9
async scheduler fix _substitute_placeholder_token_fn bug
#991 opened Oct 31, 2025 by cychiuak Loading…
4
[Misc] Add CODEOWNERS to the project.
#988 opened Oct 31, 2025 by py4 Loading…
2
[Feature] Add automated PyPI publishing workflow
#985 opened Oct 31, 2025 by ylangtsou Loading…
2
Update tpu_worker_jax.py
#982 opened Oct 30, 2025 by fenyuan-gg Loading…
Add lora layer tests
#981 opened Oct 30, 2025 by vanbasten23 Loading…
7
[GPT-OSS] add unit test for GPT-OSS
#978 opened Oct 30, 2025 by bzgoogle • Draft
1
[DeepSeek][Do-Not-Merge] experimental PR for DeepSeek optimization
#977 opened Oct 30, 2025 by bzgoogle • Draft
1
[FIX] Add dummy get_input_embeddings to fix vLLM model type check
#971 opened Oct 29, 2025 by kuafou Loading…
1
3
[TPU host offload][FIX] Keep KV cache using NamedSharding on CPU
#970 opened Oct 29, 2025 by juncgu-google Loading…
2
[Llama4/JAX] Llama4 FP8 Quantized Weight Loading and Sharding
#962 opened Oct 28, 2025 by sierraisland Loading…
37
[Spec Decoding] Reduce TPU <-> CPU data transfer
#961 opened Oct 28, 2025 by Lumosis Loading…
1
Update README.md
#956 opened Oct 27, 2025 by bvrockwell Loading…
1
Install runai-model-streamer module in Dockerfile
#955 opened Oct 27, 2025 by amacaskill Loading…
1
dtype in ModelConfig will be implicitly casted to torch.dtype so in tpu_jax, we need to check for torch dtype as well
#945 opened Oct 27, 2025 by lc5211 Loading…
1
[GPT-OSS] enable attention-sink
#943 opened Oct 27, 2025 by bzgoogle • Draft
1
[do not review yet] Get rid of a2a
#939 opened Oct 24, 2025 by vanbasten23 • Draft
1
[multi-host] add quick start guide
#928 opened Oct 23, 2025 by Lumosis Loading…
1
ProTip! Mix and match filters to narrow down what you’re looking for.