Skip to content

Pull requests: flashinfer-ai/flashinfer

New pull request New
70 Open 1,454 Closed
70 Open 1,454 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

perf: improve sampling/mask/softmax performance (part 1/2)
#2044 opened Nov 5, 2025 by yzh119 Loading…
5 tasks
10
fix: support both pip and uv pip for finding flashinfer-python package
#2043 opened Nov 5, 2025 by djmmoss Loading…
6
[wip] test: Fix test_sampling.py on Spark
#2042 opened Nov 5, 2025 by bkryu Loading…
3 of 5 tasks
@bkryu
8
feat: Add flashinfer.rope.rope_quantize_fp8_append_paged_kv_cache (fused RoPE + Q + KV cache, supports MLA/GQA/MHA)
#2037 opened Nov 4, 2025 by kahyunnam Loading…
5 tasks done
@kahyunnam
34
Added an initial implementation of Q and KV Cache in fp8 and to use t…
#2035 opened Nov 4, 2025 by Anerudhan • Draft
3 tasks done
1
Enable renormalize(naive) routing for fp8 per-tensor
#2030 opened Nov 3, 2025 by IwakuraRein • Draft
5 tasks
1
feat: suitable_auto_backends to prune auto backends, bmm_fp8 refactor, heuristic_func intake
#2029 opened Nov 3, 2025 by jimmyzho Loading…
3 of 5 tasks
23
[NVIDIA] Thor & Spark Support
#2028 opened Nov 3, 2025 by johnnynunez Loading…
6
Refactor flashinfer/__init__.py so that applications could selectively pack submodules without modifying __init__.py
#2027 opened Nov 3, 2025 by bangshengtang Loading…
5 tasks done
6
update trtllm cutlass moe
#2020 opened Oct 31, 2025 by nv-yunzheq Loading…
3 of 5 tasks
35
[DSV3] Optimized Router Gemm
#2019 opened Oct 31, 2025 by nvmbreughe Loading…
3 of 5 tasks
31
[feat] Refactor trtllmgen MOE and add Bf16 trtllmgen moe
#2014 opened Oct 30, 2025 by jiahanc Loading…
5 tasks done
8
Blockwise GEMM with all reduce overlapping
#2007 opened Oct 30, 2025 by Amir-19 • Draft
5 tasks
1
refactor: backend_requirement + supported_compute_capability decorator for gemm
#2000 opened Oct 29, 2025 by jimmyzho Loading…
5 tasks
23
chore: Update CODEOWNERS automated maintenance
#1984 opened Oct 27, 2025 by flashinfer-bot Loading…
8
[wip] feat: Add backend='auto' to mm_fp4 and enable autotune for backend='cudnn'
#1979 opened Oct 25, 2025 by bkryu • Draft
5 tasks done
@bkryu
22
Update trtllm-gen fused moe routing kernel and add more kernels
#1955 opened Oct 20, 2025 by jiahanc Loading…
3 of 5 tasks
25
chore: agentic workflow for automatic version bump
#1947 opened Oct 19, 2025 by yzh119 Loading…
5 tasks
34
chore: upgrade cutlass moe kernel launcher to match trtllm
#1925 opened Oct 13, 2025 by aleozlx Loading…
4 of 5 tasks
@aleozlx @yongwww
42
add blockwise gemm cute dsl
#1922 opened Oct 13, 2025 by Amir-19 Loading…
5 tasks
7
Sampling non contiguous
#1916 opened Oct 12, 2025 by zcin Loading…
5 tasks done
1
8
Fix "cannot find -lcuda & -lcudart" problem in WSL2
#1909 opened Oct 10, 2025 by HelloCard Loading…
3 tasks
10
documented sampling.cuh
#1864 opened Oct 4, 2025 by yonikremer Loading…
3
Feature/moe bf16 pr
#1859 opened Oct 4, 2025 by aleozlx • Draft
4 of 5 tasks
2
[wip] test: add coverage for all cli commands
#1848 opened Oct 2, 2025 by sricketts • Draft
2 of 5 tasks
@sricketts
1
ProTip! Filter pull requests by the default branch with base:main.