All pull requests

Pull requests

• [Misc] Log unsupported FlashAttention version as a one-time warning

  #63592·Raghu-dev-pixel opened Oct 25, 2026·

  ·
  1

• [Perf][Kernel] AWQ: vectorize the output store in dequantize_weights

  performancequantization
  #63590·thickett opened Oct 25, 2026·6 tasks done·

  ·
  3

• [Frontend] Support Llama for structured decisions

  documentationfrontendllama
  #63589·Hayashi-Yudai opened Oct 25, 2026·6 tasks done·

  ·
  2

• [Build] Install infiniband-diags for DeepEPv2 RDMA bandwidth detection

  ci/builddocumentationready
  #63588·devopsInterviews opened Oct 25, 2026·

  ·
  1

  7

• [Feature][KV Offload] Enable compressed-MLA support for TP agnostic offloading

  kv-connector
  #63586·rwtarpit opened Oct 25, 2026·5 of 6 tasks·

  ·
  2

• [Model] Support Ming3-ASR (inclusionAI/Ming-3.0-asr-tiny)

  ci/builddocumentationfrontendmulti-modalitynew-modelrecipe
  #63585·yuanheng-zhao opened Oct 25, 2026Contributor·4 of 6 tasks·

  ·
  3

• [Rust Frontend][gRPC] Accept per-worker weight update arrays

  rust
  #63583·zxgsn opened Oct 25, 2026·6 tasks done·

  ·
  1

• [Bugfix][Parser] Keep streamed tool-call indices contiguous when a call is rejected

  bugkimiminimaxtool-calling
  #63582·usman7384 opened Oct 25, 2026·6 tasks done·

  ·
  1

  1

• [Bugfix][Rust Frontend] Return 400 instead of 500 when tool parsing is disabled

  bugrust
  #63580·vito-lin-dev opened Oct 25, 2026·5 of 6 tasks·

  ·
  3

• [Attention] Trace-driven fusion follow-ups: DFlash pad split, native decode lens, Gumbel finalize

  deepseekdflashDSv4DSv4.1mrv2speculative-decoding
  #63579·elvircrn opened Oct 25, 2026Contributor·

  ·

• [Feature][KV Offload] Add mamba_aware_lru eviction policy for hybrid models

  documentationkv-connector
  #63578·shaharmor98 opened Oct 25, 2026Contributor·6 tasks done·

  ·
  1

• [Perf][Distributed] Read peers in rank-rotated order in the one-shot custom all-gather

  #63577·kimseunghyun-kr opened Oct 25, 2026Contributor·6 tasks done·

  ·

• [Bugfix][ROCm][DSv4.1] Await krdy before K2's combine reads klen in index-source launches

  bugdeepseekDSv4.1rocm
  #63576·AndreasKaratzas opened Oct 25, 2026Member·

  ·

• [Bugfix][Frontend] Preserve nullable MCP tool schemas

  bugdocumentationfrontendtool-calling
  #63575·bnkaiteam opened Oct 25, 2026Contributor·6 tasks done·

  ·
  1

• [Security] Raise patched runtime and test dependency floors

  ci/buildcpu
  #63574·jperezdealgaba opened Oct 25, 2026Contributor·5 of 6 tasks·

  ·
  2

• [Bugfix] Wrap parallel-sampling child seeds into int64

  bug
  #63572·vmanvs opened Oct 25, 2026·6 tasks done·

  ·
  1

• [Tool Calling] Migrate llama3_json parser to parser engine

  llamareadytool-calling
  #63569·arpera opened Oct 25, 2026Contributor·6 tasks done·

  ·
  13

• [ROCm][Perf] Add AITER FlashKDA prefill backend for GLM KDA

  glmrocm
  #63568·eppaneamd opened Oct 25, 2026·5 of 6 tasks·

  ·
  1

• [MRV2] Support routed-expert returns with decode staging

  ci/builddocumentationmrv2
  #63567·algebra-MCX opened Oct 25, 2026Contributor·6 tasks done·

  ·
  1

• [Bugfix][KV Offload] Pin a shared-prefix junction when a sparse group cuts the offload hit

  bugkv-connector
  #63566·KaloyanNaumov opened Oct 25, 2026·6 tasks done·

  ·
  1

  2

• [Bugfix][MRV2] Bound prompt-logprobs chunks by max_num_reqs

  bugmrv2
  #63564·KaloyanNaumov opened Oct 25, 2026·6 tasks done·

  ·
  1

  1

• [ROCm][Bugfix][Perf] Route AutoAWQ checkpoints to the RDNA W4A16 kernel and retune gfx12 small-M tiles

  bugdocumentationquantizationrocm
  #63562·daibenzhe opened Oct 25, 2026·6 tasks done·

  ·
  2

• [Perf][Quantization] Prefer Humming over Marlin for int4 g128 on SM100

  quantization
  #63561·namgyu-youn opened Oct 25, 2026Contributor·6 tasks done·

  ·
  1

• [Recipe] DeepSeek-V4.1-Flash: AgentX lanes as tuned presets

  deepseekDSv4.1readyrecipe
  #63560·esmeetu opened Oct 25, 2026Member·6 tasks done·

  ·
  5

• [CI][ROCm] Skip the AITER MoE garbage-rows test for fp8 per-tensor until the AITER fix

  rocm
  #63559·AndreasKaratzas opened Oct 25, 2026Member·

  ·