Discussions

• 1 You must be logged in to vote

  🙌

  claude-dash — real-time statusline for Claude Code sessions

  krabat-l started Mar 28, 2026 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙏

  [Doc]: recommended docker for visual_gen

  Doc <NV>TRTLLM's textual/illustrative materials: API refs, guides, tutorials. Improvement & clarity. VisualGen

  christopher5106 asked Mar 10, 2026 in Q&A · Answered

  

  

  8
• 1 You must be logged in to vote

  🙌

  Showcase / question: a board-proven offline language runtime on ESP32-C3, and whether this hints at a more specialized future for language inference

  Alpha-Guardian started Mar 18, 2026 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  💬

  How can I do tool calling for gpt-oss-120B

  prakshalm started Mar 12, 2026 in General

  

  

  0
• 2 You must be logged in to vote

  💬

  Would TensorRT-LLM open its roadmap ?

  inference666 started Feb 25, 2026 in General

  

  

  2
• 1 You must be logged in to vote

  🙏

  When trying to use json_schema in response_format, wrapper field(schema) cannot be used.

  khe0613 asked Dec 15, 2025 in Q&A · Closed · Answered

  

  

  

  

  5
• 0 You must be logged in to vote

  🙏

  Layerwise benchmarks

  youki-sada asked Dec 11, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  logit processor not behaving as expected

  jwd-dev asked Jan 2, 2026 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  RTX 6000 PRO sm120 and gpt-oss

  voipmonitor asked Sep 24, 2025 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  [TensorRT-LLM] KVCacheManager.add_sequence_with_eviction API compatibility issue

  ShaobinChen-AH asked Feb 9, 2026 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  #11211 PR Discussion

  SchumiDing started Feb 3, 2026 in General

  

  

  1
• 2 You must be logged in to vote

  💡

  Support for Jetson Orin (NX or Nano)

  WilliamTambellini started Dec 16, 2025 in Ideas

  

  

  

  

  5
• 1 You must be logged in to vote

  💬

  Routing request: H100 “OOM wall” at N=500k + indexed O(N) retrieval (seeking owner for NDA evaluation)

  StanByriukov02 started Dec 18, 2025 in General

  

  

  0
• 2 You must be logged in to vote

  💬

  Support for Qwen3-VL 2B/4B?

  JimikoSK started Nov 3, 2025 in General

  

  

  

  

  3
• 3 You must be logged in to vote

  🙏

  What each type of buffer is doing?

  alxmamaev asked Sep 14, 2025 in Q&A · Answered

  

  

  7
• 1 You must be logged in to vote

  🙏

  Does the TensorRT-LLM Triton backend support BERT model inference in Triton Inference Server?

  unix1986 asked Dec 1, 2025 in Q&A · Unanswered

  

  

  0
• 6 You must be logged in to vote

  💡

  Support for ASR Omnilingual model from Meta

  protonicage started Nov 25, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is there any way to capture the executorWorker's errors?

  matiaslin asked Nov 19, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Do we really need tensorrt dependency?

  RobertLou asked Oct 29, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  Offering Refactoring Expertise for Multimodal Bugs (#8652) – 20+ Yrs Exp in AI/ML

  pythonjavaerlang started Oct 24, 2025 in General

  

  

  0
• 8 You must be logged in to vote

  📣

  📢 Announcing the TensorRT LLM Software Architecture Roadmap (August 2025 Update)

  QiJune announced Sep 18, 2025 in Announcements

  

  

  1
• 1 You must be logged in to vote

  💬

  reduce docker image size

  geraldstanje1 started Oct 15, 2025 in General

  

  

  0
• 3 You must be logged in to vote

  🙌

  RTX 5090 + FP4 + Open WebUI via TensorRT-LLM (because VLLM made me cry at 2am)

  rdumasia303 started Oct 13, 2025 in Show and tell

  

  

  0
• 3 You must be logged in to vote

  🙏

  qwen omni

  piotr-frankowski-tcl asked May 28, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Does TensorrtLLM support v1/response api?

  sowmen asked Aug 28, 2025 in Q&A · Unanswered

  

  

  0