Commits

Commit history

1. Commits on Oct 24, 2026

   • feat(mtmd): add audio stream queries and Soprano TTS support

     Show description for c832fe6
     JamePeng

     committed
     c832fe6View commit details

     Copy full SHA for c832fe6

     View code at this pointBrowse repository at this point
2. Commits on Oct 18, 2026

   • docs(benchmarks): document and measure cache reuse and MTP rollback

     Show description for b0f97a1
     JamePeng

     committed
     b0f97a1View commit details

     Copy full SHA for b0f97a1

     View code at this pointBrowse repository at this point
3. Commits on Oct 16, 2026

   • feat(examples): add Qwen3-VL embedding CLI profile

     Show description for ca15297
     JamePeng

     committed
     ca15297View commit details

     Copy full SHA for ca15297

     View code at this pointBrowse repository at this point
4. Commits on Oct 15, 2026

   • feat(mtmd/mtp): add MTP image chat example with decode benchmarks

     Show description for 67f2d28
     JamePeng

     committed
     67f2d28View commit details

     Copy full SHA for 67f2d28

     View code at this pointBrowse repository at this point
5. Commits on Oct 13, 2026

   • feat(mtmd/embedding): add MTMD-based multimodal embeddings

     Show description for 28b8e64
     JamePeng

     committed
     28b8e64View commit details

     Copy full SHA for 28b8e64

     View code at this pointBrowse repository at this point
6. Commits on Sep 13, 2026

   • feat(examples): add a Streamlit TTS playground and usage guide

     Show description for 5b0a7e8
     JamePeng

     committed
     5b0a7e8View commit details

     Copy full SHA for 5b0a7e8

     View code at this pointBrowse repository at this point

   • feat(examples): add a command-line MTMD TTS demo

     Show description for 49ee2aa
     JamePeng

     committed
     49ee2aaView commit details

     Copy full SHA for 49ee2aa

     View code at this pointBrowse repository at this point
7. Commits on Sep 1, 2026

   • Rename Chat.py to chat.py

     JamePeng

     authored
     9e30d14View commit details

     Copy full SHA for 9e30d14

     View code at this pointBrowse repository at this point

   • docs(examples): refresh low-level API guidance

     Show description for 62b7e98
     JamePeng

     committed
     62b7e98View commit details

     Copy full SHA for 62b7e98

     View code at this pointBrowse repository at this point

   • refactor(examples): rebuild low-level API examples

     Show description for e864173
     JamePeng

     committed
     e864173View commit details

     Copy full SHA for e864173

     View code at this pointBrowse repository at this point
8. Commits on Aug 28, 2026

   • feat(examples): expose DFlash2 benchmark configuration

     Show description for c57b174
     JamePeng

     committed
     c57b174View commit details

     Copy full SHA for c57b174

     View code at this pointBrowse repository at this point
9. Commits on Aug 27, 2026

   • feat(multimodal): add MTMD video chat example

     Show description for 464ccca
     JamePeng

     committed
     464cccaView commit details

     Copy full SHA for 464ccca

     View code at this pointBrowse repository at this point
10. Commits on Aug 23, 2026

    • feat(examples): add DFlash and DSpark throughput benchmark

      Show description for 52a46c3
      JamePeng

      committed
      52a46c3View commit details

      Copy full SHA for 52a46c3

      View code at this pointBrowse repository at this point
11. Commits on Aug 22, 2026

    • fix(sampling): align DRY history defaults with llama.cpp

      Show description for 439846e
      JamePeng

      committed
      439846eView commit details

      Copy full SHA for 439846e

      View code at this pointBrowse repository at this point
12. Commits on Aug 19, 2026

    • feat(speculative): separate MTP and n-gram benchmark tuning parameters

      Show description for da9d87e
      JamePeng

      committed
      da9d87eView commit details

      Copy full SHA for da9d87e

      View code at this pointBrowse repository at this point
13. Commits on Aug 18, 2026

    • feat(examples): support built-in and external MTP benchmarks

      Show description for e4f29b0
      JamePeng

      committed
      e4f29b0View commit details

      Copy full SHA for e4f29b0

      View code at this pointBrowse repository at this point
14. Commits on Jul 28, 2026

    • docs: document `load_mode` migration

      Show description for bab3061
      JamePeng

      committed
      bab3061View commit details

      Copy full SHA for bab3061

      View code at this pointBrowse repository at this point

    • feat(llama): support llama_model_params load_mode

      Show description for 00591a5
      JamePeng

      committed
      00591a5View commit details

      Copy full SHA for 00591a5

      View code at this pointBrowse repository at this point
15. Commits on Jul 26, 2026

    • docs(example): refresh the built-in embedding usage example

      Show description for 77b7fa1
      JamePeng

      committed
      77b7fa1View commit details

      Copy full SHA for 77b7fa1

      View code at this pointBrowse repository at this point
16. Commits on May 23, 2026

    • examples: add benchmark script for speculative decoding

      Show description for 91627a0
      JamePeng

      committed
      91627a0View commit details

      Copy full SHA for 91627a0

      View code at this pointBrowse repository at this point
17. Commits on Feb 9, 2026

    • Refactor Llama class to use new LlamaSampler chain API from _internals

      Show description for 1e6094a
      JamePeng

      committed
      1e6094aView commit details

      Copy full SHA for 1e6094a

      View code at this pointBrowse repository at this point
18. Commits on Feb 7, 2026

    • Refactor sampling infrastructure to use llama.cpp sampler chain API

      Show description for 1df39b4
      JamePeng

      committed
      1df39b4View commit details

      Copy full SHA for 1df39b4

      View code at this pointBrowse repository at this point
19. Commits on Jan 29, 2026

    • Sync llama : disable Direct IO by default

      JamePeng

      committed
      5bdff0bView commit details

      Copy full SHA for 5bdff0b

      View code at this pointBrowse repository at this point
20. Commits on Jan 8, 2026

    • Update llama.cpp API 20260108

      JamePeng

      committed
      4d0fe24View commit details

      Copy full SHA for 4d0fe24

      View code at this pointBrowse repository at this point
21. Commits on Mar 13, 2025

    • class LlamaSampler: append add_xtc(), add_top_n_sigma() and add_dry()

      Show description for c21dc41
      JamePeng

      committed
      c21dc41View commit details

      Copy full SHA for c21dc41

      View code at this pointBrowse repository at this point
22. Commits on Dec 6, 2024

    • fix(examples): Refactor Batching notebook to use new sampler chain API (#1793)

      Show description for d610477
      lukestanley

      authored
      d610477View commit details

      Copy full SHA for d610477

      View code at this pointBrowse repository at this point
23. Commits on Jul 9, 2024

    • fix(misc): Format

      abetlen

      committed
      c1ae815View commit details

      Copy full SHA for c1ae815

      View code at this pointBrowse repository at this point
24. Commits on Jun 13, 2024

    • feat: Support SPM infill (#1492)

      Show description for dbcf64c
      

      CISC

      and

      abetlen

      authored
      dbcf64cView commit details

      Copy full SHA for dbcf64c

      View code at this pointBrowse repository at this point
25. Commits on May 17, 2024

    • example: LLM inference with Ray Serve (#1465)

      rgerganov

      authored
      03f171eView commit details

      Copy full SHA for 03f171e

      View code at this pointBrowse repository at this point
26. Commits on Apr 28, 2024

    • examples: fix quantize example (#1387)

      Show description for e6bbfb8
      iyubondyrev

      authored
      e6bbfb8View commit details

      Copy full SHA for e6bbfb8

      View code at this pointBrowse repository at this point
27. Commits on Apr 10, 2024

    • feat: Add support for yaml based configs

      abetlen

      committed
      060bfa6View commit details

      Copy full SHA for 060bfa6

      View code at this pointBrowse repository at this point
28. Commits on Feb 26, 2024

    • docs: Update multimodal example

      abetlen

      committed
      79c649cView commit details

      Copy full SHA for 79c649c

      View code at this pointBrowse repository at this point

    • docs: Update multimodal example

      abetlen

      committed
      bf315eeView commit details

      Copy full SHA for bf315ee

      View code at this pointBrowse repository at this point

    • docs(examples): Add huggingface pull example

      abetlen

      committed
      252e1ffView commit details

      Copy full SHA for 252e1ff

      View code at this pointBrowse repository at this point

    • docs(examples): Add gradio chat example

      abetlen

      committed
      bd4ec2eView commit details

      Copy full SHA for bd4ec2e

      View code at this pointBrowse repository at this point