Commits

Commit history

1. Commits on Aug 10, 2026

   • feat: update llama.cpp to 936918514 (#2348)

     Show description for 67014fd
     abetlen

     authored
     67014fdView commit details

     Copy full SHA for 67014fd

     View code at this pointBrowse repository at this point
2. Commits on Jun 22, 2026

   • fix: preserve recurrent/hybrid model state when the full prompt is already cached (#2306)

     Show description for 9be3cd1
     

     allthatido

     and

     Ankur Kaul

     authored
     9be3cd1View commit details

     Copy full SHA for 9be3cd1

     View code at this pointBrowse repository at this point
3. Commits on Jun 1, 2026

   • fix: clear prompt for recurrent / hybrid models when only a partial prefix matches (#2108)

     Show description for cdb7a75
     

     avion23

     and

     Ralf Waldukat

     authored
     cdb7a75View commit details

     Copy full SHA for cdb7a75

     View code at this pointBrowse repository at this point
4. Commits on May 8, 2026

   • fix: configure n_seq_max for batched embeddings (#2206)

     Show description for 128c331
     abetlen

     authored
     128c331View commit details

     Copy full SHA for 128c331

     View code at this pointBrowse repository at this point
5. Commits on May 4, 2026

   • fix(_internals): use n_tokens0 offset when enabling last-token logits in add_sequence (#2205)

     Show description for 90e8df9
     Anai-Guo

     authored
     90e8df9View commit details

     Copy full SHA for 90e8df9

     View code at this pointBrowse repository at this point
6. Commits on Mar 25, 2026

   • fix: handle embedding models without KV memory (#2160)

     Show description for ac59e5a
     abetlen

     authored
     ac59e5aView commit details

     Copy full SHA for ac59e5a

     View code at this pointBrowse repository at this point
7. Commits on Mar 23, 2026

   • fix: Qwen 3.5 support (#2152)

     Show description for 11e7a55
     abetlen

     authored
     11e7a55View commit details

     Copy full SHA for 11e7a55

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp to ggerganov/llama.cpp@49bfddeca18e62fa3d39114a23e9fcbdf8a22388 (#2151)

     Show description for 18aa31e
     abetlen

     authored
     18aa31eView commit details

     Copy full SHA for 18aa31e

     View code at this pointBrowse repository at this point
8. Commits on Mar 22, 2026

   • misc: Add Ruff formatting (#2148)

     Show description for a9b4a06
     abetlen

     authored
     a9b4a06View commit details

     Copy full SHA for a9b4a06

     View code at this pointBrowse repository at this point
9. Commits on Jul 5, 2025

   • fix: Update reference to in Llama.embed. Closes #2037

     abetlen

     committed
     9e5a4eaView commit details

     Copy full SHA for 9e5a4ea

     View code at this pointBrowse repository at this point
10. Commits on Sep 19, 2024

    • fix: Fix memory allocation of ndarray (#1704)

      Show description for 22cedad
      

      xu-song

      and

      abetlen

      authored
      22cedadView commit details

      Copy full SHA for 22cedad

      View code at this pointBrowse repository at this point

    • feat: Update sampling API for llama.cpp (#1742)

      Show description for f8fcb3e
      abetlen

      authored
      f8fcb3eView commit details

      Copy full SHA for f8fcb3e

      View code at this pointBrowse repository at this point
11. Commits on Jun 4, 2024

    • fix: Avoid duplicate special tokens in chat formats (#1439)

      Show description for 027f7bc
      

      CISC

      and

      abetlen

      authored
      027f7bcView commit details

      Copy full SHA for 027f7bc

      View code at this pointBrowse repository at this point
12. Commits on Apr 30, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      97fb860View commit details

      Copy full SHA for 97fb860

      View code at this pointBrowse repository at this point
13. Commits on Feb 26, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      cbbcd88View commit details

      Copy full SHA for cbbcd88

      View code at this pointBrowse repository at this point
14. Commits on Feb 21, 2024

    • feat(low-level-api): Improve API static type-safety and performance (#1205)

      abetlen

      authored
      7f51b60View commit details

      Copy full SHA for 7f51b60

      View code at this pointBrowse repository at this point
15. Commits on Feb 8, 2024

    • misc: rename grammar test

      abetlen

      committed
      2ef7ba3View commit details

      Copy full SHA for 2ef7ba3

      View code at this pointBrowse repository at this point
16. Commits on Jan 31, 2024

    • Add speculative decoding (#1120)

      Show description for fb762a6
      abetlen

      authored
      fb762a6View commit details

      Copy full SHA for fb762a6

      View code at this pointBrowse repository at this point
17. Commits on Jan 29, 2024

    • Add chat format test.

      abetlen

      committed
      9ae5819View commit details

      Copy full SHA for 9ae5819

      View code at this pointBrowse repository at this point
18. Commits on Jan 22, 2024

    • fix: from_json_schema oneof/anyof bug. Closes #1097

      abetlen

      committed
      d3f5528View commit details

      Copy full SHA for d3f5528

      View code at this pointBrowse repository at this point
19. Commits on Jan 19, 2024

    • feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

      abetlen

      committed
      b8fc1c7View commit details

      Copy full SHA for b8fc1c7

      View code at this pointBrowse repository at this point
20. Commits on Jan 17, 2024

    • Integration of Jinja2 Templating (#875)

      Show description for 6bfe98b
      teleprint-me

      authored
      6bfe98bView commit details

      Copy full SHA for 6bfe98b

      View code at this pointBrowse repository at this point
21. Commits on Jan 15, 2024

    • Fix Pydantic model parsing (#1087)

      DeNeutoy

      authored
      c689cccView commit details

      Copy full SHA for c689ccc

      View code at this pointBrowse repository at this point
22. Commits on Dec 16, 2023

    • Fix logits_to_logprobs for 2-D and 3-D logits (#1002)

      Show description for 5a89446
      kddubey

      authored
      5a89446View commit details

      Copy full SHA for 5a89446

      View code at this pointBrowse repository at this point
23. Commits on Nov 22, 2023

    • tests: add mock_kv_cache placeholder functions

      abetlen

      committed
      9515467View commit details

      Copy full SHA for 9515467

      View code at this pointBrowse repository at this point

    • tests: avoid constantly reallocating logits

      abetlen

      committed
      0ea2444View commit details

      Copy full SHA for 0ea2444

      View code at this pointBrowse repository at this point

    • tests: don't mock sampling functions

      abetlen

      committed
      0a7e05bView commit details

      Copy full SHA for 0a7e05b

      View code at this pointBrowse repository at this point
24. Commits on Nov 21, 2023

    • Use mock_llama for all tests

      abetlen

      committed
      d7388f1View commit details

      Copy full SHA for d7388f1

      View code at this pointBrowse repository at this point

    • Do not set `grammar` to `None` for new `LlamaGrammar` objects (#834)

      Show description for c21edb6
      mthuurne

      authored
      c21edb6View commit details

      Copy full SHA for c21edb6

      View code at this pointBrowse repository at this point

    • tests: Improve llama.cpp mock

      abetlen

      committed
      3dc21b2View commit details

      Copy full SHA for 3dc21b2

      View code at this pointBrowse repository at this point
25. Commits on Nov 20, 2023

    • Update llama.cpp

      abetlen

      committed
      2c2afa3View commit details

      Copy full SHA for 2c2afa3

      View code at this pointBrowse repository at this point
26. Commits on Nov 10, 2023

    • Fix tests

      abetlen

      committed
      e32ecb0View commit details

      Copy full SHA for e32ecb0

      View code at this pointBrowse repository at this point
27. Commits on Nov 6, 2023

    • Refactor Llama class internals

      abetlen

      committed
      e214a58View commit details

      Copy full SHA for e214a58

      View code at this pointBrowse repository at this point
28. Commits on Nov 3, 2023

    • Migrate inference to llama_batch and llama_decode api (#795)

      Show description for ab028cb
      

      abetlen

      and

      antoine-lizee

      authored
      ab028cbView commit details

      Copy full SHA for ab028cb

      View code at this pointBrowse repository at this point
29. Commits on Nov 2, 2023

    • fix: tokenization of special characters: (#850)

      Show description for 4d4e0f1
      

      antoine-lizee

      authored and

      abetlen

      committed
      4d4e0f1View commit details

      Copy full SHA for 4d4e0f1

      View code at this pointBrowse repository at this point