Commits

Commit history

1. Commits on Sep 19, 2024

   • Improve LlamaState test and fix rng / seed

     abetlen

     committed
     8306d1cView commit details

     Copy full SHA for 8306d1c

     View code at this pointBrowse repository at this point

   • Add basic LlamaState tests

     abetlen

     committed
     e552955View commit details

     Copy full SHA for e552955

     View code at this pointBrowse repository at this point

   • feat: Update sampling API for llama.cpp (#1742)

     Show description for f8fcb3e
     abetlen

     authored
     f8fcb3eView commit details

     Copy full SHA for f8fcb3e

     View code at this pointBrowse repository at this point
2. Commits on Jun 4, 2024

   • fix: Avoid duplicate special tokens in chat formats (#1439)

     Show description for 027f7bc
     

     CISC

     and

     abetlen

     authored
     027f7bcView commit details

     Copy full SHA for 027f7bc

     View code at this pointBrowse repository at this point
3. Commits on Apr 30, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     97fb860View commit details

     Copy full SHA for 97fb860

     View code at this pointBrowse repository at this point
4. Commits on Feb 26, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     cbbcd88View commit details

     Copy full SHA for cbbcd88

     View code at this pointBrowse repository at this point
5. Commits on Feb 21, 2024

   • feat(low-level-api): Improve API static type-safety and performance (#1205)

     abetlen

     authored
     7f51b60View commit details

     Copy full SHA for 7f51b60

     View code at this pointBrowse repository at this point
6. Commits on Feb 8, 2024

   • misc: rename grammar test

     abetlen

     committed
     2ef7ba3View commit details

     Copy full SHA for 2ef7ba3

     View code at this pointBrowse repository at this point
7. Commits on Jan 31, 2024

   • Add speculative decoding (#1120)

     Show description for fb762a6
     abetlen

     authored
     fb762a6View commit details

     Copy full SHA for fb762a6

     View code at this pointBrowse repository at this point
8. Commits on Jan 29, 2024

   • Add chat format test.

     abetlen

     committed
     9ae5819View commit details

     Copy full SHA for 9ae5819

     View code at this pointBrowse repository at this point
9. Commits on Jan 22, 2024

   • fix: from_json_schema oneof/anyof bug. Closes #1097

     abetlen

     committed
     d3f5528View commit details

     Copy full SHA for d3f5528

     View code at this pointBrowse repository at this point
10. Commits on Jan 19, 2024

    • feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

      abetlen

      committed
      b8fc1c7View commit details

      Copy full SHA for b8fc1c7

      View code at this pointBrowse repository at this point
11. Commits on Jan 17, 2024

    • Integration of Jinja2 Templating (#875)

      Show description for 6bfe98b
      teleprint-me

      authored
      6bfe98bView commit details

      Copy full SHA for 6bfe98b

      View code at this pointBrowse repository at this point
12. Commits on Jan 15, 2024

    • Fix Pydantic model parsing (#1087)

      DeNeutoy

      authored
      c689cccView commit details

      Copy full SHA for c689ccc

      View code at this pointBrowse repository at this point
13. Commits on Dec 16, 2023

    • Fix logits_to_logprobs for 2-D and 3-D logits (#1002)

      Show description for 5a89446
      kddubey

      authored
      5a89446View commit details

      Copy full SHA for 5a89446

      View code at this pointBrowse repository at this point
14. Commits on Nov 22, 2023

    • tests: add mock_kv_cache placeholder functions

      abetlen

      committed
      9515467View commit details

      Copy full SHA for 9515467

      View code at this pointBrowse repository at this point

    • tests: avoid constantly reallocating logits

      abetlen

      committed
      0ea2444View commit details

      Copy full SHA for 0ea2444

      View code at this pointBrowse repository at this point

    • tests: don't mock sampling functions

      abetlen

      committed
      0a7e05bView commit details

      Copy full SHA for 0a7e05b

      View code at this pointBrowse repository at this point
15. Commits on Nov 21, 2023

    • Use mock_llama for all tests

      abetlen

      committed
      d7388f1View commit details

      Copy full SHA for d7388f1

      View code at this pointBrowse repository at this point

    • Do not set `grammar` to `None` for new `LlamaGrammar` objects (#834)

      Show description for c21edb6
      mthuurne

      authored
      c21edb6View commit details

      Copy full SHA for c21edb6

      View code at this pointBrowse repository at this point

    • tests: Improve llama.cpp mock

      abetlen

      committed
      3dc21b2View commit details

      Copy full SHA for 3dc21b2

      View code at this pointBrowse repository at this point
16. Commits on Nov 20, 2023

    • Update llama.cpp

      abetlen

      committed
      2c2afa3View commit details

      Copy full SHA for 2c2afa3

      View code at this pointBrowse repository at this point
17. Commits on Nov 10, 2023

    • Fix tests

      abetlen

      committed
      e32ecb0View commit details

      Copy full SHA for e32ecb0

      View code at this pointBrowse repository at this point
18. Commits on Nov 6, 2023

    • Refactor Llama class internals

      abetlen

      committed
      e214a58View commit details

      Copy full SHA for e214a58

      View code at this pointBrowse repository at this point
19. Commits on Nov 3, 2023

    • Migrate inference to llama_batch and llama_decode api (#795)

      Show description for ab028cb
      

      abetlen

      and

      antoine-lizee

      authored
      ab028cbView commit details

      Copy full SHA for ab028cb

      View code at this pointBrowse repository at this point
20. Commits on Nov 2, 2023

    • fix: tokenization of special characters: (#850)

      Show description for 4d4e0f1
      

      antoine-lizee

      authored and

      abetlen

      committed
      4d4e0f1View commit details

      Copy full SHA for 4d4e0f1

      View code at this pointBrowse repository at this point
21. Commits on Oct 19, 2023

    • Enable finish reason tests

      abetlen

      committed
      ef03d77View commit details

      Copy full SHA for ef03d77

      View code at this pointBrowse repository at this point

    • Re-enable tests completion function

      abetlen

      committed
      cbeef36View commit details

      Copy full SHA for cbeef36

      View code at this pointBrowse repository at this point
22. Commits on Sep 29, 2023

    • Update llama.cpp

      abetlen

      committed
      1a1c3dcView commit details

      Copy full SHA for 1a1c3dc

      View code at this pointBrowse repository at this point
23. Commits on Sep 5, 2023

    • add test to see if llama_cpp.__version__ exists

      janvdp

      committed
      f49b6d7View commit details

      Copy full SHA for f49b6d7

      View code at this pointBrowse repository at this point
24. Commits on Aug 27, 2023

    • Update llama.cpp

      abetlen

      committed
      4887973View commit details

      Copy full SHA for 4887973

      View code at this pointBrowse repository at this point

    • Update llama.cpp

      abetlen

      committed
      3a29d65View commit details

      Copy full SHA for 3a29d65

      View code at this pointBrowse repository at this point
25. Commits on Aug 25, 2023

    • Strip leading space when de-tokenizing.

      abetlen

      committed
      8ac5946View commit details

      Copy full SHA for 8ac5946

      View code at this pointBrowse repository at this point
26. Commits on Aug 24, 2023

    • Update model path

      abetlen

      committed
      3674e5eView commit details

      Copy full SHA for 3674e5e

      View code at this pointBrowse repository at this point
27. Commits on May 19, 2023

    • Fix llama_cpp and Llama type signatures. Closes #221

      abetlen

      committed
      01a010bView commit details

      Copy full SHA for 01a010b

      View code at this pointBrowse repository at this point