Commits

Commit history

1. Commits on Feb 26, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     cbbcd88View commit details

     Copy full SHA for cbbcd88

     View code at this pointBrowse repository at this point
2. Commits on Feb 21, 2024

   • feat(low-level-api): Improve API static type-safety and performance (#1205)

     abetlen

     authored
     7f51b60View commit details

     Copy full SHA for 7f51b60

     View code at this pointBrowse repository at this point
3. Commits on Feb 8, 2024

   • misc: rename grammar test

     abetlen

     committed
     2ef7ba3View commit details

     Copy full SHA for 2ef7ba3

     View code at this pointBrowse repository at this point
4. Commits on Jan 31, 2024

   • Add speculative decoding (#1120)

     Show description for fb762a6
     abetlen

     authored
     fb762a6View commit details

     Copy full SHA for fb762a6

     View code at this pointBrowse repository at this point
5. Commits on Jan 29, 2024

   • Add chat format test.

     abetlen

     committed
     9ae5819View commit details

     Copy full SHA for 9ae5819

     View code at this pointBrowse repository at this point
6. Commits on Jan 22, 2024

   • fix: from_json_schema oneof/anyof bug. Closes #1097

     abetlen

     committed
     d3f5528View commit details

     Copy full SHA for d3f5528

     View code at this pointBrowse repository at this point
7. Commits on Jan 19, 2024

   • feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

     abetlen

     committed
     b8fc1c7View commit details

     Copy full SHA for b8fc1c7

     View code at this pointBrowse repository at this point
8. Commits on Jan 17, 2024

   • Integration of Jinja2 Templating (#875)

     Show description for 6bfe98b
     teleprint-me

     authored
     6bfe98bView commit details

     Copy full SHA for 6bfe98b

     View code at this pointBrowse repository at this point
9. Commits on Jan 15, 2024

   • Fix Pydantic model parsing (#1087)

     DeNeutoy

     authored
     c689cccView commit details

     Copy full SHA for c689ccc

     View code at this pointBrowse repository at this point
10. Commits on Dec 16, 2023

    • Fix logits_to_logprobs for 2-D and 3-D logits (#1002)

      Show description for 5a89446
      kddubey

      authored
      5a89446View commit details

      Copy full SHA for 5a89446

      View code at this pointBrowse repository at this point
11. Commits on Nov 22, 2023

    • tests: add mock_kv_cache placeholder functions

      abetlen

      committed
      9515467View commit details

      Copy full SHA for 9515467

      View code at this pointBrowse repository at this point

    • tests: avoid constantly reallocating logits

      abetlen

      committed
      0ea2444View commit details

      Copy full SHA for 0ea2444

      View code at this pointBrowse repository at this point

    • tests: don't mock sampling functions

      abetlen

      committed
      0a7e05bView commit details

      Copy full SHA for 0a7e05b

      View code at this pointBrowse repository at this point
12. Commits on Nov 21, 2023

    • Use mock_llama for all tests

      abetlen

      committed
      d7388f1View commit details

      Copy full SHA for d7388f1

      View code at this pointBrowse repository at this point

    • Do not set `grammar` to `None` for new `LlamaGrammar` objects (#834)

      Show description for c21edb6
      mthuurne

      authored
      c21edb6View commit details

      Copy full SHA for c21edb6

      View code at this pointBrowse repository at this point

    • tests: Improve llama.cpp mock

      abetlen

      committed
      3dc21b2View commit details

      Copy full SHA for 3dc21b2

      View code at this pointBrowse repository at this point
13. Commits on Nov 20, 2023

    • Update llama.cpp

      abetlen

      committed
      2c2afa3View commit details

      Copy full SHA for 2c2afa3

      View code at this pointBrowse repository at this point
14. Commits on Nov 10, 2023

    • Fix tests

      abetlen

      committed
      e32ecb0View commit details

      Copy full SHA for e32ecb0

      View code at this pointBrowse repository at this point
15. Commits on Nov 6, 2023

    • Refactor Llama class internals

      abetlen

      committed
      e214a58View commit details

      Copy full SHA for e214a58

      View code at this pointBrowse repository at this point
16. Commits on Nov 3, 2023

    • Migrate inference to llama_batch and llama_decode api (#795)

      Show description for ab028cb
      

      abetlen

      and

      antoine-lizee

      authored
      ab028cbView commit details

      Copy full SHA for ab028cb

      View code at this pointBrowse repository at this point
17. Commits on Nov 2, 2023

    • fix: tokenization of special characters: (#850)

      Show description for 4d4e0f1
      

      antoine-lizee

      authored and

      abetlen

      committed
      4d4e0f1View commit details

      Copy full SHA for 4d4e0f1

      View code at this pointBrowse repository at this point
18. Commits on Oct 19, 2023

    • Enable finish reason tests

      abetlen

      committed
      ef03d77View commit details

      Copy full SHA for ef03d77

      View code at this pointBrowse repository at this point

    • Re-enable tests completion function

      abetlen

      committed
      cbeef36View commit details

      Copy full SHA for cbeef36

      View code at this pointBrowse repository at this point
19. Commits on Sep 29, 2023

    • Update llama.cpp

      abetlen

      committed
      1a1c3dcView commit details

      Copy full SHA for 1a1c3dc

      View code at this pointBrowse repository at this point
20. Commits on Sep 5, 2023

    • add test to see if llama_cpp.__version__ exists

      janvdp

      committed
      f49b6d7View commit details

      Copy full SHA for f49b6d7

      View code at this pointBrowse repository at this point
21. Commits on Aug 27, 2023

    • Update llama.cpp

      abetlen

      committed
      4887973View commit details

      Copy full SHA for 4887973

      View code at this pointBrowse repository at this point

    • Update llama.cpp

      abetlen

      committed
      3a29d65View commit details

      Copy full SHA for 3a29d65

      View code at this pointBrowse repository at this point
22. Commits on Aug 25, 2023

    • Strip leading space when de-tokenizing.

      abetlen

      committed
      8ac5946View commit details

      Copy full SHA for 8ac5946

      View code at this pointBrowse repository at this point
23. Commits on Aug 24, 2023

    • Update model path

      abetlen

      committed
      3674e5eView commit details

      Copy full SHA for 3674e5e

      View code at this pointBrowse repository at this point
24. Commits on May 19, 2023

    • Fix llama_cpp and Llama type signatures. Closes #221

      abetlen

      committed
      01a010bView commit details

      Copy full SHA for 01a010b

      View code at this pointBrowse repository at this point
25. Commits on May 2, 2023

    • Fix

      abetlen

      committed
      46e3c4bView commit details

      Copy full SHA for 46e3c4b

      View code at this pointBrowse repository at this point

    • Refactor server to use factory

      abetlen

      committed
      9eafc4cView commit details

      Copy full SHA for 9eafc4c

      View code at this pointBrowse repository at this point
26. Commits on May 1, 2023

    • Un-skip tests

      abetlen

      committed
      c088a2bView commit details

      Copy full SHA for c088a2b

      View code at this pointBrowse repository at this point

    • Temporarily skip sampling tests.

      abetlen

      committed
      2f8a3adView commit details

      Copy full SHA for 2f8a3ad

      View code at this pointBrowse repository at this point
27. Commits on Apr 29, 2023

    • llama_cpp server: slight refactor to init_llama function

      Show description for efe8e6f
      Stonelinks

      committed
      efe8e6fView commit details

      Copy full SHA for efe8e6f

      View code at this pointBrowse repository at this point