Commits

Commit history

1. Commits on Dec 19, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     2bc1d97View commit details

     Copy full SHA for 2bc1d97

     View code at this pointBrowse repository at this point
2. Commits on Dec 9, 2024

   • chore: Bump version

     abetlen

     committed
     803924bView commit details

     Copy full SHA for 803924b

     View code at this pointBrowse repository at this point

   • fix: add missing await statements for async exit_stack handling (#1858)

     gjpower

     authored
     afedfc8View commit details

     Copy full SHA for afedfc8

     View code at this pointBrowse repository at this point

   • chore: Bump version

     abetlen

     committed
     002f583View commit details

     Copy full SHA for 002f583

     View code at this pointBrowse repository at this point

   • chore: Bump version

     abetlen

     committed
     a9fe0f8View commit details

     Copy full SHA for a9fe0f8

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     5585f8aView commit details

     Copy full SHA for 5585f8a

     View code at this pointBrowse repository at this point
3. Commits on Dec 6, 2024

   • fix: chat API logprobs format (#1788)

     Show description for 4f0ec65
     domdomegg

     authored
     4f0ec65View commit details

     Copy full SHA for 4f0ec65

     View code at this pointBrowse repository at this point

   • fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context (#1798)

     Show description for 9bd0c95
     

     gjpower

     and

     abetlen

     authored
     9bd0c95View commit details

     Copy full SHA for 9bd0c95

     View code at this pointBrowse repository at this point

   • fix: added missing exit_stack.close() to /v1/chat/completions (#1796)

     Show description for 073b7e4
     Ian321

     authored
     073b7e4View commit details

     Copy full SHA for 073b7e4

     View code at this pointBrowse repository at this point

   • fix: make content not required in ChatCompletionRequestAssistantMessage (#1807)

     feloy

     authored
     4192210View commit details

     Copy full SHA for 4192210

     View code at this pointBrowse repository at this point

   • docs: Remove ref to llama_eval in llama_cpp.py docs (#1819)

     Show description for 38fbd29
     richdougherty

     authored
     38fbd29View commit details

     Copy full SHA for 38fbd29

     View code at this pointBrowse repository at this point

   • fix logit-bias type hint (#1802)

     Show description for fa04cdc
     ddh0

     authored
     fa04cdcView commit details

     Copy full SHA for fa04cdc

     View code at this pointBrowse repository at this point

   • fix: Fix pickling of Llama class by setting seed from _seed member. Closes #1769

     abetlen

     committed
     2523472View commit details

     Copy full SHA for 2523472

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     7ba257eView commit details

     Copy full SHA for 7ba257e

     View code at this pointBrowse repository at this point
4. Commits on Nov 28, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     f3fb90bView commit details

     Copy full SHA for f3fb90b

     View code at this pointBrowse repository at this point
5. Commits on Nov 16, 2024

   • chore: Bump version

     abetlen

     committed
     7ecdd94View commit details

     Copy full SHA for 7ecdd94

     View code at this pointBrowse repository at this point
6. Commits on Oct 31, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     e712cffView commit details

     Copy full SHA for e712cff

     View code at this pointBrowse repository at this point
7. Commits on Oct 22, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     7403e00View commit details

     Copy full SHA for 7403e00

     View code at this pointBrowse repository at this point
8. Commits on Sep 29, 2024

   • chore: Bump version

     abetlen

     committed
     7c4aeadView commit details

     Copy full SHA for 7c4aead

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     57e70bbView commit details

     Copy full SHA for 57e70bb

     View code at this pointBrowse repository at this point
9. Commits on Sep 26, 2024

   • feat: Expose libggml in internal APIs (#1761)

     Show description for 01c7607
     abetlen

     authored
     01c7607View commit details

     Copy full SHA for 01c7607

     View code at this pointBrowse repository at this point

   • fix: Additional fixes for speculative decoding

     abetlen

     committed
     e975dabView commit details

     Copy full SHA for e975dab

     View code at this pointBrowse repository at this point

   • misc: Rename all_text to remaining_text (#1658)

     Show description for 11d9562
     

     xu-song

     and

     abetlen

     authored
     11d9562View commit details

     Copy full SHA for 11d9562

     View code at this pointBrowse repository at this point

   • fix: Fix speculative decoding

     abetlen

     committed
     9992c50View commit details

     Copy full SHA for 9992c50

     View code at this pointBrowse repository at this point
10. Commits on Sep 25, 2024

    • chore: Bump version

      abetlen

      committed
      b3dfb42View commit details

      Copy full SHA for b3dfb42

      View code at this pointBrowse repository at this point

    • feat: Update llama.cpp

      abetlen

      committed
      926b414View commit details

      Copy full SHA for 926b414

      View code at this pointBrowse repository at this point
11. Commits on Sep 20, 2024

    • feat: Add option to configure n_ubatch

      abetlen

      committed
      6c44a3fView commit details

      Copy full SHA for 6c44a3f

      View code at this pointBrowse repository at this point
12. Commits on Sep 19, 2024

    • feat: Add loading sharded GGUF files from HuggingFace with Llama.from_pretrained(additional_files=[...]) . Closes #1341

      Show description for 84c0920
      

      Gnurro

      and

      abetlen

      authored
      84c0920View commit details

      Copy full SHA for 84c0920

      View code at this pointBrowse repository at this point

    • fix: Don't store scores internally unless logits_all=True. Reduces memory requirements for large context. Closes #1542

      abetlen

      committed
      29afcfdView commit details

      Copy full SHA for 29afcfd

      View code at this pointBrowse repository at this point

    • fix: Fix memory allocation of ndarray (#1704)

      Show description for 22cedad
      

      xu-song

      and

      abetlen

      authored
      22cedadView commit details

      Copy full SHA for 22cedad

      View code at this pointBrowse repository at this point

    • misc: Format

      abetlen

      committed
      9b64bb5View commit details

      Copy full SHA for 9b64bb5

      View code at this pointBrowse repository at this point

    • feat: Update llama.cpp

      abetlen

      committed
      1e64664View commit details

      Copy full SHA for 1e64664

      View code at this pointBrowse repository at this point

    • feat: Update sampling API for llama.cpp (#1742)

      Show description for f8fcb3e
      abetlen

      authored
      f8fcb3eView commit details

      Copy full SHA for f8fcb3e

      View code at this pointBrowse repository at this point
13. Commits on Sep 6, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      c032fc6View commit details

      Copy full SHA for c032fc6

      View code at this pointBrowse repository at this point
14. Commits on Sep 2, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      c3fc80aView commit details

      Copy full SHA for c3fc80a

      View code at this pointBrowse repository at this point