Commits

Commit history

1. Commits on Sep 26, 2024

   • Use ctypes_extensions module for libllama and libllava

     abetlen

     committed
     b4a8a0cView commit details

     Copy full SHA for b4a8a0c

     View code at this pointBrowse repository at this point

   • Merge branch 'main' into expose-libggml

     abetlen

     authored
     eb16072View commit details

     Copy full SHA for eb16072

     View code at this pointBrowse repository at this point

   • fix: Additional fixes for speculative decoding

     abetlen

     committed
     e975dabView commit details

     Copy full SHA for e975dab

     View code at this pointBrowse repository at this point

   • misc: Rename all_text to remaining_text (#1658)

     Show description for 11d9562
     

     xu-song

     and

     abetlen

     authored
     11d9562View commit details

     Copy full SHA for 11d9562

     View code at this pointBrowse repository at this point

   • fix: Fix speculative decoding

     abetlen

     committed
     9992c50View commit details

     Copy full SHA for 9992c50

     View code at this pointBrowse repository at this point
2. Commits on Sep 25, 2024

   • Only expose libggml

     abetlen

     committed
     2c260b9View commit details

     Copy full SHA for 2c260b9

     View code at this pointBrowse repository at this point

   • Merge branch 'main' into expose-libggml

     abetlen

     authored
     1aa3991View commit details

     Copy full SHA for 1aa3991

     View code at this pointBrowse repository at this point

   • chore: Bump version

     abetlen

     committed
     b3dfb42View commit details

     Copy full SHA for b3dfb42

     View code at this pointBrowse repository at this point

   • Expose libggml and refactor ctypes extension

     abetlen

     committed
     c94bdc4View commit details

     Copy full SHA for c94bdc4

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     926b414View commit details

     Copy full SHA for 926b414

     View code at this pointBrowse repository at this point
3. Commits on Sep 20, 2024

   • feat: Add option to configure n_ubatch

     abetlen

     committed
     6c44a3fView commit details

     Copy full SHA for 6c44a3f

     View code at this pointBrowse repository at this point
4. Commits on Sep 19, 2024

   • feat: Add loading sharded GGUF files from HuggingFace with Llama.from_pretrained(additional_files=[...]) . Closes #1341

     Show description for 84c0920
     

     Gnurro

     and

     abetlen

     authored
     84c0920View commit details

     Copy full SHA for 84c0920

     View code at this pointBrowse repository at this point

   • fix: Don't store scores internally unless logits_all=True. Reduces memory requirements for large context. Closes #1542

     abetlen

     committed
     29afcfdView commit details

     Copy full SHA for 29afcfd

     View code at this pointBrowse repository at this point

   • fix: Fix memory allocation of ndarray (#1704)

     Show description for 22cedad
     

     xu-song

     and

     abetlen

     authored
     22cedadView commit details

     Copy full SHA for 22cedad

     View code at this pointBrowse repository at this point

   • misc: Format

     abetlen

     committed
     9b64bb5View commit details

     Copy full SHA for 9b64bb5

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     1e64664View commit details

     Copy full SHA for 1e64664

     View code at this pointBrowse repository at this point

   • feat: Update sampling API for llama.cpp (#1742)

     Show description for f8fcb3e
     abetlen

     authored
     f8fcb3eView commit details

     Copy full SHA for f8fcb3e

     View code at this pointBrowse repository at this point
5. Commits on Sep 6, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     c032fc6View commit details

     Copy full SHA for c032fc6

     View code at this pointBrowse repository at this point
6. Commits on Sep 2, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     c3fc80aView commit details

     Copy full SHA for c3fc80a

     View code at this pointBrowse repository at this point
7. Commits on Aug 31, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     9769e57View commit details

     Copy full SHA for 9769e57

     View code at this pointBrowse repository at this point
8. Commits on Aug 30, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     dcb0d0cView commit details

     Copy full SHA for dcb0d0c

     View code at this pointBrowse repository at this point

   • fix: Use system message in og qwen format. Closes #1697

     abetlen

     committed
     98eb092View commit details

     Copy full SHA for 98eb092

     View code at this pointBrowse repository at this point
9. Commits on Aug 29, 2024

   • feat: Enable detokenizing special tokens with `special=True` (#1596)

     Show description for d981d32
     

     benniekiss

     and

     abetlen

     authored
     d981d32View commit details

     Copy full SHA for d981d32

     View code at this pointBrowse repository at this point

   • chore: Bump version

     abetlen

     committed
     077ecb6View commit details

     Copy full SHA for 077ecb6

     View code at this pointBrowse repository at this point

   • feat: Add server chat_format minicpm-v-2.6 for MiniCPMv26ChatHandler

     abetlen

     committed
     97d527eView commit details

     Copy full SHA for 97d527e

     View code at this pointBrowse repository at this point

   • fix: Update name to MiniCPMv26ChatHandler

     abetlen

     committed
     e251a0bView commit details

     Copy full SHA for e251a0b

     View code at this pointBrowse repository at this point

   • feat: Add MiniCPMv26 chat handler.

     abetlen

     committed
     f70df82View commit details

     Copy full SHA for f70df82

     View code at this pointBrowse repository at this point
10. Commits on Aug 22, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      259ee15View commit details

      Copy full SHA for 259ee15

      View code at this pointBrowse repository at this point
11. Commits on Aug 19, 2024

    • chore: Bump version

      abetlen

      committed
      d7328efView commit details

      Copy full SHA for d7328ef

      View code at this pointBrowse repository at this point
12. Commits on Aug 16, 2024

    • Merge branch 'main' of github.com:abetlen/llama-cpp-python into main

      abetlen

      committed
      658b244View commit details

      Copy full SHA for 658b244

      View code at this pointBrowse repository at this point

    • feat: Update llama.cpp

      abetlen

      committed
      7bf07ecView commit details

      Copy full SHA for 7bf07ec

      View code at this pointBrowse repository at this point
13. Commits on Aug 15, 2024

    • fix: Llama.close didn't free lora adapter (#1679)

      jkawamoto

      authored
      3c7501bView commit details

      Copy full SHA for 3c7501b

      View code at this pointBrowse repository at this point

    • feat: Update llama.cpp

      abetlen

      committed
      63d65acView commit details

      Copy full SHA for 63d65ac

      View code at this pointBrowse repository at this point
14. Commits on Aug 13, 2024

    • chore: Bump version

      abetlen

      committed
      fc19cc7View commit details

      Copy full SHA for fc19cc7

      View code at this pointBrowse repository at this point
15. Commits on Aug 12, 2024

    • fix: only print 'cache saved' in verbose mode (#1668)

      Show description for 9bab46f
      

      lsorber

      and

      abetlen

      authored
      9bab46fView commit details

      Copy full SHA for 9bab46f

      View code at this pointBrowse repository at this point