Commits

Commit history

1. Commits on Jun 16, 2024

   • Update _utils.py

     Smartappli

     authored
     15135d2View commit details

     Copy full SHA for 15135d2

     View code at this pointBrowse repository at this point
2. Commits on Jun 13, 2024

   • feat: Add `.close()` method to `Llama` class to explicitly free model from memory (#1513)

     Show description for 320a5d7
     

     jkawamoto

     and

     abetlen

     authored
     320a5d7View commit details

     Copy full SHA for 320a5d7

     View code at this pointBrowse repository at this point

   • feat: Support SPM infill (#1492)

     Show description for dbcf64c
     

     CISC

     and

     abetlen

     authored
     dbcf64cView commit details

     Copy full SHA for dbcf64c

     View code at this pointBrowse repository at this point
3. Commits on Jun 10, 2024

   • chore: Bump version

     abetlen

     committed
     86a38adView commit details

     Copy full SHA for 86a38ad

     View code at this pointBrowse repository at this point
4. Commits on Jun 7, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     255e1b4View commit details

     Copy full SHA for 255e1b4

     View code at this pointBrowse repository at this point
5. Commits on Jun 4, 2024

   • feat: adding `rpc_servers` parameter to `Llama` class (#1477)

     Show description for d634efc
     

     chraac

     and

     abetlen

     authored
     d634efcView commit details

     Copy full SHA for d634efc

     View code at this pointBrowse repository at this point

   • fix: fix logprobs when BOS is not present (#1471)

     Show description for 6e0642c
     a-ghorbani

     authored
     6e0642cView commit details

     Copy full SHA for 6e0642c

     View code at this pointBrowse repository at this point

   • fix: Avoid duplicate special tokens in chat formats (#1439)

     Show description for 027f7bc
     

     CISC

     and

     abetlen

     authored
     027f7bcView commit details

     Copy full SHA for 027f7bc

     View code at this pointBrowse repository at this point

   • chore: Bump version

     abetlen

     committed
     c3ef41bView commit details

     Copy full SHA for c3ef41b

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     cd3f1bbView commit details

     Copy full SHA for cd3f1bb

     View code at this pointBrowse repository at this point
6. Commits on Jun 3, 2024

   • misc: Improve llava error messages

     abetlen

     committed
     6b018e0View commit details

     Copy full SHA for 6b018e0

     View code at this pointBrowse repository at this point
7. Commits on Jun 1, 2024

   • Merge branch 'main' of https://github.com/abetlen/llama-cpp-python into main

     abetlen

     committed
     a6457baView commit details

     Copy full SHA for a6457ba

     View code at this pointBrowse repository at this point

   • fix: Use numpy recarray for candidates data, fixes bug with temp < 0

     abetlen

     committed
     af3ed50View commit details

     Copy full SHA for af3ed50

     View code at this pointBrowse repository at this point
8. Commits on May 29, 2024

   • fix: Fix typo in Llama3VisionAlphaChatHandler. Closes #1488

     abetlen

     committed
     165b4dcView commit details

     Copy full SHA for 165b4dc

     View code at this pointBrowse repository at this point

   • fix: adjust kv_override member names to match llama.cpp

     abetlen

     committed
     91d05abView commit details

     Copy full SHA for 91d05ab

     View code at this pointBrowse repository at this point

   • fix: fix string value kv_overrides. Closes #1487

     abetlen

     committed
     df45a4bView commit details

     Copy full SHA for df45a4b

     View code at this pointBrowse repository at this point
9. Commits on May 27, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     454c9bbView commit details

     Copy full SHA for 454c9bb

     View code at this pointBrowse repository at this point
10. Commits on May 24, 2024

    • chore: Bump version

      abetlen

      committed
      a4c9ab8View commit details

      Copy full SHA for a4c9ab8

      View code at this pointBrowse repository at this point

    • feat: Improve Llama.eval performance by avoiding list conversion (#1476)

      Show description for 5cae104
      

      thoughtp0lice

      and

      abetlen

      authored
      5cae104View commit details

      Copy full SHA for 5cae104

      View code at this pointBrowse repository at this point

    • feat: Update llama.cpp

      abetlen

      committed
      087cc0bView commit details

      Copy full SHA for 087cc0b

      View code at this pointBrowse repository at this point
11. Commits on May 22, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      5a595f0View commit details

      Copy full SHA for 5a595f0

      View code at this pointBrowse repository at this point
12. Commits on May 16, 2024

    • chore: Bump version

      abetlen

      committed
      b564d05View commit details

      Copy full SHA for b564d05

      View code at this pointBrowse repository at this point

    • fix: segfault for models without eos / bos tokens. Closes #1463

      abetlen

      committed
      d99a6baView commit details

      Copy full SHA for d99a6ba

      View code at this pointBrowse repository at this point
13. Commits on May 14, 2024

    • feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)

      Show description for 5212fb0
      twaka

      authored
      5212fb0View commit details

      Copy full SHA for 5212fb0

      View code at this pointBrowse repository at this point

    • misc: Remove unnecessary metadata lookups (#1448)

      Show description for 389e09c
      CISC

      authored
      389e09cView commit details

      Copy full SHA for 389e09c

      View code at this pointBrowse repository at this point

    • Update llama.cpp

      abetlen

      committed
      50f5c74View commit details

      Copy full SHA for 50f5c74

      View code at this pointBrowse repository at this point
14. Commits on May 12, 2024

    • chore: Bump version

      abetlen

      committed
      3c19faaView commit details

      Copy full SHA for 3c19faa

      View code at this pointBrowse repository at this point
15. Commits on May 10, 2024

    • chore: Bump version

      abetlen

      committed
      7316502View commit details

      Copy full SHA for 7316502

      View code at this pointBrowse repository at this point

    • fix: Clear kv cache to avoid kv bug when image is evaluated first

      abetlen

      committed
      ac55d0aView commit details

      Copy full SHA for ac55d0a

      View code at this pointBrowse repository at this point

    • chore: Bump version

      abetlen

      committed
      4badac3View commit details

      Copy full SHA for 4badac3

      View code at this pointBrowse repository at this point

    • fix(security): Render all jinja templates in immutable sandbox (#1441)

      Show description for 561e880
      

      CISC

      and

      abetlen

      authored
      561e880View commit details

      Copy full SHA for 561e880

      View code at this pointBrowse repository at this point

    • Merge pull request from GHSA-56xg-wfcc-g829

      Show description for b454f40
      

      retr0reg

      and

      abetlen

      authored
      b454f40View commit details

      Copy full SHA for b454f40

      View code at this pointBrowse repository at this point
16. Commits on May 9, 2024

    • feat: Support multiple chat templates - step 1 (#1396)

      Show description for 5ab40e6
      

      CISC

      and

      abetlen

      authored
      5ab40e6View commit details

      Copy full SHA for 5ab40e6

      View code at this pointBrowse repository at this point

    • chore: Bump version

      abetlen

      committed
      bf66a28View commit details

      Copy full SHA for bf66a28

      View code at this pointBrowse repository at this point

    • fix: free last image embed in llava chat handler

      abetlen

      committed
      3757328View commit details

      Copy full SHA for 3757328

      View code at this pointBrowse repository at this point