Commits

Commit history

1. Commits on Apr 23, 2024

   • chore: Bump version

     abetlen

     committed
     c50d330View commit details

     Copy full SHA for c50d330

     View code at this pointBrowse repository at this point

   • feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)

     sean-bailey

     authored
     53ebcc8View commit details

     Copy full SHA for 53ebcc8

     View code at this pointBrowse repository at this point

   • feat: Add Llama-3 chat format (#1371)

     Show description for 8559e8c
     

     andreabak

     and

     abetlen

     authored
     8559e8cView commit details

     Copy full SHA for 8559e8c

     View code at this pointBrowse repository at this point
2. Commits on Apr 22, 2024

   • feat: Use new llama_token_is_eog in create_completions

     abetlen

     committed
     d40a250View commit details

     Copy full SHA for d40a250

     View code at this pointBrowse repository at this point

   • Merge branch 'main' of https://github.com/abetlen/llama-cpp-python into main

     abetlen

     committed
     b21ba0eView commit details

     Copy full SHA for b21ba0e

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     159cc4eView commit details

     Copy full SHA for 159cc4e

     View code at this pointBrowse repository at this point
3. Commits on Apr 20, 2024

   • chore: Bump version

     abetlen

     committed
     0281214View commit details

     Copy full SHA for 0281214

     View code at this pointBrowse repository at this point

   • feat: Add stopping_criteria to ChatFormatter, allow stopping on arbitrary token ids, fixes llama3 instruct

     abetlen

     committed
     cc81afeView commit details

     Copy full SHA for cc81afe

     View code at this pointBrowse repository at this point
4. Commits on Apr 18, 2024

   • chore: Bump version

     abetlen

     committed
     893a27aView commit details

     Copy full SHA for 893a27a

     View code at this pointBrowse repository at this point

   • feat: update grammar schema converter to match llama.cpp (#1353)

     Show description for 4f42664
     themrzmaster

     authored
     4f42664View commit details

     Copy full SHA for 4f42664

     View code at this pointBrowse repository at this point
5. Commits on Apr 17, 2024

   • Revert "feat: Update json to grammar (#1350)"

     Show description for fa4bb0c
     abetlen

     committed
     fa4bb0cView commit details

     Copy full SHA for fa4bb0c

     View code at this pointBrowse repository at this point

   • feat: Update json to grammar (#1350)

     Show description for 610a592
     themrzmaster

     authored
     610a592View commit details

     Copy full SHA for 610a592

     View code at this pointBrowse repository at this point

   • feat: add `disable_ping_events` flag (#1257)

     Show description for b73c73c
     khimaros

     authored
     b73c73cView commit details

     Copy full SHA for b73c73c

     View code at this pointBrowse repository at this point

   • feat: Make saved state more compact on-disk (#1296)

     Show description for 4924455
     tc-wolf

     authored
     4924455View commit details

     Copy full SHA for 4924455

     View code at this pointBrowse repository at this point

   • feat: Use all available CPUs for batch processing (#1345)

     

     ddh0

     authored and

     abetlen

     committed
     c96b2daView commit details

     Copy full SHA for c96b2da

     View code at this pointBrowse repository at this point
6. Commits on Apr 10, 2024

   • chore: Bump version

     abetlen

     committed
     ef29235View commit details

     Copy full SHA for ef29235

     View code at this pointBrowse repository at this point

   • fix: pass correct type to chat handlers for chat completion logprobs

     abetlen

     committed
     bb65b4dView commit details

     Copy full SHA for bb65b4d

     View code at this pointBrowse repository at this point

   • feat: Add support for yaml based configs

     abetlen

     committed
     060bfa6View commit details

     Copy full SHA for 060bfa6

     View code at this pointBrowse repository at this point

   • feat: Add typechecking for ctypes structure attributes

     abetlen

     committed
     1347e1dView commit details

     Copy full SHA for 1347e1d

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     889d0e8View commit details

     Copy full SHA for 889d0e8

     View code at this pointBrowse repository at this point
7. Commits on Apr 9, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     56071c9View commit details

     Copy full SHA for 56071c9

     View code at this pointBrowse repository at this point
8. Commits on Apr 6, 2024

   • chore: Bump version

     abetlen

     committed
     08b16afView commit details

     Copy full SHA for 08b16af

     View code at this pointBrowse repository at this point
9. Commits on Apr 5, 2024

   • fix: missing logprobs in response, incorrect response type for functionary, minor type issues. Closes #1328 Closes #1314

     abetlen

     committed
     1ae3abbView commit details

     Copy full SHA for 1ae3abb

     View code at this pointBrowse repository at this point
10. Commits on Apr 3, 2024

    • chore: Bump version

      abetlen

      committed
      34081ddView commit details

      Copy full SHA for 34081dd

      View code at this pointBrowse repository at this point

    • fix: segfault when logits_all=False. Closes #1319

      abetlen

      committed
      8649d76View commit details

      Copy full SHA for 8649d76

      View code at this pointBrowse repository at this point
11. Commits on Apr 1, 2024

    • fix: last tokens passing to sample_repetition_penalties function (#1295)

      Show description for 62aad61
      

      3 peopleauthored
      62aad61View commit details

      Copy full SHA for 62aad61

      View code at this pointBrowse repository at this point

    • chore: Bump version

      abetlen

      committed
      45bf5aeView commit details

      Copy full SHA for 45bf5ae

      View code at this pointBrowse repository at this point

    • feat: add support for KV cache quantization options (#1307)

      Show description for f165048
      

      Limour-dev

      and

      abetlen

      authored
      f165048View commit details

      Copy full SHA for f165048

      View code at this pointBrowse repository at this point
12. Commits on Mar 31, 2024

    • feat: Add logprobs support to chat completions (#1311)

      Show description for aa9f1ae
      

      windspirit95

      and

      abetlen

      authored
      aa9f1aeView commit details

      Copy full SHA for aa9f1ae

      View code at this pointBrowse repository at this point
13. Commits on Mar 28, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      125b235View commit details

      Copy full SHA for 125b235

      View code at this pointBrowse repository at this point
14. Commits on Mar 27, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      901fe02View commit details

      Copy full SHA for 901fe02

      View code at this pointBrowse repository at this point
15. Commits on Mar 23, 2024

    • fix(server): minor type fixes

      abetlen

      committed
      d11ccc3View commit details

      Copy full SHA for d11ccc3

      View code at this pointBrowse repository at this point

    • fix: tool_call missing first token.

      abetlen

      committed
      c1325dcView commit details

      Copy full SHA for c1325dc

      View code at this pointBrowse repository at this point

    • feat: Update llama.cpp

      abetlen

      committed
      e325a83View commit details

      Copy full SHA for e325a83

      View code at this pointBrowse repository at this point
16. Commits on Mar 19, 2024

    • docs: Add chat examples to openapi ui

      abetlen

      committed
      f7decc9View commit details

      Copy full SHA for f7decc9

      View code at this pointBrowse repository at this point