Commits

Commit history

1. Commits on Jul 25, 2023

   • Change tensor_split from array to pointer

     

     Shouyi Wang

     committed
     426dbfeView commit details

     Copy full SHA for 426dbfe

     View code at this pointBrowse repository at this point
2. Commits on Jul 24, 2023

   • Add temporary rms_norm_eps parameter

     abetlen

     committed
     11dd2bfView commit details

     Copy full SHA for 11dd2bf

     View code at this pointBrowse repository at this point

   • Add rms_eps_norm

     abetlen

     committed
     8cd64d4View commit details

     Copy full SHA for 8cd64d4

     View code at this pointBrowse repository at this point

   • add support for llama2 70b

     

     bretello

     committed
     0f09f10View commit details

     Copy full SHA for 0f09f10

     View code at this pointBrowse repository at this point
3. Commits on Jul 20, 2023

   • Merge pull request #481 from c0sogi/main

     Show description for 365d9a4
     abetlen

     authored
     365d9a4View commit details

     Copy full SHA for 365d9a4

     View code at this pointBrowse repository at this point

   • Now the last token sent when `stream=True`

     ctejada85

     committed
     0756a2dView commit details

     Copy full SHA for 0756a2d

     View code at this pointBrowse repository at this point
4. Commits on Jul 16, 2023

   • Added `RouteErrorHandler` for server

     c0sogi

     committed
     1551ba1View commit details

     Copy full SHA for 1551ba1

     View code at this pointBrowse repository at this point
5. Commits on Jul 15, 2023

   • Re-order Llama class params

     abetlen

     committed
     8ab098eView commit details

     Copy full SHA for 8ab098e

     View code at this pointBrowse repository at this point

   • Merge branch main into custom_rope

     abetlen

     committed
     f0797a6View commit details

     Copy full SHA for f0797a6

     View code at this pointBrowse repository at this point
6. Commits on Jul 10, 2023

   • Add bindings for custom_rope

     randoentity

     committed
     3f8f276View commit details

     Copy full SHA for 3f8f276

     View code at this pointBrowse repository at this point
7. Commits on Jul 9, 2023

   • bugfix: truncate completion max_tokens to fit context length by default

     abetlen

     committed
     a86bfdfView commit details

     Copy full SHA for a86bfdf

     View code at this pointBrowse repository at this point
8. Commits on Jul 8, 2023

   • Merge branch 'main' into add_unlimited_max_tokens

     abetlen

     authored
     5d756deView commit details

     Copy full SHA for 5d756de

     View code at this pointBrowse repository at this point

   • Merge pull request #453 from wu-qing-157/main

     Show description for b8e0bed
     abetlen

     authored
     b8e0bedView commit details

     Copy full SHA for b8e0bed

     View code at this pointBrowse repository at this point

   • bugfix: fix compatibility bug with openai api on last token

     abetlen

     committed
     d6e6aadView commit details

     Copy full SHA for d6e6aad

     View code at this pointBrowse repository at this point

   • Format

     abetlen

     committed
     4f2b5d0View commit details

     Copy full SHA for 4f2b5d0

     View code at this pointBrowse repository at this point

   • perf: convert pointer to byref

     abetlen

     committed
     34c505eView commit details

     Copy full SHA for 34c505e

     View code at this pointBrowse repository at this point
9. Commits on Jul 7, 2023

   • perf: avoid allocating new buffers during sampling

     abetlen

     committed
     11eae75View commit details

     Copy full SHA for 11eae75

     View code at this pointBrowse repository at this point

   • perf: assign to candidates data structure instead

     abetlen

     committed
     a14d8a9View commit details

     Copy full SHA for a14d8a9

     View code at this pointBrowse repository at this point

   • fix indexing token_logprobs after sorting

     wu-qing-157

     committed
     9e61661View commit details

     Copy full SHA for 9e61661

     View code at this pointBrowse repository at this point
10. Commits on Jun 29, 2023

    • Hotfix: logits_all bug

      abetlen

      committed
      e34f441View commit details

      Copy full SHA for e34f441

      View code at this pointBrowse repository at this point

    • Load logits directly into scores buffer

      abetlen

      committed
      a2ede37View commit details

      Copy full SHA for a2ede37

      View code at this pointBrowse repository at this point

    • Use pre-allocated buffers to store input_ids and scores

      abetlen

      committed
      b95b0ffView commit details

      Copy full SHA for b95b0ff

      View code at this pointBrowse repository at this point

    • Free model when llama is unloaded. Closes #434

      abetlen

      committed
      a5e059cView commit details

      Copy full SHA for a5e059c

      View code at this pointBrowse repository at this point
11. Commits on Jun 26, 2023

    • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

      abetlen

      committed
      3379dc4View commit details

      Copy full SHA for 3379dc4

      View code at this pointBrowse repository at this point

    • Update llama.cpp

      abetlen

      committed
      9522284View commit details

      Copy full SHA for 9522284

      View code at this pointBrowse repository at this point

    • Update type signature

      abetlen

      committed
      b4a3db3View commit details

      Copy full SHA for b4a3db3

      View code at this pointBrowse repository at this point

    • Merge branch 'main' into fix-state-pickle

      abetlen

      authored
      5eb4ebbView commit details

      Copy full SHA for 5eb4ebb

      View code at this pointBrowse repository at this point
12. Commits on Jun 24, 2023

    • Only concatenate after all batches are done

      samfundev

      committed
      d788fb4View commit details

      Copy full SHA for d788fb4

      View code at this pointBrowse repository at this point
13. Commits on Jun 23, 2023

    • Merge branch 'main' into fix-state-pickle

      abetlen

      authored
      877ca6dView commit details

      Copy full SHA for 877ca6d

      View code at this pointBrowse repository at this point
14. Commits on Jun 17, 2023

    • Update docs. Closes #386

      abetlen

      committed
      d410f12View commit details

      Copy full SHA for d410f12

      View code at this pointBrowse repository at this point
15. Commits on Jun 16, 2023

    • Update llama.py: Added how many input tokens in ValueError exception

      nb-programmer

      authored
      fd9f294View commit details

      Copy full SHA for fd9f294

      View code at this pointBrowse repository at this point
16. Commits on Jun 15, 2023

    • Add low_vram parameter

      abetlen

      committed
      44b83caView commit details

      Copy full SHA for 44b83ca

      View code at this pointBrowse repository at this point

    • Merge pull request #351 from player1537-forks/th/add-logits-bias-parameter

      Show description for f568bae
      abetlen

      authored
      f568baeView commit details

      Copy full SHA for f568bae

      View code at this pointBrowse repository at this point
17. Commits on Jun 13, 2023

    • fix: Make LLamaState pickable for disk cache

      Show description for 10b0cb7
      Okabintaro

      committed
      10b0cb7View commit details

      Copy full SHA for 10b0cb7

      View code at this pointBrowse repository at this point
18. Commits on Jun 10, 2023

    • Re-enable cache

      abetlen

      committed
      21acd79View commit details

      Copy full SHA for 21acd79

      View code at this pointBrowse repository at this point