Commits

Commit history

1. Commits on Aug 8, 2023

   • Add mul_mat_q option

     abetlen

     committed
     d015bdbView commit details

     Copy full SHA for d015bdb

     View code at this pointBrowse repository at this point
2. Commits on Jul 24, 2023

   • Add temporary rms_norm_eps parameter

     abetlen

     committed
     11dd2bfView commit details

     Copy full SHA for 11dd2bf

     View code at this pointBrowse repository at this point
3. Commits on Jul 20, 2023

   • Fix compatibility with older python versions

     abetlen

     committed
     28a1117View commit details

     Copy full SHA for 28a1117

     View code at this pointBrowse repository at this point

   • Merge pull request #481 from c0sogi/main

     Show description for 365d9a4
     abetlen

     authored
     365d9a4View commit details

     Copy full SHA for 365d9a4

     View code at this pointBrowse repository at this point
4. Commits on Jul 18, 2023

   • expose RoPE param to server start

     

     shutup

     committed
     5ed8bf1View commit details

     Copy full SHA for 5ed8bf1

     View code at this pointBrowse repository at this point
5. Commits on Jul 16, 2023

   • Added `RouteErrorHandler` for server

     c0sogi

     committed
     1551ba1View commit details

     Copy full SHA for 1551ba1

     View code at this pointBrowse repository at this point
6. Commits on Jul 14, 2023

   • fix: tensor_split should be optional list

     abetlen

     committed
     118b7f6View commit details

     Copy full SHA for 118b7f6

     View code at this pointBrowse repository at this point

   • Resolve merge conflicts

     

     Shouyi Wang

     committed
     579f526View commit details

     Copy full SHA for 579f526

     View code at this pointBrowse repository at this point

   • bugfix: pydantic v2 fields

     abetlen

     committed
     de4cc5aView commit details

     Copy full SHA for de4cc5a

     View code at this pointBrowse repository at this point
7. Commits on Jul 9, 2023

   • bugfix: pydantic settings missing / changed fields

     abetlen

     committed
     6f70cc4View commit details

     Copy full SHA for 6f70cc4

     View code at this pointBrowse repository at this point

   • Add tensor split

     

     Shouyi Wang

     committed
     9f21f54View commit details

     Copy full SHA for 9f21f54

     View code at this pointBrowse repository at this point
8. Commits on Jul 8, 2023

   • Upgrade fastapi to 0.100.0 and pydantic v2

     abetlen

     committed
     52753b7View commit details

     Copy full SHA for 52753b7

     View code at this pointBrowse repository at this point
9. Commits on Jul 7, 2023

   • Add setting to control request interruption

     abetlen

     committed
     57d8ec3View commit details

     Copy full SHA for 57d8ec3

     View code at this pointBrowse repository at this point

   • Add interruptible streaming requests for llama-cpp-python server. Closes #183

     abetlen

     committed
     4c7cdccView commit details

     Copy full SHA for 4c7cdcc

     View code at this pointBrowse repository at this point
10. Commits on Jun 22, 2023

    • server: pass seed param from command line to llama

      lexin4ever

      authored
      282698bView commit details

      Copy full SHA for 282698b

      View code at this pointBrowse repository at this point
11. Commits on Jun 15, 2023

    • Add low_vram to server settings

      abetlen

      committed
      1e20be6View commit details

      Copy full SHA for 1e20be6

      View code at this pointBrowse repository at this point

    • Format server options

      abetlen

      committed
      f7c5cfaView commit details

      Copy full SHA for f7c5cfa

      View code at this pointBrowse repository at this point

    • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

      abetlen

      committed
      9c41a3eView commit details

      Copy full SHA for 9c41a3e

      View code at this pointBrowse repository at this point

    • Merge pull request #351 from player1537-forks/th/add-logits-bias-parameter

      Show description for f568bae
      abetlen

      authored
      f568baeView commit details

      Copy full SHA for f568bae

      View code at this pointBrowse repository at this point

    • Add additional verbose logs for cache

      abetlen

      committed
      f27393aView commit details

      Copy full SHA for f27393a

      View code at this pointBrowse repository at this point
12. Commits on Jun 11, 2023

    • correction to add back environment variable support <3 docker

      Orfeous

      committed
      3129a0eView commit details

      Copy full SHA for 3129a0e

      View code at this pointBrowse repository at this point
13. Commits on Jun 10, 2023

    • fixes abetlen/llama-cpp-python #358

      Orfeous

      committed
      3ea3193View commit details

      Copy full SHA for 3ea3193

      View code at this pointBrowse repository at this point
14. Commits on Jun 9, 2023

    • Add support for logit_bias and logit_bias_type parameters

      player1537

      committed
      eb7645bView commit details

      Copy full SHA for eb7645b

      View code at this pointBrowse repository at this point
15. Commits on Jun 8, 2023

    • Fix cache implementation breaking changes

      abetlen

      committed
      0c42168View commit details

      Copy full SHA for 0c42168

      View code at this pointBrowse repository at this point
16. Commits on Jun 6, 2023

    • Added mirostat support for completions, chat completions API

      spirilis

      committed
      9b1c9e9View commit details

      Copy full SHA for 9b1c9e9

      View code at this pointBrowse repository at this point
17. Commits on May 27, 2023

    • Use async routes

      abetlen

      committed
      80066f0View commit details

      Copy full SHA for 80066f0

      View code at this pointBrowse repository at this point

    • Import unnused import

      abetlen

      committed
      c2b59a5View commit details

      Copy full SHA for c2b59a5

      View code at this pointBrowse repository at this point
18. Commits on May 19, 2023

    • feat: make embedding support list of string as input

      Show description for e783f1c
      chabotsi

      committed
      e783f1cView commit details

      Copy full SHA for e783f1c

      View code at this pointBrowse repository at this point

    • Bugfix: Stop sequences can be strings

      abetlen

      committed
      a8cd169View commit details

      Copy full SHA for a8cd169

      View code at this pointBrowse repository at this point

    • Use server sent events function for streaming completion

      abetlen

      committed
      dc39cc0View commit details

      Copy full SHA for dc39cc0

      View code at this pointBrowse repository at this point
19. Commits on May 16, 2023

    • Add model_alias option to override model_path in completions. Closes #39

      abetlen

      committed
      a335292View commit details

      Copy full SHA for a335292

      View code at this pointBrowse repository at this point
20. Commits on May 14, 2023

    • Update llama.cpp

      abetlen

      committed
      cdf5976View commit details

      Copy full SHA for cdf5976

      View code at this pointBrowse repository at this point
21. Commits on May 12, 2023

    • Only support generating one prompt at a time.

      abetlen

      committed
      8740ddcView commit details

      Copy full SHA for 8740ddc

      View code at this pointBrowse repository at this point

    • Revert "llama_cpp server: prompt is a string". Closes #187

      Show description for 8895b90
      abetlen

      committed
      8895b90View commit details

      Copy full SHA for 8895b90

      View code at this pointBrowse repository at this point
22. Commits on May 9, 2023

    • llama_cpp server: document presence_penalty and frequency_penalty, mark as supported

      Stonelinks

      committed
      02e8a01View commit details

      Copy full SHA for 02e8a01

      View code at this pointBrowse repository at this point