Commits

Commit history

1. Commits on Jul 15, 2023

   • Merge branch main into custom_rope

     abetlen

     committed
     f0797a6View commit details

     Copy full SHA for f0797a6

     View code at this pointBrowse repository at this point
2. Commits on Jul 9, 2023

   • bugfix: pydantic settings missing / changed fields

     abetlen

     committed
     6f70cc4View commit details

     Copy full SHA for 6f70cc4

     View code at this pointBrowse repository at this point
3. Commits on Jul 8, 2023

   • Upgrade fastapi to 0.100.0 and pydantic v2

     abetlen

     committed
     52753b7View commit details

     Copy full SHA for 52753b7

     View code at this pointBrowse repository at this point
4. Commits on Jul 7, 2023

   • Add setting to control request interruption

     abetlen

     committed
     57d8ec3View commit details

     Copy full SHA for 57d8ec3

     View code at this pointBrowse repository at this point

   • Add interruptible streaming requests for llama-cpp-python server. Closes #183

     abetlen

     committed
     4c7cdccView commit details

     Copy full SHA for 4c7cdcc

     View code at this pointBrowse repository at this point
5. Commits on Jun 22, 2023

   • server: pass seed param from command line to llama

     lexin4ever

     authored
     282698bView commit details

     Copy full SHA for 282698b

     View code at this pointBrowse repository at this point
6. Commits on Jun 15, 2023

   • Add low_vram to server settings

     abetlen

     committed
     1e20be6View commit details

     Copy full SHA for 1e20be6

     View code at this pointBrowse repository at this point

   • Format server options

     abetlen

     committed
     f7c5cfaView commit details

     Copy full SHA for f7c5cfa

     View code at this pointBrowse repository at this point

   • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

     abetlen

     committed
     9c41a3eView commit details

     Copy full SHA for 9c41a3e

     View code at this pointBrowse repository at this point

   • Merge pull request #351 from player1537-forks/th/add-logits-bias-parameter

     Show description for f568bae
     abetlen

     authored
     f568baeView commit details

     Copy full SHA for f568bae

     View code at this pointBrowse repository at this point

   • Add additional verbose logs for cache

     abetlen

     committed
     f27393aView commit details

     Copy full SHA for f27393a

     View code at this pointBrowse repository at this point
7. Commits on Jun 11, 2023

   • correction to add back environment variable support <3 docker

     Orfeous

     committed
     3129a0eView commit details

     Copy full SHA for 3129a0e

     View code at this pointBrowse repository at this point
8. Commits on Jun 10, 2023

   • fixes abetlen/llama-cpp-python #358

     Orfeous

     committed
     3ea3193View commit details

     Copy full SHA for 3ea3193

     View code at this pointBrowse repository at this point
9. Commits on Jun 9, 2023

   • Add support for logit_bias and logit_bias_type parameters

     player1537

     committed
     eb7645bView commit details

     Copy full SHA for eb7645b

     View code at this pointBrowse repository at this point
10. Commits on Jun 8, 2023

    • Fix cache implementation breaking changes

      abetlen

      committed
      0c42168View commit details

      Copy full SHA for 0c42168

      View code at this pointBrowse repository at this point
11. Commits on Jun 6, 2023

    • Added mirostat support for completions, chat completions API

      spirilis

      committed
      9b1c9e9View commit details

      Copy full SHA for 9b1c9e9

      View code at this pointBrowse repository at this point
12. Commits on May 27, 2023

    • Use async routes

      abetlen

      committed
      80066f0View commit details

      Copy full SHA for 80066f0

      View code at this pointBrowse repository at this point

    • Import unnused import

      abetlen

      committed
      c2b59a5View commit details

      Copy full SHA for c2b59a5

      View code at this pointBrowse repository at this point
13. Commits on May 19, 2023

    • feat: make embedding support list of string as input

      Show description for e783f1c
      chabotsi

      committed
      e783f1cView commit details

      Copy full SHA for e783f1c

      View code at this pointBrowse repository at this point

    • Bugfix: Stop sequences can be strings

      abetlen

      committed
      a8cd169View commit details

      Copy full SHA for a8cd169

      View code at this pointBrowse repository at this point

    • Use server sent events function for streaming completion

      abetlen

      committed
      dc39cc0View commit details

      Copy full SHA for dc39cc0

      View code at this pointBrowse repository at this point
14. Commits on May 16, 2023

    • Add model_alias option to override model_path in completions. Closes #39

      abetlen

      committed
      a335292View commit details

      Copy full SHA for a335292

      View code at this pointBrowse repository at this point
15. Commits on May 14, 2023

    • Update llama.cpp

      abetlen

      committed
      cdf5976View commit details

      Copy full SHA for cdf5976

      View code at this pointBrowse repository at this point
16. Commits on May 12, 2023

    • Only support generating one prompt at a time.

      abetlen

      committed
      8740ddcView commit details

      Copy full SHA for 8740ddc

      View code at this pointBrowse repository at this point

    • Revert "llama_cpp server: prompt is a string". Closes #187

      Show description for 8895b90
      abetlen

      committed
      8895b90View commit details

      Copy full SHA for 8895b90

      View code at this pointBrowse repository at this point
17. Commits on May 9, 2023

    • llama_cpp server: document presence_penalty and frequency_penalty, mark as supported

      Stonelinks

      committed
      02e8a01View commit details

      Copy full SHA for 02e8a01

      View code at this pointBrowse repository at this point
18. Commits on May 8, 2023

    • Fix: default repeat_penalty

      abetlen

      committed
      82d138fView commit details

      Copy full SHA for 82d138f

      View code at this pointBrowse repository at this point

    • Bugfix: not falling back to environment variables when default is value is set.

      abetlen

      committed
      29f094bView commit details

      Copy full SHA for 29f094b

      View code at this pointBrowse repository at this point

    • Show default value when --help is called

      abetlen

      committed
      0d6c600View commit details

      Copy full SHA for 0d6c600

      View code at this pointBrowse repository at this point

    • Use environment variable if parsed cli arg is None

      abetlen

      committed
      022e9ebView commit details

      Copy full SHA for 022e9eb

      View code at this pointBrowse repository at this point

    • Set repeat_penalty to 0 by default

      abetlen

      committed
      0d751a6View commit details

      Copy full SHA for 0d751a6

      View code at this pointBrowse repository at this point

    • Add openai frequency and presence penalty parameters. Closes #169

      abetlen

      committed
      65d9cc0View commit details

      Copy full SHA for 65d9cc0

      View code at this pointBrowse repository at this point

    • Bugfix for models endpoint

      abetlen

      committed
      a0b61eaView commit details

      Copy full SHA for a0b61ea

      View code at this pointBrowse repository at this point
19. Commits on May 7, 2023

    • Added cache size to settins object.

      abetlen

      committed
      14da46fView commit details

      Copy full SHA for 14da46f

      View code at this pointBrowse repository at this point

    • Add verbose flag to server

      abetlen

      committed
      627811eView commit details

      Copy full SHA for 627811e

      View code at this pointBrowse repository at this point