Commits

Commit history

1. Commits on Jun 15, 2023

   • Add low_vram to server settings

     abetlen

     committed
     1e20be6View commit details

     Copy full SHA for 1e20be6

     View code at this pointBrowse repository at this point

   • Format server options

     abetlen

     committed
     f7c5cfaView commit details

     Copy full SHA for f7c5cfa

     View code at this pointBrowse repository at this point

   • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

     abetlen

     committed
     9c41a3eView commit details

     Copy full SHA for 9c41a3e

     View code at this pointBrowse repository at this point

   • Merge pull request #351 from player1537-forks/th/add-logits-bias-parameter

     Show description for f568bae
     abetlen

     authored
     f568baeView commit details

     Copy full SHA for f568bae

     View code at this pointBrowse repository at this point

   • Add additional verbose logs for cache

     abetlen

     committed
     f27393aView commit details

     Copy full SHA for f27393a

     View code at this pointBrowse repository at this point
2. Commits on Jun 11, 2023

   • correction to add back environment variable support <3 docker

     Orfeous

     committed
     3129a0eView commit details

     Copy full SHA for 3129a0e

     View code at this pointBrowse repository at this point
3. Commits on Jun 10, 2023

   • fixes abetlen/llama-cpp-python #358

     Orfeous

     committed
     3ea3193View commit details

     Copy full SHA for 3ea3193

     View code at this pointBrowse repository at this point
4. Commits on Jun 9, 2023

   • Add support for logit_bias and logit_bias_type parameters

     player1537

     committed
     eb7645bView commit details

     Copy full SHA for eb7645b

     View code at this pointBrowse repository at this point
5. Commits on Jun 8, 2023

   • Fix cache implementation breaking changes

     abetlen

     committed
     0c42168View commit details

     Copy full SHA for 0c42168

     View code at this pointBrowse repository at this point
6. Commits on Jun 6, 2023

   • Added mirostat support for completions, chat completions API

     spirilis

     committed
     9b1c9e9View commit details

     Copy full SHA for 9b1c9e9

     View code at this pointBrowse repository at this point
7. Commits on May 27, 2023

   • Use async routes

     abetlen

     committed
     80066f0View commit details

     Copy full SHA for 80066f0

     View code at this pointBrowse repository at this point

   • Import unnused import

     abetlen

     committed
     c2b59a5View commit details

     Copy full SHA for c2b59a5

     View code at this pointBrowse repository at this point
8. Commits on May 19, 2023

   • feat: make embedding support list of string as input

     Show description for e783f1c
     chabotsi

     committed
     e783f1cView commit details

     Copy full SHA for e783f1c

     View code at this pointBrowse repository at this point

   • Bugfix: Stop sequences can be strings

     abetlen

     committed
     a8cd169View commit details

     Copy full SHA for a8cd169

     View code at this pointBrowse repository at this point

   • Use server sent events function for streaming completion

     abetlen

     committed
     dc39cc0View commit details

     Copy full SHA for dc39cc0

     View code at this pointBrowse repository at this point
9. Commits on May 16, 2023

   • Add model_alias option to override model_path in completions. Closes #39

     abetlen

     committed
     a335292View commit details

     Copy full SHA for a335292

     View code at this pointBrowse repository at this point
10. Commits on May 14, 2023

    • Update llama.cpp

      abetlen

      committed
      cdf5976View commit details

      Copy full SHA for cdf5976

      View code at this pointBrowse repository at this point
11. Commits on May 12, 2023

    • Only support generating one prompt at a time.

      abetlen

      committed
      8740ddcView commit details

      Copy full SHA for 8740ddc

      View code at this pointBrowse repository at this point

    • Revert "llama_cpp server: prompt is a string". Closes #187

      Show description for 8895b90
      abetlen

      committed
      8895b90View commit details

      Copy full SHA for 8895b90

      View code at this pointBrowse repository at this point
12. Commits on May 9, 2023

    • llama_cpp server: document presence_penalty and frequency_penalty, mark as supported

      Stonelinks

      committed
      02e8a01View commit details

      Copy full SHA for 02e8a01

      View code at this pointBrowse repository at this point
13. Commits on May 8, 2023

    • Fix: default repeat_penalty

      abetlen

      committed
      82d138fView commit details

      Copy full SHA for 82d138f

      View code at this pointBrowse repository at this point

    • Bugfix: not falling back to environment variables when default is value is set.

      abetlen

      committed
      29f094bView commit details

      Copy full SHA for 29f094b

      View code at this pointBrowse repository at this point

    • Show default value when --help is called

      abetlen

      committed
      0d6c600View commit details

      Copy full SHA for 0d6c600

      View code at this pointBrowse repository at this point

    • Use environment variable if parsed cli arg is None

      abetlen

      committed
      022e9ebView commit details

      Copy full SHA for 022e9eb

      View code at this pointBrowse repository at this point

    • Set repeat_penalty to 0 by default

      abetlen

      committed
      0d751a6View commit details

      Copy full SHA for 0d751a6

      View code at this pointBrowse repository at this point

    • Add openai frequency and presence penalty parameters. Closes #169

      abetlen

      committed
      65d9cc0View commit details

      Copy full SHA for 65d9cc0

      View code at this pointBrowse repository at this point

    • Bugfix for models endpoint

      abetlen

      committed
      a0b61eaView commit details

      Copy full SHA for a0b61ea

      View code at this pointBrowse repository at this point
14. Commits on May 7, 2023

    • Added cache size to settins object.

      abetlen

      committed
      14da46fView commit details

      Copy full SHA for 14da46f

      View code at this pointBrowse repository at this point

    • Add verbose flag to server

      abetlen

      committed
      627811eView commit details

      Copy full SHA for 627811e

      View code at this pointBrowse repository at this point

    • Fix mlock_supported and mmap_supported return type

      abetlen

      committed
      3fbda71View commit details

      Copy full SHA for 3fbda71

      View code at this pointBrowse repository at this point

    • Update cpu_count

      abetlen

      committed
      5a3413eView commit details

      Copy full SHA for 5a3413e

      View code at this pointBrowse repository at this point

    • Update settings fields and defaults

      abetlen

      committed
      1a00e45View commit details

      Copy full SHA for 1a00e45

      View code at this pointBrowse repository at this point

    • Revert "llama_cpp server: delete some ignored / unused parameters"

      Show description for 8675397
      abetlen

      committed
      8675397View commit details

      Copy full SHA for 8675397

      View code at this pointBrowse repository at this point

    • Revert "llama_cpp server: mark model as required"

      Show description for c382d8f
      abetlen

      committed
      c382d8fView commit details

      Copy full SHA for c382d8f

      View code at this pointBrowse repository at this point

    • Merge branch 'main' of github.com:abetlen/llama_cpp_python into better-server-params-and-fields

      abetlen

      committed
      d8fddccView commit details

      Copy full SHA for d8fddcc

      View code at this pointBrowse repository at this point