Commits

Commit history

1. Commits on Sep 14, 2023

   • Fix boolean env vars and cli arguments

     abetlen

     committed
     0449d29View commit details

     Copy full SHA for 0449d29

     View code at this pointBrowse repository at this point

   • Update app.py (#705)

     earonesty

     authored
     58a6e42View commit details

     Copy full SHA for 58a6e42

     View code at this pointBrowse repository at this point

   • Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.

     abetlen

     committed
     f4090a0View commit details

     Copy full SHA for f4090a0

     View code at this pointBrowse repository at this point

   • Fix boolean cli flags

     abetlen

     committed
     c999325View commit details

     Copy full SHA for c999325

     View code at this pointBrowse repository at this point

   • Format

     abetlen

     committed
     4daf77eView commit details

     Copy full SHA for 4daf77e

     View code at this pointBrowse repository at this point

   • Update server params. Added lora_base, lora_path, low_vram, and main_gpu. Removed rms_norm_eps and n_gqa (deprecated in llama.cpp)

     abetlen

     committed
     2920c4bView commit details

     Copy full SHA for 2920c4b

     View code at this pointBrowse repository at this point

   • Fix tensor_split cli option

     abetlen

     committed
     c4c440bView commit details

     Copy full SHA for c4c440b

     View code at this pointBrowse repository at this point
2. Commits on Sep 13, 2023

   • Fix issue with Literal and Optional cli arguments not working. Closes #702

     abetlen

     committed
     759405cView commit details

     Copy full SHA for 759405c

     View code at this pointBrowse repository at this point

   • Add X-Request-ID request header for mirroring custom IDs. (#703)

     devrimcavusoglu

     authored
     da9df78View commit details

     Copy full SHA for da9df78

     View code at this pointBrowse repository at this point
3. Commits on Sep 12, 2023

   • Merge branch 'main' into v0.2-wip

     abetlen

     committed
     1910793View commit details

     Copy full SHA for 1910793

     View code at this pointBrowse repository at this point
4. Commits on Aug 25, 2023

   • Add copilot-codex completions endpoint for drop-in copilot usage

     abetlen

     committed
     5de8009View commit details

     Copy full SHA for 5de8009

     View code at this pointBrowse repository at this point
5. Commits on Aug 24, 2023

   • Merge branch 'main' into v0.2-wip

     abetlen

     committed
     cf405f6View commit details

     Copy full SHA for cf405f6

     View code at this pointBrowse repository at this point
6. Commits on Aug 8, 2023

   • Add mul_mat_q option

     abetlen

     committed
     d015bdbView commit details

     Copy full SHA for d015bdb

     View code at this pointBrowse repository at this point
7. Commits on Jul 24, 2023

   • Merge branch 'main' into v0.2-wip

     abetlen

     committed
     3434803View commit details

     Copy full SHA for 3434803

     View code at this pointBrowse repository at this point

   • Add temporary rms_norm_eps parameter

     abetlen

     committed
     11dd2bfView commit details

     Copy full SHA for 11dd2bf

     View code at this pointBrowse repository at this point
8. Commits on Jul 20, 2023

   • Merge branch 'main' into v0.2-wip

     abetlen

     committed
     0538ba1View commit details

     Copy full SHA for 0538ba1

     View code at this pointBrowse repository at this point

   • Fix compatibility with older python versions

     abetlen

     committed
     28a1117View commit details

     Copy full SHA for 28a1117

     View code at this pointBrowse repository at this point

   • Merge pull request #481 from c0sogi/main

     Show description for 365d9a4
     abetlen

     authored
     365d9a4View commit details

     Copy full SHA for 365d9a4

     View code at this pointBrowse repository at this point
9. Commits on Jul 19, 2023

   • Format

     abetlen

     committed
     0b121a7View commit details

     Copy full SHA for 0b121a7

     View code at this pointBrowse repository at this point

   • Add functions parameters

     abetlen

     committed
     b43917cView commit details

     Copy full SHA for b43917c

     View code at this pointBrowse repository at this point
10. Commits on Jul 18, 2023

    • Use numpy arrays for logits_processors and stopping_criteria. Closes #491

      abetlen

      committed
      19ba9d3View commit details

      Copy full SHA for 19ba9d3

      View code at this pointBrowse repository at this point

    • expose RoPE param to server start

      

      shutup

      committed
      5ed8bf1View commit details

      Copy full SHA for 5ed8bf1

      View code at this pointBrowse repository at this point
11. Commits on Jul 16, 2023

    • Added `RouteErrorHandler` for server

      c0sogi

      committed
      1551ba1View commit details

      Copy full SHA for 1551ba1

      View code at this pointBrowse repository at this point
12. Commits on Jul 14, 2023

    • fix: tensor_split should be optional list

      abetlen

      committed
      118b7f6View commit details

      Copy full SHA for 118b7f6

      View code at this pointBrowse repository at this point

    • Resolve merge conflicts

      

      Shouyi Wang

      committed
      579f526View commit details

      Copy full SHA for 579f526

      View code at this pointBrowse repository at this point

    • bugfix: pydantic v2 fields

      abetlen

      committed
      de4cc5aView commit details

      Copy full SHA for de4cc5a

      View code at this pointBrowse repository at this point
13. Commits on Jul 9, 2023

    • bugfix: pydantic settings missing / changed fields

      abetlen

      committed
      6f70cc4View commit details

      Copy full SHA for 6f70cc4

      View code at this pointBrowse repository at this point

    • Add tensor split

      

      Shouyi Wang

      committed
      9f21f54View commit details

      Copy full SHA for 9f21f54

      View code at this pointBrowse repository at this point
14. Commits on Jul 8, 2023

    • Upgrade fastapi to 0.100.0 and pydantic v2

      abetlen

      committed
      52753b7View commit details

      Copy full SHA for 52753b7

      View code at this pointBrowse repository at this point
15. Commits on Jul 7, 2023

    • Add setting to control request interruption

      abetlen

      committed
      57d8ec3View commit details

      Copy full SHA for 57d8ec3

      View code at this pointBrowse repository at this point

    • Add interruptible streaming requests for llama-cpp-python server. Closes #183

      abetlen

      committed
      4c7cdccView commit details

      Copy full SHA for 4c7cdcc

      View code at this pointBrowse repository at this point
16. Commits on Jun 22, 2023

    • server: pass seed param from command line to llama

      lexin4ever

      authored
      282698bView commit details

      Copy full SHA for 282698b

      View code at this pointBrowse repository at this point
17. Commits on Jun 15, 2023

    • Add low_vram to server settings

      abetlen

      committed
      1e20be6View commit details

      Copy full SHA for 1e20be6

      View code at this pointBrowse repository at this point

    • Format server options

      abetlen

      committed
      f7c5cfaView commit details

      Copy full SHA for f7c5cfa

      View code at this pointBrowse repository at this point

    • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

      abetlen

      committed
      9c41a3eView commit details

      Copy full SHA for 9c41a3e

      View code at this pointBrowse repository at this point