Commits

Commit history

1. Commits on Oct 18, 2023

   • update value check for n_gpu_layers field (#826)

     hxy9243

     authored
     a315128View commit details

     Copy full SHA for a315128

     View code at this pointBrowse repository at this point
2. Commits on Oct 10, 2023

   • Print traceback on server error

     abetlen

     committed
     d6a130aView commit details

     Copy full SHA for d6a130a

     View code at this pointBrowse repository at this point
3. Commits on Sep 30, 2023

   • Log server exceptions to stdout

     abetlen

     committed
     5ef5280View commit details

     Copy full SHA for 5ef5280

     View code at this pointBrowse repository at this point
4. Commits on Sep 29, 2023

   • Update server params

     abetlen

     committed
     d9bce17View commit details

     Copy full SHA for d9bce17

     View code at this pointBrowse repository at this point
5. Commits on Sep 25, 2023

   • Adds openai-processing-ms response header (#748)

     

     Viacheslav/Slava Tradunsky

     authored
     3d5e5b1View commit details

     Copy full SHA for 3d5e5b1

     View code at this pointBrowse repository at this point
6. Commits on Sep 15, 2023

   • Remove confusing helpstring from server cli args. Closes #719

     abetlen

     committed
     b047b30View commit details

     Copy full SHA for b047b30

     View code at this pointBrowse repository at this point
7. Commits on Sep 14, 2023

   • Fix boolean env vars and cli arguments

     abetlen

     committed
     0449d29View commit details

     Copy full SHA for 0449d29

     View code at this pointBrowse repository at this point

   • Update app.py (#705)

     earonesty

     authored
     58a6e42View commit details

     Copy full SHA for 58a6e42

     View code at this pointBrowse repository at this point

   • Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.

     abetlen

     committed
     f4090a0View commit details

     Copy full SHA for f4090a0

     View code at this pointBrowse repository at this point

   • Fix boolean cli flags

     abetlen

     committed
     c999325View commit details

     Copy full SHA for c999325

     View code at this pointBrowse repository at this point

   • Format

     abetlen

     committed
     4daf77eView commit details

     Copy full SHA for 4daf77e

     View code at this pointBrowse repository at this point

   • Update server params. Added lora_base, lora_path, low_vram, and main_gpu. Removed rms_norm_eps and n_gqa (deprecated in llama.cpp)

     abetlen

     committed
     2920c4bView commit details

     Copy full SHA for 2920c4b

     View code at this pointBrowse repository at this point

   • Fix tensor_split cli option

     abetlen

     committed
     c4c440bView commit details

     Copy full SHA for c4c440b

     View code at this pointBrowse repository at this point
8. Commits on Sep 13, 2023

   • Fix issue with Literal and Optional cli arguments not working. Closes #702

     abetlen

     committed
     759405cView commit details

     Copy full SHA for 759405c

     View code at this pointBrowse repository at this point

   • Add X-Request-ID request header for mirroring custom IDs. (#703)

     devrimcavusoglu

     authored
     da9df78View commit details

     Copy full SHA for da9df78

     View code at this pointBrowse repository at this point
9. Commits on Sep 12, 2023

   • Merge branch 'main' into v0.2-wip

     abetlen

     committed
     1910793View commit details

     Copy full SHA for 1910793

     View code at this pointBrowse repository at this point
10. Commits on Aug 25, 2023

    • Add copilot-codex completions endpoint for drop-in copilot usage

      abetlen

      committed
      5de8009View commit details

      Copy full SHA for 5de8009

      View code at this pointBrowse repository at this point
11. Commits on Aug 24, 2023

    • Merge branch 'main' into v0.2-wip

      abetlen

      committed
      cf405f6View commit details

      Copy full SHA for cf405f6

      View code at this pointBrowse repository at this point
12. Commits on Aug 8, 2023

    • Add mul_mat_q option

      abetlen

      committed
      d015bdbView commit details

      Copy full SHA for d015bdb

      View code at this pointBrowse repository at this point
13. Commits on Jul 24, 2023

    • Merge branch 'main' into v0.2-wip

      abetlen

      committed
      3434803View commit details

      Copy full SHA for 3434803

      View code at this pointBrowse repository at this point

    • Add temporary rms_norm_eps parameter

      abetlen

      committed
      11dd2bfView commit details

      Copy full SHA for 11dd2bf

      View code at this pointBrowse repository at this point
14. Commits on Jul 20, 2023

    • Merge branch 'main' into v0.2-wip

      abetlen

      committed
      0538ba1View commit details

      Copy full SHA for 0538ba1

      View code at this pointBrowse repository at this point

    • Fix compatibility with older python versions

      abetlen

      committed
      28a1117View commit details

      Copy full SHA for 28a1117

      View code at this pointBrowse repository at this point

    • Merge pull request #481 from c0sogi/main

      Show description for 365d9a4
      abetlen

      authored
      365d9a4View commit details

      Copy full SHA for 365d9a4

      View code at this pointBrowse repository at this point
15. Commits on Jul 19, 2023

    • Format

      abetlen

      committed
      0b121a7View commit details

      Copy full SHA for 0b121a7

      View code at this pointBrowse repository at this point

    • Add functions parameters

      abetlen

      committed
      b43917cView commit details

      Copy full SHA for b43917c

      View code at this pointBrowse repository at this point
16. Commits on Jul 18, 2023

    • Use numpy arrays for logits_processors and stopping_criteria. Closes #491

      abetlen

      committed
      19ba9d3View commit details

      Copy full SHA for 19ba9d3

      View code at this pointBrowse repository at this point

    • expose RoPE param to server start

      

      shutup

      committed
      5ed8bf1View commit details

      Copy full SHA for 5ed8bf1

      View code at this pointBrowse repository at this point
17. Commits on Jul 16, 2023

    • Added `RouteErrorHandler` for server

      c0sogi

      committed
      1551ba1View commit details

      Copy full SHA for 1551ba1

      View code at this pointBrowse repository at this point
18. Commits on Jul 14, 2023

    • fix: tensor_split should be optional list

      abetlen

      committed
      118b7f6View commit details

      Copy full SHA for 118b7f6

      View code at this pointBrowse repository at this point

    • Resolve merge conflicts

      

      Shouyi Wang

      committed
      579f526View commit details

      Copy full SHA for 579f526

      View code at this pointBrowse repository at this point

    • bugfix: pydantic v2 fields

      abetlen

      committed
      de4cc5aView commit details

      Copy full SHA for de4cc5a

      View code at this pointBrowse repository at this point
19. Commits on Jul 9, 2023

    • bugfix: pydantic settings missing / changed fields

      abetlen

      committed
      6f70cc4View commit details

      Copy full SHA for 6f70cc4

      View code at this pointBrowse repository at this point

    • Add tensor split

      

      Shouyi Wang

      committed
      9f21f54View commit details

      Copy full SHA for 9f21f54

      View code at this pointBrowse repository at this point
20. Commits on Jul 8, 2023

    • Upgrade fastapi to 0.100.0 and pydantic v2

      abetlen

      committed
      52753b7View commit details

      Copy full SHA for 52753b7

      View code at this pointBrowse repository at this point