Commits

Commit history

1. Commits on Nov 10, 2023

   • Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

     abetlen

     committed
     e7962d2View commit details

     Copy full SHA for e7962d2

     View code at this pointBrowse repository at this point
2. Commits on Nov 8, 2023

   • Fix destructor NoneType is not callable error

     abetlen

     committed
     ca4cb88View commit details

     Copy full SHA for ca4cb88

     View code at this pointBrowse repository at this point

   • Add JSON mode support. Closes #881

     abetlen

     committed
     b30b9c3View commit details

     Copy full SHA for b30b9c3

     View code at this pointBrowse repository at this point

   • Add seed parameter support for completion and chat_completion requests. Closes #884

     abetlen

     committed
     86aeb9fView commit details

     Copy full SHA for 86aeb9f

     View code at this pointBrowse repository at this point

   • Multimodal Support (Llava 1.5) (#821)

     Show description for aab74f0
     

     damian0815

     and

     abetlen

     authored
     aab74f0View commit details

     Copy full SHA for aab74f0

     View code at this pointBrowse repository at this point
3. Commits on Nov 3, 2023

   • Update llama.cpp

     abetlen

     committed
     df9362eView commit details

     Copy full SHA for df9362e

     View code at this pointBrowse repository at this point

   • Add functionary support (#784)

     Show description for 3af7b21
     abetlen

     authored
     3af7b21View commit details

     Copy full SHA for 3af7b21

     View code at this pointBrowse repository at this point
4. Commits on Nov 2, 2023

   • Update llama.cpp

     Show description for fa83cc5
     abetlen

     committed
     fa83cc5View commit details

     Copy full SHA for fa83cc5

     View code at this pointBrowse repository at this point

   • fix: tokenization of special characters: (#850)

     Show description for 4d4e0f1
     

     antoine-lizee

     authored and

     abetlen

     committed
     4d4e0f1View commit details

     Copy full SHA for 4d4e0f1

     View code at this pointBrowse repository at this point
5. Commits on Nov 1, 2023

   • Iterate over tokens that should be biased rather than the entire vocabulary. (#851)

     zolastro

     authored
     3fc9147View commit details

     Copy full SHA for 3fc9147

     View code at this pointBrowse repository at this point

   • Pass-Through grammar parameter in web server. (#855) Closes #778

     dthuerck

     authored
     5f8f369View commit details

     Copy full SHA for 5f8f369

     View code at this pointBrowse repository at this point
6. Commits on Oct 18, 2023

   • update value check for n_gpu_layers field (#826)

     hxy9243

     authored
     a315128View commit details

     Copy full SHA for a315128

     View code at this pointBrowse repository at this point
7. Commits on Oct 10, 2023

   • Print traceback on server error

     abetlen

     committed
     d6a130aView commit details

     Copy full SHA for d6a130a

     View code at this pointBrowse repository at this point
8. Commits on Sep 30, 2023

   • Log server exceptions to stdout

     abetlen

     committed
     5ef5280View commit details

     Copy full SHA for 5ef5280

     View code at this pointBrowse repository at this point
9. Commits on Sep 29, 2023

   • Update server params

     abetlen

     committed
     d9bce17View commit details

     Copy full SHA for d9bce17

     View code at this pointBrowse repository at this point
10. Commits on Sep 25, 2023

    • Adds openai-processing-ms response header (#748)

      

      Viacheslav/Slava Tradunsky

      authored
      3d5e5b1View commit details

      Copy full SHA for 3d5e5b1

      View code at this pointBrowse repository at this point
11. Commits on Sep 15, 2023

    • Remove confusing helpstring from server cli args. Closes #719

      abetlen

      committed
      b047b30View commit details

      Copy full SHA for b047b30

      View code at this pointBrowse repository at this point
12. Commits on Sep 14, 2023

    • Fix boolean env vars and cli arguments

      abetlen

      committed
      0449d29View commit details

      Copy full SHA for 0449d29

      View code at this pointBrowse repository at this point

    • Update app.py (#705)

      earonesty

      authored
      58a6e42View commit details

      Copy full SHA for 58a6e42

      View code at this pointBrowse repository at this point

    • Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.

      abetlen

      committed
      f4090a0View commit details

      Copy full SHA for f4090a0

      View code at this pointBrowse repository at this point

    • Fix boolean cli flags

      abetlen

      committed
      c999325View commit details

      Copy full SHA for c999325

      View code at this pointBrowse repository at this point

    • Format

      abetlen

      committed
      4daf77eView commit details

      Copy full SHA for 4daf77e

      View code at this pointBrowse repository at this point

    • Update server params. Added lora_base, lora_path, low_vram, and main_gpu. Removed rms_norm_eps and n_gqa (deprecated in llama.cpp)

      abetlen

      committed
      2920c4bView commit details

      Copy full SHA for 2920c4b

      View code at this pointBrowse repository at this point

    • Fix tensor_split cli option

      abetlen

      committed
      c4c440bView commit details

      Copy full SHA for c4c440b

      View code at this pointBrowse repository at this point
13. Commits on Sep 13, 2023

    • Fix issue with Literal and Optional cli arguments not working. Closes #702

      abetlen

      committed
      759405cView commit details

      Copy full SHA for 759405c

      View code at this pointBrowse repository at this point

    • Add X-Request-ID request header for mirroring custom IDs. (#703)

      devrimcavusoglu

      authored
      da9df78View commit details

      Copy full SHA for da9df78

      View code at this pointBrowse repository at this point
14. Commits on Sep 12, 2023

    • Merge branch 'main' into v0.2-wip

      abetlen

      committed
      1910793View commit details

      Copy full SHA for 1910793

      View code at this pointBrowse repository at this point
15. Commits on Aug 25, 2023

    • Add copilot-codex completions endpoint for drop-in copilot usage

      abetlen

      committed
      5de8009View commit details

      Copy full SHA for 5de8009

      View code at this pointBrowse repository at this point
16. Commits on Aug 24, 2023

    • Merge branch 'main' into v0.2-wip

      abetlen

      committed
      cf405f6View commit details

      Copy full SHA for cf405f6

      View code at this pointBrowse repository at this point
17. Commits on Aug 8, 2023

    • Add mul_mat_q option

      abetlen

      committed
      d015bdbView commit details

      Copy full SHA for d015bdb

      View code at this pointBrowse repository at this point
18. Commits on Jul 24, 2023

    • Merge branch 'main' into v0.2-wip

      abetlen

      committed
      3434803View commit details

      Copy full SHA for 3434803

      View code at this pointBrowse repository at this point

    • Add temporary rms_norm_eps parameter

      abetlen

      committed
      11dd2bfView commit details

      Copy full SHA for 11dd2bf

      View code at this pointBrowse repository at this point
19. Commits on Jul 20, 2023

    • Merge branch 'main' into v0.2-wip

      abetlen

      committed
      0538ba1View commit details

      Copy full SHA for 0538ba1

      View code at this pointBrowse repository at this point

    • Fix compatibility with older python versions

      abetlen

      committed
      28a1117View commit details

      Copy full SHA for 28a1117

      View code at this pointBrowse repository at this point

    • Merge pull request #481 from c0sogi/main

      Show description for 365d9a4
      abetlen

      authored
      365d9a4View commit details

      Copy full SHA for 365d9a4

      View code at this pointBrowse repository at this point