Commits

Commit history

1. Commits on Feb 17, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     fdce078View commit details

     Copy full SHA for fdce078

     View code at this pointBrowse repository at this point
2. Commits on Feb 15, 2024

   • fix: Use '\n' seperator for EventSourceResponse (#1188)

     Show description for ea1f88d
     

     khimaros

     and

     abetlen

     authored
     ea1f88dView commit details

     Copy full SHA for ea1f88d

     View code at this pointBrowse repository at this point
3. Commits on Feb 8, 2024

   • fix: broken import

     abetlen

     committed
     85d3374View commit details

     Copy full SHA for 85d3374

     View code at this pointBrowse repository at this point

   • feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)

     Show description for 9018270
     

     jeffrey-fong

     and

     abetlen

     authored
     9018270View commit details

     Copy full SHA for 9018270

     View code at this pointBrowse repository at this point
4. Commits on Jan 31, 2024

   • Add speculative decoding (#1120)

     Show description for fb762a6
     abetlen

     authored
     fb762a6View commit details

     Copy full SHA for fb762a6

     View code at this pointBrowse repository at this point
5. Commits on Jan 29, 2024

   • Automatically set chat format from gguf (#1110)

     Show description for da003d8
     abetlen

     authored
     da003d8View commit details

     Copy full SHA for da003d8

     View code at this pointBrowse repository at this point
6. Commits on Jan 25, 2024

   • feat(server): include llama-cpp-python version in openapi spec

     abetlen

     committed
     cde7514View commit details

     Copy full SHA for cde7514

     View code at this pointBrowse repository at this point
7. Commits on Jan 21, 2024

   • fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

     abetlen

     committed
     24f3945View commit details

     Copy full SHA for 24f3945

     View code at this pointBrowse repository at this point
8. Commits on Jan 19, 2024

   • Fix python3.8 support

     abetlen

     committed
     141293aView commit details

     Copy full SHA for 141293a

     View code at this pointBrowse repository at this point

   • feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

     abetlen

     committed
     b8fc1c7View commit details

     Copy full SHA for b8fc1c7

     View code at this pointBrowse repository at this point
9. Commits on Jan 18, 2024

   • Offload KQV by default

     abetlen

     committed
     48c3b77View commit details

     Copy full SHA for 48c3b77

     View code at this pointBrowse repository at this point
10. Commits on Jan 16, 2024

    • fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)

      K-Mistele

      authored
      9c36688View commit details

      Copy full SHA for 9c36688

      View code at this pointBrowse repository at this point

    • Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

      Show description for cfb7da9
      

      3 peopleauthored
      cfb7da9View commit details

      Copy full SHA for cfb7da9

      View code at this pointBrowse repository at this point
11. Commits on Jan 15, 2024

    • Add split_mode option. Closes #1085

      abetlen

      committed
      84615adView commit details

      Copy full SHA for 84615ad

      View code at this pointBrowse repository at this point

    • Implement GGUF metadata KV overrides (#1011)

      Show description for 76aafa6
      

      phiharri

      and

      abetlen

      authored
      76aafa6View commit details

      Copy full SHA for 76aafa6

      View code at this pointBrowse repository at this point
12. Commits on Dec 22, 2023

    • docs: add server config docs

      abetlen

      committed
      522aecbView commit details

      Copy full SHA for 522aecb

      View code at this pointBrowse repository at this point

    • server: Support none defaulting to infinity for completions (#111)

      Show description for 4b01a87
      

      swg

      and

      abetlen

      authored
      4b01a87View commit details

      Copy full SHA for 4b01a87

      View code at this pointBrowse repository at this point

    • [Feat] Multi model support (#931)

      Show description for 12b7f2f
      

      D4ve-R

      and

      abetlen

      authored
      12b7f2fView commit details

      Copy full SHA for 12b7f2f

      View code at this pointBrowse repository at this point
13. Commits on Dec 21, 2023

    • Implement openai api compatible authentication (#1010)

      docmeth02

      authored
      33cc623View commit details

      Copy full SHA for 33cc623

      View code at this pointBrowse repository at this point
14. Commits on Dec 18, 2023

    • Add offload_kqv option to llama and server

      abetlen

      committed
      095c650View commit details

      Copy full SHA for 095c650

      View code at this pointBrowse repository at this point

    • Bugfix: Remove f16_kv, add offload_kqv field (#1019)

      Show description for 62944df
      brandonrobertz

      authored
      62944dfView commit details

      Copy full SHA for 62944df

      View code at this pointBrowse repository at this point
15. Commits on Dec 12, 2023

    • Add support for running the server with SSL (#994)

      rgerganov

      authored
      8e44a32View commit details

      Copy full SHA for 8e44a32

      View code at this pointBrowse repository at this point
16. Commits on Nov 24, 2023

    • docs: Update openapi endpoint names

      abetlen

      committed
      1a7bf20View commit details

      Copy full SHA for 1a7bf20

      View code at this pointBrowse repository at this point
17. Commits on Nov 21, 2023

    • Fix #569

      abetlen

      committed
      128dc47View commit details

      Copy full SHA for 128dc47

      View code at this pointBrowse repository at this point

    • Format

      abetlen

      committed
      7a3f878View commit details

      Copy full SHA for 7a3f878

      View code at this pointBrowse repository at this point

    • Add support for logit_bias outside of server api. Closes #827

      abetlen

      committed
      07e47f5View commit details

      Copy full SHA for 07e47f5

      View code at this pointBrowse repository at this point

    • Added support for min_p (#921)

      Show description for b8438f7
      tk-master

      authored
      b8438f7View commit details

      Copy full SHA for b8438f7

      View code at this pointBrowse repository at this point
18. Commits on Nov 10, 2023

    • Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

      abetlen

      committed
      e7962d2View commit details

      Copy full SHA for e7962d2

      View code at this pointBrowse repository at this point
19. Commits on Nov 8, 2023

    • Fix destructor NoneType is not callable error

      abetlen

      committed
      ca4cb88View commit details

      Copy full SHA for ca4cb88

      View code at this pointBrowse repository at this point

    • Add JSON mode support. Closes #881

      abetlen

      committed
      b30b9c3View commit details

      Copy full SHA for b30b9c3

      View code at this pointBrowse repository at this point

    • Add seed parameter support for completion and chat_completion requests. Closes #884

      abetlen

      committed
      86aeb9fView commit details

      Copy full SHA for 86aeb9f

      View code at this pointBrowse repository at this point

    • Multimodal Support (Llava 1.5) (#821)

      Show description for aab74f0
      

      damian0815

      and

      abetlen

      authored
      aab74f0View commit details

      Copy full SHA for aab74f0

      View code at this pointBrowse repository at this point
20. Commits on Nov 3, 2023

    • Update llama.cpp

      abetlen

      committed
      df9362eView commit details

      Copy full SHA for df9362e

      View code at this pointBrowse repository at this point

    • Add functionary support (#784)

      Show description for 3af7b21
      abetlen

      authored
      3af7b21View commit details

      Copy full SHA for 3af7b21

      View code at this pointBrowse repository at this point
21. Commits on Nov 2, 2023

    • Update llama.cpp

      Show description for fa83cc5
      abetlen

      committed
      fa83cc5View commit details

      Copy full SHA for fa83cc5

      View code at this pointBrowse repository at this point