Commits

Commit history

1. Commits on Apr 1, 2024

   • feat: add support for KV cache quantization options (#1307)

     Show description for f165048
     

     Limour-dev

     and

     abetlen

     authored
     f165048View commit details

     Copy full SHA for f165048

     View code at this pointBrowse repository at this point
2. Commits on Mar 31, 2024

   • feat: Add logprobs support to chat completions (#1311)

     Show description for aa9f1ae
     

     windspirit95

     and

     abetlen

     authored
     aa9f1aeView commit details

     Copy full SHA for aa9f1ae

     View code at this pointBrowse repository at this point
3. Commits on Mar 23, 2024

   • fix(server): minor type fixes

     abetlen

     committed
     d11ccc3View commit details

     Copy full SHA for d11ccc3

     View code at this pointBrowse repository at this point
4. Commits on Mar 19, 2024

   • docs: Add chat examples to openapi ui

     abetlen

     committed
     f7decc9View commit details

     Copy full SHA for f7decc9

     View code at this pointBrowse repository at this point
5. Commits on Mar 9, 2024

   • feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

     Show description for c139f8b
     

     felipelo

     and

     abetlen

     authored
     c139f8bView commit details

     Copy full SHA for c139f8b

     View code at this pointBrowse repository at this point
6. Commits on Feb 28, 2024

   • misc: Format

     abetlen

     committed
     727d60cView commit details

     Copy full SHA for 727d60c

     View code at this pointBrowse repository at this point

   • feat: Update llama.cpp

     abetlen

     committed
     0d37ce5View commit details

     Copy full SHA for 0d37ce5

     View code at this pointBrowse repository at this point
7. Commits on Feb 26, 2024

   • feat(server): Add support for pulling models from Huggingface Hub (#1222)

     Show description for 4d574bd
     abetlen

     authored
     4d574bdView commit details

     Copy full SHA for 4d574bd

     View code at this pointBrowse repository at this point

   • fix: remove prematurely commited change

     abetlen

     committed
     dcf38f6View commit details

     Copy full SHA for dcf38f6

     View code at this pointBrowse repository at this point
8. Commits on Feb 25, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     2292af5View commit details

     Copy full SHA for 2292af5

     View code at this pointBrowse repository at this point
9. Commits on Feb 17, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     fdce078View commit details

     Copy full SHA for fdce078

     View code at this pointBrowse repository at this point
10. Commits on Feb 15, 2024

    • fix: Use '\n' seperator for EventSourceResponse (#1188)

      Show description for ea1f88d
      

      khimaros

      and

      abetlen

      authored
      ea1f88dView commit details

      Copy full SHA for ea1f88d

      View code at this pointBrowse repository at this point
11. Commits on Feb 8, 2024

    • fix: broken import

      abetlen

      committed
      85d3374View commit details

      Copy full SHA for 85d3374

      View code at this pointBrowse repository at this point

    • feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)

      Show description for 9018270
      

      jeffrey-fong

      and

      abetlen

      authored
      9018270View commit details

      Copy full SHA for 9018270

      View code at this pointBrowse repository at this point
12. Commits on Jan 31, 2024

    • Add speculative decoding (#1120)

      Show description for fb762a6
      abetlen

      authored
      fb762a6View commit details

      Copy full SHA for fb762a6

      View code at this pointBrowse repository at this point
13. Commits on Jan 29, 2024

    • Automatically set chat format from gguf (#1110)

      Show description for da003d8
      abetlen

      authored
      da003d8View commit details

      Copy full SHA for da003d8

      View code at this pointBrowse repository at this point
14. Commits on Jan 25, 2024

    • feat(server): include llama-cpp-python version in openapi spec

      abetlen

      committed
      cde7514View commit details

      Copy full SHA for cde7514

      View code at this pointBrowse repository at this point
15. Commits on Jan 21, 2024

    • fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

      abetlen

      committed
      24f3945View commit details

      Copy full SHA for 24f3945

      View code at this pointBrowse repository at this point
16. Commits on Jan 19, 2024

    • Fix python3.8 support

      abetlen

      committed
      141293aView commit details

      Copy full SHA for 141293a

      View code at this pointBrowse repository at this point

    • feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

      abetlen

      committed
      b8fc1c7View commit details

      Copy full SHA for b8fc1c7

      View code at this pointBrowse repository at this point
17. Commits on Jan 18, 2024

    • Offload KQV by default

      abetlen

      committed
      48c3b77View commit details

      Copy full SHA for 48c3b77

      View code at this pointBrowse repository at this point
18. Commits on Jan 16, 2024

    • fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)

      K-Mistele

      authored
      9c36688View commit details

      Copy full SHA for 9c36688

      View code at this pointBrowse repository at this point

    • Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

      Show description for cfb7da9
      

      3 peopleauthored
      cfb7da9View commit details

      Copy full SHA for cfb7da9

      View code at this pointBrowse repository at this point
19. Commits on Jan 15, 2024

    • Add split_mode option. Closes #1085

      abetlen

      committed
      84615adView commit details

      Copy full SHA for 84615ad

      View code at this pointBrowse repository at this point

    • Implement GGUF metadata KV overrides (#1011)

      Show description for 76aafa6
      

      phiharri

      and

      abetlen

      authored
      76aafa6View commit details

      Copy full SHA for 76aafa6

      View code at this pointBrowse repository at this point
20. Commits on Dec 22, 2023

    • docs: add server config docs

      abetlen

      committed
      522aecbView commit details

      Copy full SHA for 522aecb

      View code at this pointBrowse repository at this point

    • server: Support none defaulting to infinity for completions (#111)

      Show description for 4b01a87
      

      swg

      and

      abetlen

      authored
      4b01a87View commit details

      Copy full SHA for 4b01a87

      View code at this pointBrowse repository at this point

    • [Feat] Multi model support (#931)

      Show description for 12b7f2f
      

      D4ve-R

      and

      abetlen

      authored
      12b7f2fView commit details

      Copy full SHA for 12b7f2f

      View code at this pointBrowse repository at this point
21. Commits on Dec 21, 2023

    • Implement openai api compatible authentication (#1010)

      docmeth02

      authored
      33cc623View commit details

      Copy full SHA for 33cc623

      View code at this pointBrowse repository at this point
22. Commits on Dec 18, 2023

    • Add offload_kqv option to llama and server

      abetlen

      committed
      095c650View commit details

      Copy full SHA for 095c650

      View code at this pointBrowse repository at this point

    • Bugfix: Remove f16_kv, add offload_kqv field (#1019)

      Show description for 62944df
      brandonrobertz

      authored
      62944dfView commit details

      Copy full SHA for 62944df

      View code at this pointBrowse repository at this point
23. Commits on Dec 12, 2023

    • Add support for running the server with SSL (#994)

      rgerganov

      authored
      8e44a32View commit details

      Copy full SHA for 8e44a32

      View code at this pointBrowse repository at this point
24. Commits on Nov 24, 2023

    • docs: Update openapi endpoint names

      abetlen

      committed
      1a7bf20View commit details

      Copy full SHA for 1a7bf20

      View code at this pointBrowse repository at this point
25. Commits on Nov 21, 2023

    • Fix #569

      abetlen

      committed
      128dc47View commit details

      Copy full SHA for 128dc47

      View code at this pointBrowse repository at this point

    • Format

      abetlen

      committed
      7a3f878View commit details

      Copy full SHA for 7a3f878

      View code at this pointBrowse repository at this point