Commits

Commit history

1. Commits on Mar 22, 2026

   • misc: Add Ruff formatting (#2148)

     Show description for a9b4a06
     abetlen

     authored
     a9b4a06View commit details

     Copy full SHA for a9b4a06

     View code at this pointBrowse repository at this point
2. Commits on Jan 8, 2025

   • fix: streaming resource lock (#1879)

     Show description for e8f14ce
     

     gjpower

     and

     abetlen

     authored
     e8f14ceView commit details

     Copy full SHA for e8f14ce

     View code at this pointBrowse repository at this point
3. Commits on Dec 9, 2024

   • fix: add missing await statements for async exit_stack handling (#1858)

     gjpower

     authored
     afedfc8View commit details

     Copy full SHA for afedfc8

     View code at this pointBrowse repository at this point
4. Commits on Dec 6, 2024

   • fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context (#1798)

     Show description for 9bd0c95
     

     gjpower

     and

     abetlen

     authored
     9bd0c95View commit details

     Copy full SHA for 9bd0c95

     View code at this pointBrowse repository at this point

   • fix: added missing exit_stack.close() to /v1/chat/completions (#1796)

     Show description for 073b7e4
     Ian321

     authored
     073b7e4View commit details

     Copy full SHA for 073b7e4

     View code at this pointBrowse repository at this point
5. Commits on Jul 9, 2024

   • fix(misc): Format

     abetlen

     committed
     c1ae815View commit details

     Copy full SHA for c1ae815

     View code at this pointBrowse repository at this point
6. Commits on Jul 2, 2024

   • fix(misc): Fix type errors

     abetlen

     committed
     387d01dView commit details

     Copy full SHA for 387d01d

     View code at this pointBrowse repository at this point

   • fix(server): Fix bug in FastAPI streaming response where dependency was released before request completes causing SEGFAULT

     abetlen

     committed
     296304bView commit details

     Copy full SHA for 296304b

     View code at this pointBrowse repository at this point
7. Commits on May 14, 2024

   • feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)

     Show description for 5212fb0
     twaka

     authored
     5212fb0View commit details

     Copy full SHA for 5212fb0

     View code at this pointBrowse repository at this point
8. Commits on May 5, 2024

   • feat(server): Add support for setting root_path. Closes #1420

     abetlen

     committed
     0318702View commit details

     Copy full SHA for 0318702

     View code at this pointBrowse repository at this point
9. Commits on Apr 17, 2024

   • feat: add `disable_ping_events` flag (#1257)

     Show description for b73c73c
     khimaros

     authored
     b73c73cView commit details

     Copy full SHA for b73c73c

     View code at this pointBrowse repository at this point
10. Commits on Apr 10, 2024

    • feat: Add support for yaml based configs

      abetlen

      committed
      060bfa6View commit details

      Copy full SHA for 060bfa6

      View code at this pointBrowse repository at this point
11. Commits on Mar 31, 2024

    • feat: Add logprobs support to chat completions (#1311)

      Show description for aa9f1ae
      

      windspirit95

      and

      abetlen

      authored
      aa9f1aeView commit details

      Copy full SHA for aa9f1ae

      View code at this pointBrowse repository at this point
12. Commits on Mar 23, 2024

    • fix(server): minor type fixes

      abetlen

      committed
      d11ccc3View commit details

      Copy full SHA for d11ccc3

      View code at this pointBrowse repository at this point
13. Commits on Mar 19, 2024

    • docs: Add chat examples to openapi ui

      abetlen

      committed
      f7decc9View commit details

      Copy full SHA for f7decc9

      View code at this pointBrowse repository at this point
14. Commits on Mar 9, 2024

    • feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

      Show description for c139f8b
      

      felipelo

      and

      abetlen

      authored
      c139f8bView commit details

      Copy full SHA for c139f8b

      View code at this pointBrowse repository at this point
15. Commits on Feb 28, 2024

    • misc: Format

      abetlen

      committed
      727d60cView commit details

      Copy full SHA for 727d60c

      View code at this pointBrowse repository at this point
16. Commits on Feb 15, 2024

    • fix: Use '\n' seperator for EventSourceResponse (#1188)

      Show description for ea1f88d
      

      khimaros

      and

      abetlen

      authored
      ea1f88dView commit details

      Copy full SHA for ea1f88d

      View code at this pointBrowse repository at this point
17. Commits on Jan 25, 2024

    • feat(server): include llama-cpp-python version in openapi spec

      abetlen

      committed
      cde7514View commit details

      Copy full SHA for cde7514

      View code at this pointBrowse repository at this point
18. Commits on Jan 16, 2024

    • Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

      Show description for cfb7da9
      

      3 peopleauthored
      cfb7da9View commit details

      Copy full SHA for cfb7da9

      View code at this pointBrowse repository at this point
19. Commits on Dec 22, 2023

    • [Feat] Multi model support (#931)

      Show description for 12b7f2f
      

      D4ve-R

      and

      abetlen

      authored
      12b7f2fView commit details

      Copy full SHA for 12b7f2f

      View code at this pointBrowse repository at this point
20. Commits on Dec 21, 2023

    • Implement openai api compatible authentication (#1010)

      docmeth02

      authored
      33cc623View commit details

      Copy full SHA for 33cc623

      View code at this pointBrowse repository at this point
21. Commits on Dec 18, 2023

    • Add offload_kqv option to llama and server

      abetlen

      committed
      095c650View commit details

      Copy full SHA for 095c650

      View code at this pointBrowse repository at this point

    • Bugfix: Remove f16_kv, add offload_kqv field (#1019)

      Show description for 62944df
      brandonrobertz

      authored
      62944dfView commit details

      Copy full SHA for 62944df

      View code at this pointBrowse repository at this point
22. Commits on Dec 12, 2023

    • Add support for running the server with SSL (#994)

      rgerganov

      authored
      8e44a32View commit details

      Copy full SHA for 8e44a32

      View code at this pointBrowse repository at this point
23. Commits on Nov 24, 2023

    • docs: Update openapi endpoint names

      abetlen

      committed
      1a7bf20View commit details

      Copy full SHA for 1a7bf20

      View code at this pointBrowse repository at this point
24. Commits on Nov 21, 2023

    • Fix #569

      abetlen

      committed
      128dc47View commit details

      Copy full SHA for 128dc47

      View code at this pointBrowse repository at this point

    • Format

      abetlen

      committed
      7a3f878View commit details

      Copy full SHA for 7a3f878

      View code at this pointBrowse repository at this point

    • Add support for logit_bias outside of server api. Closes #827

      abetlen

      committed
      07e47f5View commit details

      Copy full SHA for 07e47f5

      View code at this pointBrowse repository at this point

    • Added support for min_p (#921)

      Show description for b8438f7
      tk-master

      authored
      b8438f7View commit details

      Copy full SHA for b8438f7

      View code at this pointBrowse repository at this point
25. Commits on Nov 10, 2023

    • Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

      abetlen

      committed
      e7962d2View commit details

      Copy full SHA for e7962d2

      View code at this pointBrowse repository at this point
26. Commits on Nov 8, 2023

    • Fix destructor NoneType is not callable error

      abetlen

      committed
      ca4cb88View commit details

      Copy full SHA for ca4cb88

      View code at this pointBrowse repository at this point

    • Add JSON mode support. Closes #881

      abetlen

      committed
      b30b9c3View commit details

      Copy full SHA for b30b9c3

      View code at this pointBrowse repository at this point

    • Add seed parameter support for completion and chat_completion requests. Closes #884

      abetlen

      committed
      86aeb9fView commit details

      Copy full SHA for 86aeb9f

      View code at this pointBrowse repository at this point

    • Multimodal Support (Llava 1.5) (#821)

      Show description for aab74f0
      

      damian0815

      and

      abetlen

      authored
      aab74f0View commit details

      Copy full SHA for aab74f0

      View code at this pointBrowse repository at this point