Commits

Commit history

1. Commits on May 29, 2024

   • fix: fix string value kv_overrides. Closes #1487

     abetlen

     committed
     df45a4bView commit details

     Copy full SHA for df45a4b

     View code at this pointBrowse repository at this point
2. Commits on May 14, 2024

   • feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)

     Show description for 5212fb0
     twaka

     authored
     5212fb0View commit details

     Copy full SHA for 5212fb0

     View code at this pointBrowse repository at this point
3. Commits on May 5, 2024

   • feat(server): Add support for setting root_path. Closes #1420

     abetlen

     committed
     0318702View commit details

     Copy full SHA for 0318702

     View code at this pointBrowse repository at this point
4. Commits on May 3, 2024

   • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

     abetlen

     committed
     f9b7221View commit details

     Copy full SHA for f9b7221

     View code at this pointBrowse repository at this point

   • feat(server): Remove temperature bounds checks for server. Closes #1384

     abetlen

     committed
     0a454beView commit details

     Copy full SHA for 0a454be

     View code at this pointBrowse repository at this point

   • fix(server): Propagate `flash_attn` to model load. (#1424)

     dthuerck

     authored
     2138561View commit details

     Copy full SHA for 2138561

     View code at this pointBrowse repository at this point
5. Commits on May 2, 2024

   • feat: Add llama-3-vision-alpha chat format

     abetlen

     committed
     31b1d95View commit details

     Copy full SHA for 31b1d95

     View code at this pointBrowse repository at this point
6. Commits on Apr 30, 2024

   • feat: Add option to enable `flash_attn` to Lllama params and ModelSettings

     abetlen

     committed
     22d77eeView commit details

     Copy full SHA for 22d77ee

     View code at this pointBrowse repository at this point

   • feat: Generic Chat Formats, Tool Calling, and Huggingface Pull Support for Multimodal Models (Obsidian, LLaVA1.6, Moondream) (#1147)

     Show description for fe2da09
     abetlen

     authored
     fe2da09View commit details

     Copy full SHA for fe2da09

     View code at this pointBrowse repository at this point
7. Commits on Apr 26, 2024

   • fix: pydantic deprecation warning

     abetlen

     committed
     fcfea66View commit details

     Copy full SHA for fcfea66

     View code at this pointBrowse repository at this point
8. Commits on Apr 23, 2024

   • feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)

     sean-bailey

     authored
     53ebcc8View commit details

     Copy full SHA for 53ebcc8

     View code at this pointBrowse repository at this point
9. Commits on Apr 17, 2024

   • feat: add `disable_ping_events` flag (#1257)

     Show description for b73c73c
     khimaros

     authored
     b73c73cView commit details

     Copy full SHA for b73c73c

     View code at this pointBrowse repository at this point

   • feat: Use all available CPUs for batch processing (#1345)

     

     ddh0

     authored and

     abetlen

     committed
     c96b2daView commit details

     Copy full SHA for c96b2da

     View code at this pointBrowse repository at this point
10. Commits on Apr 10, 2024

    • feat: Add support for yaml based configs

      abetlen

      committed
      060bfa6View commit details

      Copy full SHA for 060bfa6

      View code at this pointBrowse repository at this point
11. Commits on Apr 1, 2024

    • feat: add support for KV cache quantization options (#1307)

      Show description for f165048
      

      Limour-dev

      and

      abetlen

      authored
      f165048View commit details

      Copy full SHA for f165048

      View code at this pointBrowse repository at this point
12. Commits on Mar 31, 2024

    • feat: Add logprobs support to chat completions (#1311)

      Show description for aa9f1ae
      

      windspirit95

      and

      abetlen

      authored
      aa9f1aeView commit details

      Copy full SHA for aa9f1ae

      View code at this pointBrowse repository at this point
13. Commits on Mar 23, 2024

    • fix(server): minor type fixes

      abetlen

      committed
      d11ccc3View commit details

      Copy full SHA for d11ccc3

      View code at this pointBrowse repository at this point
14. Commits on Mar 19, 2024

    • docs: Add chat examples to openapi ui

      abetlen

      committed
      f7decc9View commit details

      Copy full SHA for f7decc9

      View code at this pointBrowse repository at this point
15. Commits on Mar 9, 2024

    • feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

      Show description for c139f8b
      

      felipelo

      and

      abetlen

      authored
      c139f8bView commit details

      Copy full SHA for c139f8b

      View code at this pointBrowse repository at this point
16. Commits on Feb 28, 2024

    • misc: Format

      abetlen

      committed
      727d60cView commit details

      Copy full SHA for 727d60c

      View code at this pointBrowse repository at this point

    • feat: Update llama.cpp

      abetlen

      committed
      0d37ce5View commit details

      Copy full SHA for 0d37ce5

      View code at this pointBrowse repository at this point
17. Commits on Feb 26, 2024

    • feat(server): Add support for pulling models from Huggingface Hub (#1222)

      Show description for 4d574bd
      abetlen

      authored
      4d574bdView commit details

      Copy full SHA for 4d574bd

      View code at this pointBrowse repository at this point

    • fix: remove prematurely commited change

      abetlen

      committed
      dcf38f6View commit details

      Copy full SHA for dcf38f6

      View code at this pointBrowse repository at this point
18. Commits on Feb 25, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      2292af5View commit details

      Copy full SHA for 2292af5

      View code at this pointBrowse repository at this point
19. Commits on Feb 17, 2024

    • feat: Update llama.cpp

      abetlen

      committed
      fdce078View commit details

      Copy full SHA for fdce078

      View code at this pointBrowse repository at this point
20. Commits on Feb 15, 2024

    • fix: Use '\n' seperator for EventSourceResponse (#1188)

      Show description for ea1f88d
      

      khimaros

      and

      abetlen

      authored
      ea1f88dView commit details

      Copy full SHA for ea1f88d

      View code at this pointBrowse repository at this point
21. Commits on Feb 8, 2024

    • fix: broken import

      abetlen

      committed
      85d3374View commit details

      Copy full SHA for 85d3374

      View code at this pointBrowse repository at this point

    • feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)

      Show description for 9018270
      

      jeffrey-fong

      and

      abetlen

      authored
      9018270View commit details

      Copy full SHA for 9018270

      View code at this pointBrowse repository at this point
22. Commits on Jan 31, 2024

    • Add speculative decoding (#1120)

      Show description for fb762a6
      abetlen

      authored
      fb762a6View commit details

      Copy full SHA for fb762a6

      View code at this pointBrowse repository at this point
23. Commits on Jan 29, 2024

    • Automatically set chat format from gguf (#1110)

      Show description for da003d8
      abetlen

      authored
      da003d8View commit details

      Copy full SHA for da003d8

      View code at this pointBrowse repository at this point
24. Commits on Jan 25, 2024

    • feat(server): include llama-cpp-python version in openapi spec

      abetlen

      committed
      cde7514View commit details

      Copy full SHA for cde7514

      View code at this pointBrowse repository at this point
25. Commits on Jan 21, 2024

    • fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

      abetlen

      committed
      24f3945View commit details

      Copy full SHA for 24f3945

      View code at this pointBrowse repository at this point
26. Commits on Jan 19, 2024

    • Fix python3.8 support

      abetlen

      committed
      141293aView commit details

      Copy full SHA for 141293a

      View code at this pointBrowse repository at this point

    • feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

      abetlen

      committed
      b8fc1c7View commit details

      Copy full SHA for b8fc1c7

      View code at this pointBrowse repository at this point
27. Commits on Jan 18, 2024

    • Offload KQV by default

      abetlen

      committed
      48c3b77View commit details

      Copy full SHA for 48c3b77

      View code at this pointBrowse repository at this point