Commits

Commit history

1. Commits on Apr 1, 2024

   • feat: add support for KV cache quantization options (#1307)

     Show description for f165048
     

     Limour-dev

     and

     abetlen

     authored
     f165048View commit details

     Copy full SHA for f165048

     View code at this pointBrowse repository at this point
2. Commits on Feb 28, 2024

   • misc: Format

     abetlen

     committed
     727d60cView commit details

     Copy full SHA for 727d60c

     View code at this pointBrowse repository at this point
3. Commits on Feb 26, 2024

   • feat(server): Add support for pulling models from Huggingface Hub (#1222)

     Show description for 4d574bd
     abetlen

     authored
     4d574bdView commit details

     Copy full SHA for 4d574bd

     View code at this pointBrowse repository at this point
4. Commits on Feb 8, 2024

   • fix: broken import

     abetlen

     committed
     85d3374View commit details

     Copy full SHA for 85d3374

     View code at this pointBrowse repository at this point

   • feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)

     Show description for 9018270
     

     jeffrey-fong

     and

     abetlen

     authored
     9018270View commit details

     Copy full SHA for 9018270

     View code at this pointBrowse repository at this point
5. Commits on Jan 31, 2024

   • Add speculative decoding (#1120)

     Show description for fb762a6
     abetlen

     authored
     fb762a6View commit details

     Copy full SHA for fb762a6

     View code at this pointBrowse repository at this point
6. Commits on Jan 21, 2024

   • fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

     abetlen

     committed
     24f3945View commit details

     Copy full SHA for 24f3945

     View code at this pointBrowse repository at this point
7. Commits on Jan 19, 2024

   • feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

     abetlen

     committed
     b8fc1c7View commit details

     Copy full SHA for b8fc1c7

     View code at this pointBrowse repository at this point
8. Commits on Jan 15, 2024

   • Implement GGUF metadata KV overrides (#1011)

     Show description for 76aafa6
     

     phiharri

     and

     abetlen

     authored
     76aafa6View commit details

     Copy full SHA for 76aafa6

     View code at this pointBrowse repository at this point
9. Commits on Dec 22, 2023

   • [Feat] Multi model support (#931)

     Show description for 12b7f2f
     

     D4ve-R

     and

     abetlen

     authored
     12b7f2fView commit details

     Copy full SHA for 12b7f2f

     View code at this pointBrowse repository at this point
10. Loading