Commits

Commit history

1. Commits on Feb 17, 2024

   • feat: Update llama.cpp

     abetlen

     committed
     fdce078View commit details

     Copy full SHA for fdce078

     View code at this pointBrowse repository at this point
2. Commits on Jan 31, 2024

   • Add speculative decoding (#1120)

     Show description for fb762a6
     abetlen

     authored
     fb762a6View commit details

     Copy full SHA for fb762a6

     View code at this pointBrowse repository at this point
3. Commits on Jan 29, 2024

   • Automatically set chat format from gguf (#1110)

     Show description for da003d8
     abetlen

     authored
     da003d8View commit details

     Copy full SHA for da003d8

     View code at this pointBrowse repository at this point
4. Commits on Jan 19, 2024

   • feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

     abetlen

     committed
     b8fc1c7View commit details

     Copy full SHA for b8fc1c7

     View code at this pointBrowse repository at this point
5. Commits on Jan 18, 2024

   • Offload KQV by default

     abetlen

     committed
     48c3b77View commit details

     Copy full SHA for 48c3b77

     View code at this pointBrowse repository at this point
6. Commits on Jan 16, 2024

   • fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)

     K-Mistele

     authored
     9c36688View commit details

     Copy full SHA for 9c36688

     View code at this pointBrowse repository at this point
7. Commits on Jan 15, 2024

   • Add split_mode option. Closes #1085

     abetlen

     committed
     84615adView commit details

     Copy full SHA for 84615ad

     View code at this pointBrowse repository at this point

   • Implement GGUF metadata KV overrides (#1011)

     Show description for 76aafa6
     

     phiharri

     and

     abetlen

     authored
     76aafa6View commit details

     Copy full SHA for 76aafa6

     View code at this pointBrowse repository at this point
8. Commits on Dec 22, 2023

   • docs: add server config docs

     abetlen

     committed
     522aecbView commit details

     Copy full SHA for 522aecb

     View code at this pointBrowse repository at this point

   • [Feat] Multi model support (#931)

     Show description for 12b7f2f
     

     D4ve-R

     and

     abetlen

     authored
     12b7f2fView commit details

     Copy full SHA for 12b7f2f

     View code at this pointBrowse repository at this point
9. Loading