Commits

Commit history

1. Commits on Dec 24, 2023

   • chore: small fix to prevent query params in function name

     pjay-io

     committed
     d9eb959View commit details

     Copy full SHA for d9eb959

     View code at this pointBrowse repository at this point
2. Commits on Dec 23, 2023

   • wip: chatml function calling

     pjay-io

     committed
     c84d5ffView commit details

     Copy full SHA for c84d5ff

     View code at this pointBrowse repository at this point
3. Commits on Dec 22, 2023

   • Add HIP_PATH to dll search directories for windows users.

     abetlen

     committed
     92284f3View commit details

     Copy full SHA for 92284f3

     View code at this pointBrowse repository at this point

   • set llama_max_devices using library function

     abetlen

     committed
     2b0d3f3View commit details

     Copy full SHA for 2b0d3f3

     View code at this pointBrowse repository at this point

   • Fix typo

     abetlen

     committed
     d9a1d90View commit details

     Copy full SHA for d9a1d90

     View code at this pointBrowse repository at this point

   • Bump version

     abetlen

     committed
     37556bfView commit details

     Copy full SHA for 37556bf

     View code at this pointBrowse repository at this point

   • fix: inccorect bindings for kv override. Based on #1011

     abetlen

     committed
     6d8bc09View commit details

     Copy full SHA for 6d8bc09

     View code at this pointBrowse repository at this point

   • docs: add server config docs

     abetlen

     committed
     522aecbView commit details

     Copy full SHA for 522aecb

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     6473796View commit details

     Copy full SHA for 6473796

     View code at this pointBrowse repository at this point

   • server: Support none defaulting to infinity for completions (#111)

     Show description for 4b01a87
     

     swg

     and

     abetlen

     authored
     4b01a87View commit details

     Copy full SHA for 4b01a87

     View code at this pointBrowse repository at this point

   • [Feat] Multi model support (#931)

     Show description for 12b7f2f
     

     D4ve-R

     and

     abetlen

     authored
     12b7f2fView commit details

     Copy full SHA for 12b7f2f

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     4a85442View commit details

     Copy full SHA for 4a85442

     View code at this pointBrowse repository at this point

   • fix text_offset of multi-token characters (#1037)

     Show description for 2f03fb0
     twaka

     authored
     2f03fb0View commit details

     Copy full SHA for 2f03fb0

     View code at this pointBrowse repository at this point
4. Commits on Dec 21, 2023

   • Implement openai api compatible authentication (#1010)

     docmeth02

     authored
     33cc623View commit details

     Copy full SHA for 33cc623

     View code at this pointBrowse repository at this point
5. Commits on Dec 18, 2023

   • fix: float32 is not JSON serializable when streaming logits.

     abetlen

     committed
     a05b4daView commit details

     Copy full SHA for a05b4da

     View code at this pointBrowse repository at this point

   • Fix type annotations

     abetlen

     committed
     7df6c32View commit details

     Copy full SHA for 7df6c32

     View code at this pointBrowse repository at this point

   • Fix type annotation

     abetlen

     committed
     b703aadView commit details

     Copy full SHA for b703aad

     View code at this pointBrowse repository at this point

   • Fix type annotation

     abetlen

     committed
     d0aedfcView commit details

     Copy full SHA for d0aedfc

     View code at this pointBrowse repository at this point

   • Fix ctypes definitions of `llama_kv_cache_view_update` and `llama_kv_cache_view_free`. (#1028)

     e-c-d

     authored
     2993936View commit details

     Copy full SHA for 2993936

     View code at this pointBrowse repository at this point

   • Bump version

     abetlen

     committed
     5e863d8View commit details

     Copy full SHA for 5e863d8

     View code at this pointBrowse repository at this point

   • Add offload_kqv option to llama and server

     abetlen

     committed
     095c650View commit details

     Copy full SHA for 095c650

     View code at this pointBrowse repository at this point

   • Remove unnused import

     abetlen

     committed
     472b344View commit details

     Copy full SHA for 472b344

     View code at this pointBrowse repository at this point

   • perf: Don't convert logprobs arrays to lists (#1021)

     kddubey

     authored
     6b2e0e0View commit details

     Copy full SHA for 6b2e0e0

     View code at this pointBrowse repository at this point

   • Bugfix: Remove f16_kv, add offload_kqv field (#1019)

     Show description for 62944df
     brandonrobertz

     authored
     62944dfView commit details

     Copy full SHA for 62944df

     View code at this pointBrowse repository at this point
6. Commits on Dec 16, 2023

   • Bug fixed with n_ctx=0 (#1015)

     Show description for f1c631d
     DanieleMorotti

     authored
     f1c631dView commit details

     Copy full SHA for f1c631d

     View code at this pointBrowse repository at this point

   • Fix logits_to_logprobs for 2-D and 3-D logits (#1002)

     Show description for 5a89446
     kddubey

     authored
     5a89446View commit details

     Copy full SHA for 5a89446

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     534b1eaView commit details

     Copy full SHA for 534b1ea

     View code at this pointBrowse repository at this point
7. Commits on Dec 14, 2023

   • Bump version

     abetlen

     committed
     cbce061View commit details

     Copy full SHA for cbce061

     View code at this pointBrowse repository at this point

   • Add qwen chat format (#1005)

     yhfgyyf

     authored
     8b4db73View commit details

     Copy full SHA for 8b4db73

     View code at this pointBrowse repository at this point

   • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

     abetlen

     committed
     690c563View commit details

     Copy full SHA for 690c563

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     c0fc0a1View commit details

     Copy full SHA for c0fc0a1

     View code at this pointBrowse repository at this point
8. Commits on Dec 12, 2023

   • Add support for running the server with SSL (#994)

     rgerganov

     authored
     8e44a32View commit details

     Copy full SHA for 8e44a32

     View code at this pointBrowse repository at this point

   • Replace logits_to_logprobs implementation with numpy equivalent to llama.cpp (#991)

     Show description for ef22e47
     player1537

     authored
     ef22e47View commit details

     Copy full SHA for ef22e47

     View code at this pointBrowse repository at this point

   • Fix UnsupportedOperation: fileno in suppress_stdout_stderr (#961)

     Show description for ac35f68
     

     zocainViken

     and

     abetlen

     authored
     ac35f68View commit details

     Copy full SHA for ac35f68

     View code at this pointBrowse repository at this point

   • Add Pygmalion chat format (#986)

     chiensen

     authored
     b938cccView commit details

     Copy full SHA for b938ccc

     View code at this pointBrowse repository at this point