Commits

Commit history

1. Commits on Jul 25, 2023

   • Change tensor_split from array to pointer

     

     Shouyi Wang

     committed
     426dbfeView commit details

     Copy full SHA for 426dbfe

     View code at this pointBrowse repository at this point
2. Commits on Jul 24, 2023

   • Add temporary rms_norm_eps parameter

     abetlen

     committed
     11dd2bfView commit details

     Copy full SHA for 11dd2bf

     View code at this pointBrowse repository at this point

   • Add rms_eps_norm

     abetlen

     committed
     8cd64d4View commit details

     Copy full SHA for 8cd64d4

     View code at this pointBrowse repository at this point

   • add support for llama2 70b

     

     bretello

     committed
     0f09f10View commit details

     Copy full SHA for 0f09f10

     View code at this pointBrowse repository at this point

   • Revert "Merge pull request #521 from bretello/main"

     Show description for 401309d
     abetlen

     committed
     401309dView commit details

     Copy full SHA for 401309d

     View code at this pointBrowse repository at this point

   • Merge pull request #521 from bretello/main

     Show description for 07f0f3a
     abetlen

     authored
     07f0f3aView commit details

     Copy full SHA for 07f0f3a

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     d8a3ddbView commit details

     Copy full SHA for d8a3ddb

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     985d559View commit details

     Copy full SHA for 985d559

     View code at this pointBrowse repository at this point

   • raise exception when `llama_load_model_from_file` fails

     

     bretello

     committed
     8be7d67View commit details

     Copy full SHA for 8be7d67

     View code at this pointBrowse repository at this point
3. Commits on Jul 21, 2023

   • Update llama.cpp

     abetlen

     committed
     b83728aView commit details

     Copy full SHA for b83728a

     View code at this pointBrowse repository at this point
4. Commits on Jul 20, 2023

   • Update llama.cpp

     abetlen

     committed
     01435daView commit details

     Copy full SHA for 01435da

     View code at this pointBrowse repository at this point

   • Fix compatibility with older python versions

     abetlen

     committed
     28a1117View commit details

     Copy full SHA for 28a1117

     View code at this pointBrowse repository at this point

   • Revert ctypes argtype change

     abetlen

     committed
     d10ce62View commit details

     Copy full SHA for d10ce62

     View code at this pointBrowse repository at this point

   • Merge pull request #481 from c0sogi/main

     Show description for 365d9a4
     abetlen

     authored
     365d9a4View commit details

     Copy full SHA for 365d9a4

     View code at this pointBrowse repository at this point

   • Update llama_cpp.py - Fix c_char_p to Array[c_char_p] and c_float to Array[c_float]

     viniciusarruda

     authored
     a855147View commit details

     Copy full SHA for a855147

     View code at this pointBrowse repository at this point

   • Now the last token sent when `stream=True`

     ctejada85

     committed
     0756a2dView commit details

     Copy full SHA for 0756a2d

     View code at this pointBrowse repository at this point
5. Commits on Jul 18, 2023

   • expose RoPE param to server start

     

     shutup

     committed
     5ed8bf1View commit details

     Copy full SHA for 5ed8bf1

     View code at this pointBrowse repository at this point
6. Commits on Jul 16, 2023

   • Added `RouteErrorHandler` for server

     c0sogi

     committed
     1551ba1View commit details

     Copy full SHA for 1551ba1

     View code at this pointBrowse repository at this point
7. Commits on Jul 15, 2023

   • Re-order Llama class params

     abetlen

     committed
     8ab098eView commit details

     Copy full SHA for 8ab098e

     View code at this pointBrowse repository at this point

   • Fix context_params struct layout

     abetlen

     committed
     e4f9db3View commit details

     Copy full SHA for e4f9db3

     View code at this pointBrowse repository at this point

   • Merge branch main into custom_rope

     abetlen

     committed
     f0797a6View commit details

     Copy full SHA for f0797a6

     View code at this pointBrowse repository at this point
8. Commits on Jul 10, 2023

   • Add bindings for custom_rope

     randoentity

     committed
     3f8f276View commit details

     Copy full SHA for 3f8f276

     View code at this pointBrowse repository at this point
9. Commits on Jul 9, 2023

   • bugfix: truncate completion max_tokens to fit context length by default

     abetlen

     committed
     a86bfdfView commit details

     Copy full SHA for a86bfdf

     View code at this pointBrowse repository at this point

   • bugfix: pydantic settings missing / changed fields

     abetlen

     committed
     6f70cc4View commit details

     Copy full SHA for 6f70cc4

     View code at this pointBrowse repository at this point
10. Commits on Jul 8, 2023

    • Merge branch 'main' into add_unlimited_max_tokens

      abetlen

      authored
      5d756deView commit details

      Copy full SHA for 5d756de

      View code at this pointBrowse repository at this point

    • Merge pull request #453 from wu-qing-157/main

      Show description for b8e0bed
      abetlen

      authored
      b8e0bedView commit details

      Copy full SHA for b8e0bed

      View code at this pointBrowse repository at this point

    • bugfix: fix compatibility bug with openai api on last token

      abetlen

      committed
      d6e6aadView commit details

      Copy full SHA for d6e6aad

      View code at this pointBrowse repository at this point

    • Format

      abetlen

      committed
      4f2b5d0View commit details

      Copy full SHA for 4f2b5d0

      View code at this pointBrowse repository at this point

    • perf: convert pointer to byref

      abetlen

      committed
      34c505eView commit details

      Copy full SHA for 34c505e

      View code at this pointBrowse repository at this point

    • Upgrade fastapi to 0.100.0 and pydantic v2

      abetlen

      committed
      52753b7View commit details

      Copy full SHA for 52753b7

      View code at this pointBrowse repository at this point
11. Commits on Jul 7, 2023

    • perf: avoid allocating new buffers during sampling

      abetlen

      committed
      11eae75View commit details

      Copy full SHA for 11eae75

      View code at this pointBrowse repository at this point

    • perf: assign to candidates data structure instead

      abetlen

      committed
      a14d8a9View commit details

      Copy full SHA for a14d8a9

      View code at this pointBrowse repository at this point

    • fix indexing token_logprobs after sorting

      wu-qing-157

      committed
      9e61661View commit details

      Copy full SHA for 9e61661

      View code at this pointBrowse repository at this point

    • Add setting to control request interruption

      abetlen

      committed
      57d8ec3View commit details

      Copy full SHA for 57d8ec3

      View code at this pointBrowse repository at this point

    • Add interruptible streaming requests for llama-cpp-python server. Closes #183

      abetlen

      committed
      4c7cdccView commit details

      Copy full SHA for 4c7cdcc

      View code at this pointBrowse repository at this point