Commits

Commit history

1. Commits on Aug 8, 2023

   • Move grammar to function call argument

     abetlen

     committed
     66fb034View commit details

     Copy full SHA for 66fb034

     View code at this pointBrowse repository at this point

   • fix

     abetlen

     committed
     1e844d3View commit details

     Copy full SHA for 1e844d3

     View code at this pointBrowse repository at this point

   • Merge branch 'main' into c0sogi/main

     abetlen

     committed
     843b7ccView commit details

     Copy full SHA for 843b7cc

     View code at this pointBrowse repository at this point

   • Add mul_mat_q option

     abetlen

     committed
     d015bdbView commit details

     Copy full SHA for d015bdb

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     f6a7850View commit details

     Copy full SHA for f6a7850

     View code at this pointBrowse repository at this point
2. Commits on Aug 7, 2023

   • prevent memory access error by llama_grammar_free

     

     c0sogi

     committed
     0d7d203View commit details

     Copy full SHA for 0d7d203

     View code at this pointBrowse repository at this point

   • reset grammar for every generation

     

     c0sogi

     committed
     b07713cView commit details

     Copy full SHA for b07713c

     View code at this pointBrowse repository at this point
3. Commits on Aug 6, 2023

   • Added grammar based sampling

     c0sogi

     committed
     418aa83View commit details

     Copy full SHA for 418aa83

     View code at this pointBrowse repository at this point
4. Commits on Aug 5, 2023

   • Added low level grammar API

     c0sogi

     committed
     ac188a2View commit details

     Copy full SHA for ac188a2

     View code at this pointBrowse repository at this point
5. Commits on Jul 28, 2023

   • Suppress llama.cpp output when loading model.

     abetlen

     committed
     ce57920View commit details

     Copy full SHA for ce57920

     View code at this pointBrowse repository at this point

   • Format

     abetlen

     committed
     a9b9f03View commit details

     Copy full SHA for a9b9f03

     View code at this pointBrowse repository at this point

   • fix: annoying bug where attribute exceptions were droining out file not found exceptions

     abetlen

     committed
     abc538fView commit details

     Copy full SHA for abc538f

     View code at this pointBrowse repository at this point
6. Commits on Jul 25, 2023

   • Change tensor_split from array to pointer

     

     Shouyi Wang

     committed
     426dbfeView commit details

     Copy full SHA for 426dbfe

     View code at this pointBrowse repository at this point
7. Commits on Jul 24, 2023

   • Add temporary rms_norm_eps parameter

     abetlen

     committed
     11dd2bfView commit details

     Copy full SHA for 11dd2bf

     View code at this pointBrowse repository at this point

   • Add rms_eps_norm

     abetlen

     committed
     8cd64d4View commit details

     Copy full SHA for 8cd64d4

     View code at this pointBrowse repository at this point

   • add support for llama2 70b

     

     bretello

     committed
     0f09f10View commit details

     Copy full SHA for 0f09f10

     View code at this pointBrowse repository at this point

   • Revert "Merge pull request #521 from bretello/main"

     Show description for 401309d
     abetlen

     committed
     401309dView commit details

     Copy full SHA for 401309d

     View code at this pointBrowse repository at this point

   • Merge pull request #521 from bretello/main

     Show description for 07f0f3a
     abetlen

     authored
     07f0f3aView commit details

     Copy full SHA for 07f0f3a

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     d8a3ddbView commit details

     Copy full SHA for d8a3ddb

     View code at this pointBrowse repository at this point

   • Update llama.cpp

     abetlen

     committed
     985d559View commit details

     Copy full SHA for 985d559

     View code at this pointBrowse repository at this point

   • raise exception when `llama_load_model_from_file` fails

     

     bretello

     committed
     8be7d67View commit details

     Copy full SHA for 8be7d67

     View code at this pointBrowse repository at this point
8. Commits on Jul 21, 2023

   • Update llama.cpp

     abetlen

     committed
     b83728aView commit details

     Copy full SHA for b83728a

     View code at this pointBrowse repository at this point
9. Commits on Jul 20, 2023

   • Update llama.cpp

     abetlen

     committed
     01435daView commit details

     Copy full SHA for 01435da

     View code at this pointBrowse repository at this point

   • Fix compatibility with older python versions

     abetlen

     committed
     28a1117View commit details

     Copy full SHA for 28a1117

     View code at this pointBrowse repository at this point

   • Revert ctypes argtype change

     abetlen

     committed
     d10ce62View commit details

     Copy full SHA for d10ce62

     View code at this pointBrowse repository at this point

   • Merge pull request #481 from c0sogi/main

     Show description for 365d9a4
     abetlen

     authored
     365d9a4View commit details

     Copy full SHA for 365d9a4

     View code at this pointBrowse repository at this point

   • Update llama_cpp.py - Fix c_char_p to Array[c_char_p] and c_float to Array[c_float]

     viniciusarruda

     authored
     a855147View commit details

     Copy full SHA for a855147

     View code at this pointBrowse repository at this point

   • Now the last token sent when `stream=True`

     ctejada85

     committed
     0756a2dView commit details

     Copy full SHA for 0756a2d

     View code at this pointBrowse repository at this point
10. Commits on Jul 18, 2023

    • expose RoPE param to server start

      

      shutup

      committed
      5ed8bf1View commit details

      Copy full SHA for 5ed8bf1

      View code at this pointBrowse repository at this point
11. Commits on Jul 16, 2023

    • Added `RouteErrorHandler` for server

      c0sogi

      committed
      1551ba1View commit details

      Copy full SHA for 1551ba1

      View code at this pointBrowse repository at this point
12. Commits on Jul 15, 2023

    • Re-order Llama class params

      abetlen

      committed
      8ab098eView commit details

      Copy full SHA for 8ab098e

      View code at this pointBrowse repository at this point

    • Fix context_params struct layout

      abetlen

      committed
      e4f9db3View commit details

      Copy full SHA for e4f9db3

      View code at this pointBrowse repository at this point

    • Merge branch main into custom_rope

      abetlen

      committed
      f0797a6View commit details

      Copy full SHA for f0797a6

      View code at this pointBrowse repository at this point
13. Commits on Jul 10, 2023

    • Add bindings for custom_rope

      randoentity

      committed
      3f8f276View commit details

      Copy full SHA for 3f8f276

      View code at this pointBrowse repository at this point
14. Commits on Jul 9, 2023

    • bugfix: truncate completion max_tokens to fit context length by default

      abetlen

      committed
      a86bfdfView commit details

      Copy full SHA for a86bfdf

      View code at this pointBrowse repository at this point