Commits

Commit history

1. Commits on Sep 14, 2023

   • Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.

     abetlen

     committed
     f4090a0View commit details

     Copy full SHA for f4090a0

     View code at this pointBrowse repository at this point
2. Commits on Sep 7, 2023

   • Fix low level api examples

     

     Juarez Bochi

     committed
     20ac434View commit details

     Copy full SHA for 20ac434

     View code at this pointBrowse repository at this point
3. Commits on May 26, 2023

   • Merge pull request #265 from dmahurin/fix-from-bytes-byteorder

     Show description for 2adf6f3
     abetlen

     authored
     2adf6f3View commit details

     Copy full SHA for 2adf6f3

     View code at this pointBrowse repository at this point

   • Merge pull request #274 from dmahurin/fix-missing-antiprompt

     Show description for 34ad71f
     abetlen

     authored
     34ad71fView commit details

     Copy full SHA for 34ad71f

     View code at this pointBrowse repository at this point

   • low_level_api_chat_cpp.py: Fix missing antiprompt output in chat.

     

     Don Mahurin

     committed
     0fa2ec4View commit details

     Copy full SHA for 0fa2ec4

     View code at this pointBrowse repository at this point
4. Commits on May 23, 2023

   • fix "missing 1 required positional argument: 'min_keep'"

     

     Don Mahurin

     committed
     d6a7adbView commit details

     Copy full SHA for d6a7adb

     View code at this pointBrowse repository at this point

   • fix "from_bytes() missing required argument 'byteorder'"

     

     Don Mahurin

     committed
     327eedbView commit details

     Copy full SHA for 327eedb

     View code at this pointBrowse repository at this point
5. Commits on May 8, 2023

   • Fix lora

     SagsMug

     committed
     eaf9f19View commit details

     Copy full SHA for eaf9f19

     View code at this pointBrowse repository at this point

   • Fix session loading and saving in low level example chat

     SagsMug

     committed
     2c0d9b1View commit details

     Copy full SHA for 2c0d9b1

     View code at this pointBrowse repository at this point
6. Commits on May 6, 2023

   • Fix a bug with wrong type

     SagsMug

     committed
     fd80ddfView commit details

     Copy full SHA for fd80ddf

     View code at this pointBrowse repository at this point

   • Add utf8 to chat example

     SagsMug

     committed
     996f63eView commit details

     Copy full SHA for 996f63e

     View code at this pointBrowse repository at this point

   • Fix mirastat requiring c_float

     SagsMug

     committed
     3ceb47bView commit details

     Copy full SHA for 3ceb47b

     View code at this pointBrowse repository at this point

   • Wrong logit_bias parsed type

     SagsMug

     committed
     9797394View commit details

     Copy full SHA for 9797394

     View code at this pointBrowse repository at this point

   • Rename postfix to suffix to match upstream

     SagsMug

     committed
     1895c11View commit details

     Copy full SHA for 1895c11

     View code at this pointBrowse repository at this point
7. Commits on May 4, 2023

   • Update low level examples

     SagsMug

     committed
     0e9f227View commit details

     Copy full SHA for 0e9f227

     View code at this pointBrowse repository at this point
8. Commits on Apr 28, 2023

   • Detect multi-byte responses and wait

     

     Mug

     committed
     c39547aView commit details

     Copy full SHA for c39547a

     View code at this pointBrowse repository at this point
9. Commits on Apr 26, 2023

   • Also ignore errors on input prompts

     

     Mug

     committed
     5f81400View commit details

     Copy full SHA for 5f81400

     View code at this pointBrowse repository at this point

   • Remove try catch from chat

     

     Mug

     committed
     3c130f0View commit details

     Copy full SHA for 3c130f0

     View code at this pointBrowse repository at this point

   • Fix decode errors permanently

     

     Mug

     committed
     c4a8491View commit details

     Copy full SHA for c4a8491

     View code at this pointBrowse repository at this point
10. Commits on Apr 17, 2023

    • Fixed end of text wrong type, and fix n_predict behaviour

      

      Mug

      committed
      53d17adView commit details

      Copy full SHA for 53d17ad

      View code at this pointBrowse repository at this point
11. Commits on Apr 10, 2023

    • More reasonable defaults

      

      Mug

      committed
      3bb45f1View commit details

      Copy full SHA for 3bb45f1

      View code at this pointBrowse repository at this point

    • Added iterative search to prevent instructions from being echoed, add ignore eos, add no-mmap, fixed 1 character echo too much bug

      

      Mug

      committed
      0cccb41View commit details

      Copy full SHA for 0cccb41

      View code at this pointBrowse repository at this point

    • Update model paths to be more clear they should point to file

      abetlen

      committed
      196650cView commit details

      Copy full SHA for 196650c

      View code at this pointBrowse repository at this point
12. Commits on Apr 7, 2023

    • More interoperability to the original llama.cpp, and arguments now work

      

      Mug

      committed
      16fc5b5View commit details

      Copy full SHA for 16fc5b5

      View code at this pointBrowse repository at this point
13. Commits on Apr 6, 2023

    • Fixed too many newlines, now onto args.

      Show description for 10c7571
      

      Mug

      committed
      10c7571View commit details

      Copy full SHA for 10c7571

      View code at this pointBrowse repository at this point

    • Better llama.cpp interoperability

      Show description for 085cc92
      

      Mug

      committed
      085cc92View commit details

      Copy full SHA for 085cc92

      View code at this pointBrowse repository at this point
14. Commits on Apr 5, 2023

    • Fix bug in init_break not being set when exited via antiprompt and others.

      

      Mug

      committed
      283e59cView commit details

      Copy full SHA for 283e59c

      View code at this pointBrowse repository at this point

    • Move to new examples directory

      

      Mug

      committed
      99ceecfView commit details

      Copy full SHA for 99ceecf

      View code at this pointBrowse repository at this point

    • Add quantize example

      abetlen

      committed
      b1babcfView commit details

      Copy full SHA for b1babcf

      View code at this pointBrowse repository at this point

    • Re-organize examples folder

      abetlen

      committed
      c8e13a7View commit details

      Copy full SHA for c8e13a7

      View code at this pointBrowse repository at this point
15. Loading