Commits

Commit history

1. Commits on Apr 15, 2023

   • Add experimental cache

     abetlen

     committed
     92c0771View commit details

     Copy full SHA for 92c0771

     View code at this pointBrowse repository at this point
2. Commits on Apr 14, 2023

   • Fix completion request

     abetlen

     committed
     6c7cec0View commit details

     Copy full SHA for 6c7cec0

     View code at this pointBrowse repository at this point
3. Commits on Apr 13, 2023

   • Formatting

     abetlen

     committed
     4f5f99eView commit details

     Copy full SHA for 4f5f99e

     View code at this pointBrowse repository at this point
4. Commits on Apr 12, 2023

   • Enable logprobs on completion endpoint

     abetlen

     committed
     0daf16dView commit details

     Copy full SHA for 0daf16d

     View code at this pointBrowse repository at this point

   • Fix threading bug. Closes #62

     abetlen

     committed
     19598acView commit details

     Copy full SHA for 19598ac

     View code at this pointBrowse repository at this point

   • Implement logprobs parameter for text completion. Closes #2

     abetlen

     committed
     b3805bbView commit details

     Copy full SHA for b3805bb

     View code at this pointBrowse repository at this point
5. Commits on Apr 11, 2023

   • Remove async from function signature to avoid blocking the server

     abetlen

     committed
     213cc5cView commit details

     Copy full SHA for 213cc5c

     View code at this pointBrowse repository at this point
6. Commits on Apr 8, 2023

   • Formatting

     abetlen

     committed
     0067c1aView commit details

     Copy full SHA for 0067c1a

     View code at this pointBrowse repository at this point
7. Commits on Apr 7, 2023

   • Safer calculation of default n_threads

     abetlen

     committed
     da539ccView commit details

     Copy full SHA for da539cc

     View code at this pointBrowse repository at this point

   • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

     abetlen

     committed
     930db37View commit details

     Copy full SHA for 930db37

     View code at this pointBrowse repository at this point

   • Handle prompt list

     abetlen

     committed
     55279b6View commit details

     Copy full SHA for 55279b6

     View code at this pointBrowse repository at this point
8. Commits on Apr 5, 2023

   • Set n_batch to default values and reduce thread count:

     Show description for c283edd
     MillionthOdin16

     committed
     c283eddView commit details

     Copy full SHA for c283edd

     View code at this pointBrowse repository at this point

   • Set n_batch to the default value of 8. I think this is leftover from when n_ctx was missing and n_batch was 2048.

     MillionthOdin16

     committed
     76a82baView commit details

     Copy full SHA for 76a82ba

     View code at this pointBrowse repository at this point

   • Add server as a subpackage

     abetlen

     committed
     44448fbView commit details

     Copy full SHA for 44448fb

     View code at this pointBrowse repository at this point
9. Loading