Commits

Commit history

1. Commits on Dec 22, 2023

   • [Feat] Multi model support (#931)

     Show description for 12b7f2f
     

     D4ve-R

     and

     abetlen

     authored
     12b7f2fView commit details

     Copy full SHA for 12b7f2f

     View code at this pointBrowse repository at this point
2. Commits on Dec 12, 2023

   • Add support for running the server with SSL (#994)

     rgerganov

     authored
     8e44a32View commit details

     Copy full SHA for 8e44a32

     View code at this pointBrowse repository at this point
3. Commits on Sep 15, 2023

   • Remove confusing helpstring from server cli args. Closes #719

     abetlen

     committed
     b047b30View commit details

     Copy full SHA for b047b30

     View code at this pointBrowse repository at this point
4. Commits on Sep 14, 2023

   • Fix boolean env vars and cli arguments

     abetlen

     committed
     0449d29View commit details

     Copy full SHA for 0449d29

     View code at this pointBrowse repository at this point

   • Fix boolean cli flags

     abetlen

     committed
     c999325View commit details

     Copy full SHA for c999325

     View code at this pointBrowse repository at this point

   • Fix tensor_split cli option

     abetlen

     committed
     c4c440bView commit details

     Copy full SHA for c4c440b

     View code at this pointBrowse repository at this point
5. Commits on Sep 13, 2023

   • Fix issue with Literal and Optional cli arguments not working. Closes #702

     abetlen

     committed
     759405cView commit details

     Copy full SHA for 759405c

     View code at this pointBrowse repository at this point
6. Commits on Jul 9, 2023

   • bugfix: pydantic settings missing / changed fields

     abetlen

     committed
     6f70cc4View commit details

     Copy full SHA for 6f70cc4

     View code at this pointBrowse repository at this point
7. Commits on Jul 8, 2023

   • Upgrade fastapi to 0.100.0 and pydantic v2

     abetlen

     committed
     52753b7View commit details

     Copy full SHA for 52753b7

     View code at this pointBrowse repository at this point
8. Commits on Jun 11, 2023

   • correction to add back environment variable support <3 docker

     Orfeous

     committed
     3129a0eView commit details

     Copy full SHA for 3129a0e

     View code at this pointBrowse repository at this point
9. Commits on Jun 10, 2023

   • fixes abetlen/llama-cpp-python #358

     Orfeous

     committed
     3ea3193View commit details

     Copy full SHA for 3ea3193

     View code at this pointBrowse repository at this point
10. Commits on May 8, 2023

    • Bugfix: not falling back to environment variables when default is value is set.

      abetlen

      committed
      29f094bView commit details

      Copy full SHA for 29f094b

      View code at this pointBrowse repository at this point

    • Show default value when --help is called

      abetlen

      committed
      0d6c600View commit details

      Copy full SHA for 0d6c600

      View code at this pointBrowse repository at this point

    • Use environment variable if parsed cli arg is None

      abetlen

      committed
      022e9ebView commit details

      Copy full SHA for 022e9eb

      View code at this pointBrowse repository at this point
11. Commits on May 5, 2023

    • Add cli options to server. Closes #37

      abetlen

      committed
      24fc387View commit details

      Copy full SHA for 24fc387

      View code at this pointBrowse repository at this point
12. Commits on May 2, 2023

    • Refactor server to use factory

      abetlen

      committed
      9eafc4cView commit details

      Copy full SHA for 9eafc4c

      View code at this pointBrowse repository at this point
13. Commits on Apr 29, 2023

    • llama_cpp server: slight refactor to init_llama function

      Show description for efe8e6f
      Stonelinks

      committed
      efe8e6fView commit details

      Copy full SHA for efe8e6f

      View code at this pointBrowse repository at this point

    • llama_cpp server: app is now importable, still runnable as a module

      Stonelinks

      committed
      468377bView commit details

      Copy full SHA for 468377b

      View code at this pointBrowse repository at this point
14. Commits on Apr 25, 2023

    • Update n_batch for server

      abetlen

      committed
      3cab3efView commit details

      Copy full SHA for 3cab3ef

      View code at this pointBrowse repository at this point
15. Commits on Apr 19, 2023

    • Add use_mmap flag to server

      abetlen

      committed
      e4647c7View commit details

      Copy full SHA for e4647c7

      View code at this pointBrowse repository at this point
16. Commits on Apr 15, 2023

    • Add experimental cache

      abetlen

      committed
      92c0771View commit details

      Copy full SHA for 92c0771

      View code at this pointBrowse repository at this point
17. Commits on Apr 14, 2023

    • Fix completion request

      abetlen

      committed
      6c7cec0View commit details

      Copy full SHA for 6c7cec0

      View code at this pointBrowse repository at this point
18. Commits on Apr 13, 2023

    • Formatting

      abetlen

      committed
      4f5f99eView commit details

      Copy full SHA for 4f5f99e

      View code at this pointBrowse repository at this point
19. Commits on Apr 12, 2023

    • Enable logprobs on completion endpoint

      abetlen

      committed
      0daf16dView commit details

      Copy full SHA for 0daf16d

      View code at this pointBrowse repository at this point

    • Fix threading bug. Closes #62

      abetlen

      committed
      19598acView commit details

      Copy full SHA for 19598ac

      View code at this pointBrowse repository at this point

    • Implement logprobs parameter for text completion. Closes #2

      abetlen

      committed
      b3805bbView commit details

      Copy full SHA for b3805bb

      View code at this pointBrowse repository at this point
20. Commits on Apr 11, 2023

    • Remove async from function signature to avoid blocking the server

      abetlen

      committed
      213cc5cView commit details

      Copy full SHA for 213cc5c

      View code at this pointBrowse repository at this point
21. Commits on Apr 8, 2023

    • Formatting

      abetlen

      committed
      0067c1aView commit details

      Copy full SHA for 0067c1a

      View code at this pointBrowse repository at this point
22. Commits on Apr 7, 2023

    • Safer calculation of default n_threads

      abetlen

      committed
      da539ccView commit details

      Copy full SHA for da539cc

      View code at this pointBrowse repository at this point

    • Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

      abetlen

      committed
      930db37View commit details

      Copy full SHA for 930db37

      View code at this pointBrowse repository at this point

    • Handle prompt list

      abetlen

      committed
      55279b6View commit details

      Copy full SHA for 55279b6

      View code at this pointBrowse repository at this point
23. Commits on Apr 5, 2023

    • Set n_batch to default values and reduce thread count:

      Show description for c283edd
      MillionthOdin16

      committed
      c283eddView commit details

      Copy full SHA for c283edd

      View code at this pointBrowse repository at this point

    • Set n_batch to the default value of 8. I think this is leftover from when n_ctx was missing and n_batch was 2048.

      MillionthOdin16

      committed
      76a82baView commit details

      Copy full SHA for 76a82ba

      View code at this pointBrowse repository at this point

    • Add server as a subpackage

      abetlen

      committed
      44448fbView commit details

      Copy full SHA for 44448fb

      View code at this pointBrowse repository at this point
24. Loading