Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on May 8, 2023

• Bugfix: not falling back to environment variables when default is value is set.

  abetlen

  committed
  29f094b

  Copy full SHA for 29f094b

• Show default value when --help is called

  abetlen

  committed
  0d6c600

  Copy full SHA for 0d6c600

• Use environment variable if parsed cli arg is None

  abetlen

  committed
  022e9eb

  Copy full SHA for 022e9eb

Commits on May 5, 2023

• Add cli options to server. Closes #37

  abetlen

  committed
  24fc387

  Copy full SHA for 24fc387

Commits on May 2, 2023

• Refactor server to use factory

  abetlen

  committed
  9eafc4c

  Copy full SHA for 9eafc4c

Commits on Apr 29, 2023

• llama_cpp server: slight refactor to init_llama function

  Show description for efe8e6f
  Stonelinks

  committed
  efe8e6f

  Copy full SHA for efe8e6f

• llama_cpp server: app is now importable, still runnable as a module

  Stonelinks

  committed
  468377b

  Copy full SHA for 468377b

Commits on Apr 25, 2023

• Update n_batch for server

  abetlen

  committed
  3cab3ef

  Copy full SHA for 3cab3ef

Commits on Apr 19, 2023

• Add use_mmap flag to server

  abetlen

  committed
  e4647c7

  Copy full SHA for e4647c7

Commits on Apr 15, 2023

• Add experimental cache

  abetlen

  committed
  92c0771

  Copy full SHA for 92c0771

Commits on Apr 14, 2023

• Fix completion request

  abetlen

  committed
  6c7cec0

  Copy full SHA for 6c7cec0

Commits on Apr 13, 2023

• Formatting

  abetlen

  committed
  4f5f99e

  Copy full SHA for 4f5f99e

Commits on Apr 12, 2023

• Enable logprobs on completion endpoint

  abetlen

  committed
  0daf16d

  Copy full SHA for 0daf16d

• Fix threading bug. Closes #62

  abetlen

  committed
  19598ac

  Copy full SHA for 19598ac

• Implement logprobs parameter for text completion. Closes #2

  abetlen

  committed
  b3805bb

  Copy full SHA for b3805bb

Commits on Apr 11, 2023

• Remove async from function signature to avoid blocking the server

  abetlen

  committed
  213cc5c

  Copy full SHA for 213cc5c

Commits on Apr 8, 2023

• Formatting

  abetlen

  committed
  0067c1a

  Copy full SHA for 0067c1a

Commits on Apr 7, 2023

• Safer calculation of default n_threads

  abetlen

  committed
  da539cc

  Copy full SHA for da539cc

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

  abetlen

  committed
  930db37

  Copy full SHA for 930db37

• Handle prompt list

  abetlen

  committed
  55279b6

  Copy full SHA for 55279b6

Commits on Apr 5, 2023

• Set n_batch to default values and reduce thread count:

  Show description for c283edd
  MillionthOdin16

  committed
  c283edd

  Copy full SHA for c283edd

• Set n_batch to the default value of 8. I think this is leftover from when n_ctx was missing and n_batch was 2048.

  MillionthOdin16

  committed
  76a82ba

  Copy full SHA for 76a82ba

• Add server as a subpackage

  abetlen

  committed
  44448fb

  Copy full SHA for 44448fb

Loading