Commits

Breadcrumbs

History for

onparallel_tool_choice

User selector

All users

All time

Commit History

Commits on Jul 9, 2024

• fix(misc): Format

  abetlen

  committed
  c1ae815

  Copy full SHA for c1ae815

Commits on Apr 10, 2024

• feat: Add support for yaml based configs

  abetlen

  committed
  060bfa6

  Copy full SHA for 060bfa6

Commits on Dec 22, 2023

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2f

  Copy full SHA for 12b7f2f

Commits on Dec 12, 2023

• Add support for running the server with SSL (#994)

  rgerganov

  authored
  8e44a32

  Copy full SHA for 8e44a32

Commits on Sep 15, 2023

• Remove confusing helpstring from server cli args. Closes #719

  abetlen

  committed
  b047b30

  Copy full SHA for b047b30

Commits on Sep 14, 2023

• Fix boolean env vars and cli arguments

  abetlen

  committed
  0449d29

  Copy full SHA for 0449d29

• Fix boolean cli flags

  abetlen

  committed
  c999325

  Copy full SHA for c999325

• Fix tensor_split cli option

  abetlen

  committed
  c4c440b

  Copy full SHA for c4c440b

Commits on Sep 13, 2023

• Fix issue with Literal and Optional cli arguments not working. Closes #702

  abetlen

  committed
  759405c

  Copy full SHA for 759405c

Commits on Jul 9, 2023

• bugfix: pydantic settings missing / changed fields

  abetlen

  committed
  6f70cc4

  Copy full SHA for 6f70cc4

Commits on Jul 8, 2023

• Upgrade fastapi to 0.100.0 and pydantic v2

  abetlen

  committed
  52753b7

  Copy full SHA for 52753b7

Commits on Jun 11, 2023

• correction to add back environment variable support <3 docker

  Orfeous

  committed
  3129a0e

  Copy full SHA for 3129a0e

Commits on Jun 10, 2023

• fixes abetlen/llama-cpp-python #358

  Orfeous

  committed
  3ea3193

  Copy full SHA for 3ea3193

Commits on May 8, 2023

• Bugfix: not falling back to environment variables when default is value is set.

  abetlen

  committed
  29f094b

  Copy full SHA for 29f094b

• Show default value when --help is called

  abetlen

  committed
  0d6c600

  Copy full SHA for 0d6c600

• Use environment variable if parsed cli arg is None

  abetlen

  committed
  022e9eb

  Copy full SHA for 022e9eb

Commits on May 5, 2023

• Add cli options to server. Closes #37

  abetlen

  committed
  24fc387

  Copy full SHA for 24fc387

Commits on May 2, 2023

• Refactor server to use factory

  abetlen

  committed
  9eafc4c

  Copy full SHA for 9eafc4c

Commits on Apr 29, 2023

• llama_cpp server: slight refactor to init_llama function

  Show description for efe8e6f
  Stonelinks

  committed
  efe8e6f

  Copy full SHA for efe8e6f

• llama_cpp server: app is now importable, still runnable as a module

  Stonelinks

  committed
  468377b

  Copy full SHA for 468377b

Commits on Apr 25, 2023

• Update n_batch for server

  abetlen

  committed
  3cab3ef

  Copy full SHA for 3cab3ef

Commits on Apr 19, 2023

• Add use_mmap flag to server

  abetlen

  committed
  e4647c7

  Copy full SHA for e4647c7

Commits on Apr 15, 2023

• Add experimental cache

  abetlen

  committed
  92c0771

  Copy full SHA for 92c0771

Commits on Apr 14, 2023

• Fix completion request

  abetlen

  committed
  6c7cec0

  Copy full SHA for 6c7cec0

Commits on Apr 13, 2023

• Formatting

  abetlen

  committed
  4f5f99e

  Copy full SHA for 4f5f99e

Commits on Apr 12, 2023

• Enable logprobs on completion endpoint

  abetlen

  committed
  0daf16d

  Copy full SHA for 0daf16d

• Fix threading bug. Closes #62

  abetlen

  committed
  19598ac

  Copy full SHA for 19598ac

• Implement logprobs parameter for text completion. Closes #2

  abetlen

  committed
  b3805bb

  Copy full SHA for b3805bb

Commits on Apr 11, 2023

• Remove async from function signature to avoid blocking the server

  abetlen

  committed
  213cc5c

  Copy full SHA for 213cc5c

Commits on Apr 8, 2023

• Formatting

  abetlen

  committed
  0067c1a

  Copy full SHA for 0067c1a

Commits on Apr 7, 2023

• Safer calculation of default n_threads

  abetlen

  committed
  da539cc

  Copy full SHA for da539cc

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

  abetlen

  committed
  930db37

  Copy full SHA for 930db37

• Handle prompt list

  abetlen

  committed
  55279b6

  Copy full SHA for 55279b6

Commits on Apr 5, 2023

• Set n_batch to default values and reduce thread count:

  Show description for c283edd
  MillionthOdin16

  committed
  c283edd

  Copy full SHA for c283edd

• Set n_batch to the default value of 8. I think this is leftover from when n_ctx was missing and n_batch was 2048.

  MillionthOdin16

  committed
  76a82ba

  Copy full SHA for 76a82ba