Commits

Breadcrumbs

History for

onbinary-wheels

User selector

All users

All time

Commit History

Commits on Apr 1, 2024

• feat: add support for KV cache quantization options (#1307)

  Show description for f165048
  

  Limour-dev

  and

  abetlen

  authored
  f165048

  Copy full SHA for f165048

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60c

  Copy full SHA for 727d60c

Commits on Feb 26, 2024

• feat(server): Add support for pulling models from Huggingface Hub (#1222)

  Show description for 4d574bd
  abetlen

  authored
  4d574bd

  Copy full SHA for 4d574bd

Commits on Feb 8, 2024

• fix: broken import

  abetlen

  committed
  85d3374

  Copy full SHA for 85d3374

• feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)

  Show description for 9018270
  

  jeffrey-fong

  and

  abetlen

  authored
  9018270

  Copy full SHA for 9018270

Commits on Jan 31, 2024

• Add speculative decoding (#1120)

  Show description for fb762a6
  abetlen

  authored
  fb762a6

  Copy full SHA for fb762a6

Commits on Jan 21, 2024

• fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

  abetlen

  committed
  24f3945

  Copy full SHA for 24f3945

Commits on Jan 19, 2024

• feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

  abetlen

  committed
  b8fc1c7

  Copy full SHA for b8fc1c7

Commits on Jan 15, 2024

• Implement GGUF metadata KV overrides (#1011)

  Show description for 76aafa6
  

  phiharri

  and

  abetlen

  authored
  76aafa6

  Copy full SHA for 76aafa6

Commits on Dec 22, 2023

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2f

  Copy full SHA for 12b7f2f

Loading