Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 3, 2026

• Benchmark quality of life (#441)

  Show description for 0f1c5e9
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  0f1c5e9

  Copy full SHA for 0f1c5e9

Commits on Feb 2, 2026

• Cleanup dependencies (#440)

  Show description for 802f576
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  802f576

  Copy full SHA for 802f576

• Refactor memory allocation handling in inference scripts (#439)

  Show description for 0e1e918
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  0e1e918

  Copy full SHA for 0e1e918

Commits on Feb 1, 2026

• Optimize Benchmarking Infrastructure (#437)

  Show description for 18546fb
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  18546fb

  Copy full SHA for 18546fb

Commits on Jan 31, 2026

• Improve Benchmark Reliability and Add Features (#436)

  Show description for 9727ece
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  9727ece

  Copy full SHA for 9727ece

Commits on Jan 30, 2026

• also track running and waiting requests, together with kv cache usage and prefix cache hit rate (#435)

  Show description for bee4304
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  bee4304

  Copy full SHA for bee4304

• Simplify analysis (#434)

  Show description for dfa453a
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  dfa453a

  Copy full SHA for dfa453a

• Extend Benchmarking Framework (#433)

  Show description for 51609a5
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  51609a5

  Copy full SHA for 51609a5

Commits on Jan 29, 2026

• replace venv_path with env_command to fix ModuleNotFoundError (#432)

  Show description for 93404ad
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  93404ad

  Copy full SHA for 93404ad

Commits on Jan 28, 2026

• Benchmark analysis improvements (#431)

  Show description for c31ee3c
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  c31ee3c

  Copy full SHA for c31ee3c

Commits on Jan 27, 2026

• Speed up Benchmark Submission (#430)

  Show description for 358f968
  

  JoelNiklaus

  and

  Joel Niklaus

  authored
  358f968

  Copy full SHA for 358f968

• Merge pull request #429 from huggingface/inference-benchmark-misc

  Show description for f9b483c
  JoelNiklaus

  authored
  f9b483c

  Copy full SHA for f9b483c

• added missing import

  

  Joel Niklaus

  committed
  d7b5a63

  Copy full SHA for d7b5a63

• switched to lazy imports for faster submission

  

  Joel Niklaus

  committed
  05c6aef

  Copy full SHA for 05c6aef

• small misc changes

  

  Joel Niklaus

  committed
  efbc428

  Copy full SHA for efbc428

• change default output-dir

  

  Joel Niklaus

  committed
  6578fd8

  Copy full SHA for 6578fd8

• fix boolean args in experiment launcher

  

  Joel Niklaus

  committed
  dee4e67

  Copy full SHA for dee4e67

• Merge pull request #426 from huggingface/fix/vllm-cache-isolation

  Show description for e15cece
  JoelNiklaus

  authored
  e15cece

  Copy full SHA for e15cece

• Merge pull request #428 from huggingface/readme-deps

  Show description for 4cf9cad
  JoelNiklaus

  authored
  4cf9cad

  Copy full SHA for 4cf9cad

• make hash mimic vllm compute_hash more

  

  Joel Niklaus

  committed
  6688f7d

  Copy full SHA for 6688f7d

• added tests

  

  Joel Niklaus

  committed
  f0d2fff

  Copy full SHA for f0d2fff

• changed to adding a lock on the cache dir

  

  Joel Niklaus

  committed
  2fce454

  Copy full SHA for 2fce454

• fix readme

  

  Joel Niklaus

  committed
  3ac61e8

  Copy full SHA for 3ac61e8

• add datatrove[io] and other necessary deps for inference part

  

  Joel Niklaus

  committed
  7c3d2eb

  Copy full SHA for 7c3d2eb

• Merge branch 'main' into fix/vllm-cache-isolation

  

  Joel Niklaus

  committed
  e423767

  Copy full SHA for e423767

• Merge pull request #427 from huggingface/fix/dataset-name

  Show description for 477e43a
  JoelNiklaus

  authored
  477e43a

  Copy full SHA for 477e43a

• ran formatter

  

  Joel Niklaus

  committed
  f845e65

  Copy full SHA for f845e65

• update dataset name

  

  Joel Niklaus

  committed
  010e4b3

  Copy full SHA for 010e4b3

• prevent vllm cache corruption

  

  Joel Niklaus

  committed
  e90933b

  Copy full SHA for e90933b

Commits on Jan 26, 2026

• Merge pull request #421 from huggingface/optimized-parquet-in-readme

  Show description for c00c03b
  lhoestq

  authored
  c00c03b

  Copy full SHA for c00c03b

• Merge pull request #425 from huggingface/truncate-context

  Show description for 23593cb
  JoelNiklaus

  authored
  23593cb

  Copy full SHA for 23593cb

• format

  

  Joel Niklaus

  committed
  a80e252

  Copy full SHA for a80e252

• Merge pull request #424 from huggingface/benchmark-mode

  Show description for d4b4423
  JoelNiklaus

  authored
  d4b4423

  Copy full SHA for d4b4423

• Update generate_data.py

  JoelNiklaus

  authored
  25e9f21

  Copy full SHA for 25e9f21

• truncate context to prevent server errors

  

  Joel Niklaus

  committed
  03f5b4d

  Copy full SHA for 03f5b4d

Pagination

Previous

Next