Commits

Commit history

1. Commits on Jul 26, 2026

   • docs(example): refresh the built-in embedding usage example

     Show description for 77b7fa1
     JamePeng

     committed
     77b7fa1View commit details

     Copy full SHA for 77b7fa1

     View code at this pointBrowse repository at this point
2. Commits on May 23, 2026

   • examples: add benchmark script for speculative decoding

     Show description for 91627a0
     JamePeng

     committed
     91627a0View commit details

     Copy full SHA for 91627a0

     View code at this pointBrowse repository at this point
3. Commits on Feb 9, 2026

   • Refactor Llama class to use new LlamaSampler chain API from _internals

     Show description for 1e6094a
     JamePeng

     committed
     1e6094aView commit details

     Copy full SHA for 1e6094a

     View code at this pointBrowse repository at this point
4. Commits on Feb 7, 2026

   • Refactor sampling infrastructure to use llama.cpp sampler chain API

     Show description for 1df39b4
     JamePeng

     committed
     1df39b4View commit details

     Copy full SHA for 1df39b4

     View code at this pointBrowse repository at this point
5. Commits on Jan 29, 2026

   • Sync llama : disable Direct IO by default

     JamePeng

     committed
     5bdff0bView commit details

     Copy full SHA for 5bdff0b

     View code at this pointBrowse repository at this point
6. Commits on Jan 8, 2026

   • Update llama.cpp API 20260108

     JamePeng

     committed
     4d0fe24View commit details

     Copy full SHA for 4d0fe24

     View code at this pointBrowse repository at this point
7. Commits on Mar 13, 2025

   • class LlamaSampler: append add_xtc(), add_top_n_sigma() and add_dry()

     Show description for c21dc41
     JamePeng

     committed
     c21dc41View commit details

     Copy full SHA for c21dc41

     View code at this pointBrowse repository at this point
8. Commits on Dec 6, 2024

   • fix(examples): Refactor Batching notebook to use new sampler chain API (#1793)

     Show description for d610477
     lukestanley

     authored
     d610477View commit details

     Copy full SHA for d610477

     View code at this pointBrowse repository at this point
9. Commits on Jul 9, 2024

   • fix(misc): Format

     abetlen

     committed
     c1ae815View commit details

     Copy full SHA for c1ae815

     View code at this pointBrowse repository at this point
10. Commits on Jun 13, 2024

    • feat: Support SPM infill (#1492)

      Show description for dbcf64c
      

      CISC

      and

      abetlen

      authored
      dbcf64cView commit details

      Copy full SHA for dbcf64c

      View code at this pointBrowse repository at this point
11. Commits on May 17, 2024

    • example: LLM inference with Ray Serve (#1465)

      rgerganov

      authored
      03f171eView commit details

      Copy full SHA for 03f171e

      View code at this pointBrowse repository at this point
12. Commits on Apr 28, 2024

    • examples: fix quantize example (#1387)

      Show description for e6bbfb8
      iyubondyrev

      authored
      e6bbfb8View commit details

      Copy full SHA for e6bbfb8

      View code at this pointBrowse repository at this point
13. Commits on Apr 10, 2024

    • feat: Add support for yaml based configs

      abetlen

      committed
      060bfa6View commit details

      Copy full SHA for 060bfa6

      View code at this pointBrowse repository at this point
14. Commits on Feb 26, 2024

    • docs: Update multimodal example

      abetlen

      committed
      79c649cView commit details

      Copy full SHA for 79c649c

      View code at this pointBrowse repository at this point

    • docs: Update multimodal example

      abetlen

      committed
      bf315eeView commit details

      Copy full SHA for bf315ee

      View code at this pointBrowse repository at this point

    • docs(examples): Add huggingface pull example

      abetlen

      committed
      252e1ffView commit details

      Copy full SHA for 252e1ff

      View code at this pointBrowse repository at this point

    • docs(examples): Add gradio chat example

      abetlen

      committed
      bd4ec2eView commit details

      Copy full SHA for bd4ec2e

      View code at this pointBrowse repository at this point
15. Commits on Feb 23, 2024

    • docs: Update Functionary OpenAI Server Readme (#1193)

      Show description for bce6dc0
      jeffrey-fong

      authored
      bce6dc0View commit details

      Copy full SHA for bce6dc0

      View code at this pointBrowse repository at this point
16. Commits on Feb 12, 2024

    • feat: Generic chatml Function Calling (#957)

      Show description for 153a004
      abetlen

      authored
      153a004View commit details

      Copy full SHA for 153a004

      View code at this pointBrowse repository at this point
17. Commits on Jan 31, 2024

    • fix: Run server command. Closes #1143

      abetlen

      committed
      2b37d8eView commit details

      Copy full SHA for 2b37d8e

      View code at this pointBrowse repository at this point
18. Commits on Jan 15, 2024

    • Fix low_level_api_chat_cpp example to match current API (#1086)

      Show description for 1eaace8
      

      aniljava

      and

      Anil Pathak

      authored
      1eaace8View commit details

      Copy full SHA for 1eaace8

      View code at this pointBrowse repository at this point
19. Commits on Dec 18, 2023

    • Update low_level_api_llama_cpp.py to match current API (#1023)

      jsoma

      authored
      cfd698cView commit details

      Copy full SHA for cfd698c

      View code at this pointBrowse repository at this point
20. Commits on Nov 20, 2023

    • bug fixing (#925)

      zocainViken

      authored
      6dde6bdView commit details

      Copy full SHA for 6dde6bd

      View code at this pointBrowse repository at this point
21. Commits on Nov 10, 2023

    • Update Functions notebook

      abetlen

      committed
      74167bdView commit details

      Copy full SHA for 74167bd

      View code at this pointBrowse repository at this point

    • Update Functions notebook example

      abetlen

      committed
      85ead98View commit details

      Copy full SHA for 85ead98

      View code at this pointBrowse repository at this point

    • Update functionary for new OpenAI API

      abetlen

      committed
      1b376c6View commit details

      Copy full SHA for 1b376c6

      View code at this pointBrowse repository at this point
22. Commits on Nov 8, 2023

    • Update Multimodal notebook

      abetlen

      committed
      598780fView commit details

      Copy full SHA for 598780f

      View code at this pointBrowse repository at this point

    • Multimodal Support (Llava 1.5) (#821)

      Show description for aab74f0
      

      damian0815

      and

      abetlen

      authored
      aab74f0View commit details

      Copy full SHA for aab74f0

      View code at this pointBrowse repository at this point
23. Commits on Nov 3, 2023

    • Add functionary support (#784)

      Show description for 3af7b21
      abetlen

      authored
      3af7b21View commit details

      Copy full SHA for 3af7b21

      View code at this pointBrowse repository at this point

    • Migrate inference to llama_batch and llama_decode api (#795)

      Show description for ab028cb
      

      abetlen

      and

      antoine-lizee

      authored
      ab028cbView commit details

      Copy full SHA for ab028cb

      View code at this pointBrowse repository at this point
24. Commits on Sep 14, 2023

    • Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.

      abetlen

      committed
      f4090a0View commit details

      Copy full SHA for f4090a0

      View code at this pointBrowse repository at this point
25. Commits on Sep 7, 2023

    • Fix low level api examples

      

      Juarez Bochi

      committed
      20ac434View commit details

      Copy full SHA for 20ac434

      View code at this pointBrowse repository at this point
26. Commits on May 26, 2023

    • Merge pull request #265 from dmahurin/fix-from-bytes-byteorder

      Show description for 2adf6f3
      abetlen

      authored
      2adf6f3View commit details

      Copy full SHA for 2adf6f3

      View code at this pointBrowse repository at this point

    • Merge pull request #274 from dmahurin/fix-missing-antiprompt

      Show description for 34ad71f
      abetlen

      authored
      34ad71fView commit details

      Copy full SHA for 34ad71f

      View code at this pointBrowse repository at this point

    • low_level_api_chat_cpp.py: Fix missing antiprompt output in chat.

      

      Don Mahurin

      committed
      0fa2ec4View commit details

      Copy full SHA for 0fa2ec4

      View code at this pointBrowse repository at this point