Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
SashaMIT
llama-cpp-python
Repository navigation
Code
Pull requests
Actions
Projects
Security and quality
Insights
More
items
Commits
Breadcrumbs
History for
llama-cpp-python
examples
on
main
User selector
All users
Datepicker
All time
Commit history
Commits on Sep 12, 2026
feat: update llama.cpp to v0.4.0 (#2367)
abetlen
authored
d736646
View commit details
Copy full SHA for d736646
View code at this point
Browse repository at this point
Commits on Aug 16, 2026
fix(example): retain recurrent state for MTP rollback (#2358)
abetlen
authored
987e3df
View commit details
Copy full SHA for 987e3df
View code at this point
Browse repository at this point
Commits on Aug 10, 2026
feat: update llama.cpp to 936918514 (#2348)
Show description for 67014fd
abetlen
authored
67014fd
View commit details
Copy full SHA for 67014fd
View code at this point
Browse repository at this point
Commits on Jun 25, 2026
feat(example): support chained NextN server MTP (#2319)
abetlen
authored
4ff48f0
View commit details
Copy full SHA for 4ff48f0
View code at this point
Browse repository at this point
Commits on Jun 13, 2026
feat(example): use MTMD batch encoding (#2301)
abetlen
authored
a52702f
View commit details
Copy full SHA for a52702f
View code at this point
Browse repository at this point
Commits on Jun 9, 2026
feat(example): support server video inputs and Gemma text tool calls (#2291)
Show description for 051dda2
abetlen
authored
051dda2
View commit details
Copy full SHA for 051dda2
View code at this point
Browse repository at this point
Commits on Jun 8, 2026
fix(example): correct GPT-OSS tool calling config for server example (#2289)
abetlen
authored
e8191f0
View commit details
Copy full SHA for e8191f0
View code at this point
Browse repository at this point
fix(example): support multi-step Responses tool streaming (#2288)
Show description for d4ac2c2
abetlen
authored
d4ac2c2
View commit details
Copy full SHA for d4ac2c2
View code at this point
Browse repository at this point
fix(example): derive streaming response parser boundaries from schema (#2287)
abetlen
authored
411e0f4
View commit details
Copy full SHA for 411e0f4
View code at this point
Browse repository at this point
fix(example): avoid duplicate streamed response deltas (#2285)
abetlen
authored
a72325b
View commit details
Copy full SHA for a72325b
View code at this point
Browse repository at this point
Commits on Jun 7, 2026
feat(example): align server MTP support with llama.cpp (#2283)
Show description for fddee27
abetlen
authored
fddee27
View commit details
Copy full SHA for fddee27
View code at this point
Browse repository at this point
feat(example): add OpenAI-compatible embeddings endpoint (#2281)
Show description for fe927bd
abetlen
authored
fe927bd
View commit details
Copy full SHA for fe927bd
View code at this point
Browse repository at this point
feat: update llama.cpp to ggml-org/llama.cpp@465b1f0e7 (#2278)
abetlen
authored
cf18830
View commit details
Copy full SHA for cf18830
View code at this point
Browse repository at this point
feat(example): Updated server example (batch processing, `/v1/responses` api, response parsing) (#2174)
Show description for 66635a0
abetlen
authored
66635a0
View commit details
Copy full SHA for 66635a0
View code at this point
Browse repository at this point
Commits on Jun 6, 2026
docs: add Gemma 4 QAT Colab notebook (#2276)
Show description for 7f16fe1
abetlen
authored
7f16fe1
View commit details
Copy full SHA for 7f16fe1
View code at this point
Browse repository at this point
Commits on Jun 5, 2026
docs: fix Gemma 4 Colab notebook (#2275)
Show description for 7a2a36d
abetlen
authored
7a2a36d
View commit details
Copy full SHA for 7a2a36d
View code at this point
Browse repository at this point
docs: add Gemma 4 Colab notebook (#2274)
abetlen
authored
8949066
View commit details
Copy full SHA for 8949066
View code at this point
Browse repository at this point
Commits on Apr 3, 2026
fix(misc): replace deprecated llama.cpp references (#2170)
Show description for 08e088c
abetlen
authored
08e088c
View commit details
Copy full SHA for 08e088c
View code at this point
Browse repository at this point
Commits on Mar 23, 2026
fix: Qwen 3.5 support (#2152)
Show description for 11e7a55
abetlen
authored
11e7a55
View commit details
Copy full SHA for 11e7a55
View code at this point
Browse repository at this point
Commits on Dec 6, 2024
fix(examples): Refactor Batching notebook to use new sampler chain API (#1793)
Show description for d610477
lukestanley
authored
d610477
View commit details
Copy full SHA for d610477
View code at this point
Browse repository at this point
Commits on Jul 9, 2024
fix(misc): Format
abetlen
committed
c1ae815
View commit details
Copy full SHA for c1ae815
View code at this point
Browse repository at this point
Commits on Jun 13, 2024
feat: Support SPM infill (#1492)
Show description for dbcf64c
CISC
and
abetlen
authored
dbcf64c
View commit details
Copy full SHA for dbcf64c
View code at this point
Browse repository at this point
Commits on May 17, 2024
example: LLM inference with Ray Serve (#1465)
rgerganov
authored
03f171e
View commit details
Copy full SHA for 03f171e
View code at this point
Browse repository at this point
Commits on Apr 28, 2024
examples: fix quantize example (#1387)
Show description for e6bbfb8
iyubondyrev
authored
e6bbfb8
View commit details
Copy full SHA for e6bbfb8
View code at this point
Browse repository at this point
Commits on Apr 10, 2024
feat: Add support for yaml based configs
abetlen
committed
060bfa6
View commit details
Copy full SHA for 060bfa6
View code at this point
Browse repository at this point
Commits on Feb 26, 2024
docs: Update multimodal example
abetlen
committed
79c649c
View commit details
Copy full SHA for 79c649c
View code at this point
Browse repository at this point
docs: Update multimodal example
abetlen
committed
bf315ee
View commit details
Copy full SHA for bf315ee
View code at this point
Browse repository at this point
docs(examples): Add huggingface pull example
abetlen
committed
252e1ff
View commit details
Copy full SHA for 252e1ff
View code at this point
Browse repository at this point
docs(examples): Add gradio chat example
abetlen
committed
bd4ec2e
View commit details
Copy full SHA for bd4ec2e
View code at this point
Browse repository at this point
Commits on Feb 23, 2024
docs: Update Functionary OpenAI Server Readme (#1193)
Show description for bce6dc0
jeffrey-fong
authored
bce6dc0
View commit details
Copy full SHA for bce6dc0
View code at this point
Browse repository at this point
Commits on Feb 12, 2024
feat: Generic chatml Function Calling (#957)
Show description for 153a004
abetlen
authored
153a004
View commit details
Copy full SHA for 153a004
View code at this point
Browse repository at this point
Commits on Jan 31, 2024
fix: Run server command. Closes #1143
abetlen
committed
2b37d8e
View commit details
Copy full SHA for 2b37d8e
View code at this point
Browse repository at this point
Commits on Jan 15, 2024
Fix low_level_api_chat_cpp example to match current API (#1086)
Show description for 1eaace8
aniljava
and
Anil Pathak
authored
1eaace8
View commit details
Copy full SHA for 1eaace8
View code at this point
Browse repository at this point
Commits on Dec 18, 2023
Update low_level_api_llama_cpp.py to match current API (#1023)
jsoma
authored
cfd698c
View commit details
Copy full SHA for cfd698c
View code at this point
Browse repository at this point
Commits on Nov 20, 2023
bug fixing (#925)
zocainViken
authored
6dde6bd
View commit details
Copy full SHA for 6dde6bd
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.