Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Smartappli
llama-cpp-python
Repository navigation
Code
Pull requests
Actions
Projects
Security and quality
Insights
More
items
Commits
Breadcrumbs
History for
llama-cpp-python
llama_cpp
on
macos
User selector
All users
Datepicker
All time
Commit history
Commits on Apr 26, 2024
chore: Bump version
abetlen
committed
65edc90
View commit details
Copy full SHA for 65edc90
View code at this point
Browse repository at this point
fix: Remove duplicate pooling_type definition and add misisng n_vocab definition in bindings
abetlen
committed
173ebc7
View commit details
Copy full SHA for 173ebc7
View code at this point
Browse repository at this point
feat: Allow for possibly non-pooled embeddings (#1380)
Show description for f6ed21f
iamlemec
and
abetlen
authored
f6ed21f
View commit details
Copy full SHA for f6ed21f
View code at this point
Browse repository at this point
fix: pydantic deprecation warning
abetlen
committed
fcfea66
View commit details
Copy full SHA for fcfea66
View code at this point
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
7f52335
View commit details
Copy full SHA for 7f52335
View code at this point
Browse repository at this point
Commits on Apr 25, 2024
feat: Update llama.cpp
abetlen
committed
2a9979f
View commit details
Copy full SHA for 2a9979f
View code at this point
Browse repository at this point
Commits on Apr 23, 2024
chore: Bump version
abetlen
committed
c50d330
View commit details
Copy full SHA for c50d330
View code at this point
Browse repository at this point
feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)
sean-bailey
authored
53ebcc8
View commit details
Copy full SHA for 53ebcc8
View code at this point
Browse repository at this point
feat: Add Llama-3 chat format (#1371)
Show description for 8559e8c
andreabak
and
abetlen
authored
8559e8c
View commit details
Copy full SHA for 8559e8c
View code at this point
Browse repository at this point
Commits on Apr 22, 2024
feat: Use new llama_token_is_eog in create_completions
abetlen
committed
d40a250
View commit details
Copy full SHA for d40a250
View code at this point
Browse repository at this point
Merge branch 'main' of https://github.com/abetlen/llama-cpp-python into main
abetlen
committed
b21ba0e
View commit details
Copy full SHA for b21ba0e
View code at this point
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
159cc4e
View commit details
Copy full SHA for 159cc4e
View code at this point
Browse repository at this point
Commits on Apr 20, 2024
chore: Bump version
abetlen
committed
0281214
View commit details
Copy full SHA for 0281214
View code at this point
Browse repository at this point
feat: Add stopping_criteria to ChatFormatter, allow stopping on arbitrary token ids, fixes llama3 instruct
abetlen
committed
cc81afe
View commit details
Copy full SHA for cc81afe
View code at this point
Browse repository at this point
Commits on Apr 18, 2024
chore: Bump version
abetlen
committed
893a27a
View commit details
Copy full SHA for 893a27a
View code at this point
Browse repository at this point
feat: update grammar schema converter to match llama.cpp (#1353)
Show description for 4f42664
themrzmaster
authored
4f42664
View commit details
Copy full SHA for 4f42664
View code at this point
Browse repository at this point
Commits on Apr 17, 2024
Revert "feat: Update json to grammar (#1350)"
Show description for fa4bb0c
abetlen
committed
fa4bb0c
View commit details
Copy full SHA for fa4bb0c
View code at this point
Browse repository at this point
feat: Update json to grammar (#1350)
Show description for 610a592
themrzmaster
authored
610a592
View commit details
Copy full SHA for 610a592
View code at this point
Browse repository at this point
feat: add `disable_ping_events` flag (#1257)
Show description for b73c73c
khimaros
authored
b73c73c
View commit details
Copy full SHA for b73c73c
View code at this point
Browse repository at this point
feat: Make saved state more compact on-disk (#1296)
Show description for 4924455
tc-wolf
authored
4924455
View commit details
Copy full SHA for 4924455
View code at this point
Browse repository at this point
feat: Use all available CPUs for batch processing (#1345)
ddh0
authored and
abetlen
committed
c96b2da
View commit details
Copy full SHA for c96b2da
View code at this point
Browse repository at this point
Commits on Apr 10, 2024
chore: Bump version
abetlen
committed
ef29235
View commit details
Copy full SHA for ef29235
View code at this point
Browse repository at this point
fix: pass correct type to chat handlers for chat completion logprobs
abetlen
committed
bb65b4d
View commit details
Copy full SHA for bb65b4d
View code at this point
Browse repository at this point
feat: Add support for yaml based configs
abetlen
committed
060bfa6
View commit details
Copy full SHA for 060bfa6
View code at this point
Browse repository at this point
feat: Add typechecking for ctypes structure attributes
abetlen
committed
1347e1d
View commit details
Copy full SHA for 1347e1d
View code at this point
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
889d0e8
View commit details
Copy full SHA for 889d0e8
View code at this point
Browse repository at this point
Commits on Apr 9, 2024
feat: Update llama.cpp
abetlen
committed
56071c9
View commit details
Copy full SHA for 56071c9
View code at this point
Browse repository at this point
Commits on Apr 6, 2024
chore: Bump version
abetlen
committed
08b16af
View commit details
Copy full SHA for 08b16af
View code at this point
Browse repository at this point
Commits on Apr 5, 2024
fix: missing logprobs in response, incorrect response type for functionary, minor type issues. Closes #1328 Closes #1314
abetlen
committed
1ae3abb
View commit details
Copy full SHA for 1ae3abb
View code at this point
Browse repository at this point
Commits on Apr 3, 2024
chore: Bump version
abetlen
committed
34081dd
View commit details
Copy full SHA for 34081dd
View code at this point
Browse repository at this point
fix: segfault when logits_all=False. Closes #1319
abetlen
committed
8649d76
View commit details
Copy full SHA for 8649d76
View code at this point
Browse repository at this point
Commits on Apr 1, 2024
fix: last tokens passing to sample_repetition_penalties function (#1295)
Show description for 62aad61
3 people
authored
62aad61
View commit details
Copy full SHA for 62aad61
View code at this point
Browse repository at this point
chore: Bump version
abetlen
committed
45bf5ae
View commit details
Copy full SHA for 45bf5ae
View code at this point
Browse repository at this point
feat: add support for KV cache quantization options (#1307)
Show description for f165048
Limour-dev
and
abetlen
authored
f165048
View commit details
Copy full SHA for f165048
View code at this point
Browse repository at this point
Commits on Mar 31, 2024
feat: Add logprobs support to chat completions (#1311)
Show description for aa9f1ae
windspirit95
and
abetlen
authored
aa9f1ae
View commit details
Copy full SHA for aa9f1ae
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.