Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
ExtReMLapin
llama-cpp-python
Repository navigation
Code
Pull requests
Actions
Projects
Security and quality
Insights
More
items
Commits
Breadcrumbs
History for
llama-cpp-python
llama_cpp
_internals.py
on
main
User selector
All users
Datepicker
All time
Commit history
Commits on Jul 18, 2024
fix: Change repeat_penalty to 1.0 to match llama.cpp defaults (#1590)
Show description for 0700476
ddh0
and
abetlen
authored
0700476
View commit details
Copy full SHA for 0700476
View code at this point
Browse repository at this point
Commits on Jul 9, 2024
fix(minor): Minor ruff fixes
abetlen
committed
08f2bb3
View commit details
Copy full SHA for 08f2bb3
View code at this point
Browse repository at this point
fix(misc): Format
abetlen
committed
c1ae815
View commit details
Copy full SHA for c1ae815
View code at this point
Browse repository at this point
Commits on Jul 6, 2024
fix: update token_to_piece
abetlen
committed
157d913
View commit details
Copy full SHA for 157d913
View code at this point
Browse repository at this point
Commits on Jun 19, 2024
fix: Make destructor to automatically call .close() method on Llama class.
abetlen
committed
4c1d74c
View commit details
Copy full SHA for 4c1d74c
View code at this point
Browse repository at this point
Commits on Jun 13, 2024
feat: Add `.close()` method to `Llama` class to explicitly free model from memory (#1513)
Show description for 320a5d7
jkawamoto
and
abetlen
authored
320a5d7
View commit details
Copy full SHA for 320a5d7
View code at this point
Browse repository at this point
feat: Support SPM infill (#1492)
Show description for dbcf64c
CISC
and
abetlen
authored
dbcf64c
View commit details
Copy full SHA for dbcf64c
View code at this point
Browse repository at this point
Commits on Jun 7, 2024
feat: Update llama.cpp
abetlen
committed
255e1b4
View commit details
Copy full SHA for 255e1b4
View code at this point
Browse repository at this point
Commits on Jun 4, 2024
fix: Avoid duplicate special tokens in chat formats (#1439)
Show description for 027f7bc
CISC
and
abetlen
authored
027f7bc
View commit details
Copy full SHA for 027f7bc
View code at this point
Browse repository at this point
Commits on Jun 1, 2024
fix: Use numpy recarray for candidates data, fixes bug with temp < 0
abetlen
committed
af3ed50
View commit details
Copy full SHA for af3ed50
View code at this point
Browse repository at this point
Commits on May 4, 2024
fix: detokenization case where first token does not start with a leading space (#1375)
Show description for e0d7674
noamgat
and
abetlen
authored
e0d7674
View commit details
Copy full SHA for e0d7674
View code at this point
Browse repository at this point
Commits on Apr 30, 2024
fix: Suppress all logs when verbose=False, use hardcoded fileno's to work in colab notebooks. Closes #796 Closes #729
abetlen
committed
f116175
View commit details
Copy full SHA for f116175
View code at this point
Browse repository at this point
Commits on Apr 26, 2024
feat: Allow for possibly non-pooled embeddings (#1380)
Show description for f6ed21f
iamlemec
and
abetlen
authored
f6ed21f
View commit details
Copy full SHA for f6ed21f
View code at this point
Browse repository at this point
Commits on Apr 22, 2024
feat: Update llama.cpp
abetlen
committed
159cc4e
View commit details
Copy full SHA for 159cc4e
View code at this point
Browse repository at this point
Commits on Apr 1, 2024
fix: last tokens passing to sample_repetition_penalties function (#1295)
Show description for 62aad61
3 people
authored
62aad61
View commit details
Copy full SHA for 62aad61
View code at this point
Browse repository at this point
Commits on Feb 28, 2024
fix: Remove deprecated cfg sampling functions
abetlen
committed
8c71725
View commit details
Copy full SHA for 8c71725
View code at this point
Browse repository at this point
Commits on Feb 26, 2024
feat: Update llama.cpp
abetlen
committed
cbbcd88
View commit details
Copy full SHA for cbbcd88
View code at this point
Browse repository at this point
Commits on Feb 23, 2024
misc: use typesafe byref for internal classes
abetlen
committed
b9aca61
View commit details
Copy full SHA for b9aca61
View code at this point
Browse repository at this point
Commits on Feb 22, 2024
fix: Raise exceptions when llama model or context fails to load
abetlen
committed
dd22010
View commit details
Copy full SHA for dd22010
View code at this point
Browse repository at this point
Commits on Feb 21, 2024
feat(low-level-api): Improve API static type-safety and performance (#1205)
abetlen
authored
7f51b60
View commit details
Copy full SHA for 7f51b60
View code at this point
Browse repository at this point
Commits on Feb 14, 2024
feat: Support batch embeddings (#1186)
Show description for d7a6791
iamlemec
and
abetlen
authored
d7a6791
View commit details
Copy full SHA for d7a6791
View code at this point
Browse repository at this point
fix: destructor exception where internal classes are missing some uninitialized attributes
abetlen
committed
6943bab
View commit details
Copy full SHA for 6943bab
View code at this point
Browse repository at this point
Commits on Feb 6, 2024
fix: Use llama_log_callback to avoid suppress_stdout_stderr
abetlen
committed
59760c8
View commit details
Copy full SHA for 59760c8
View code at this point
Browse repository at this point
Commits on Jan 29, 2024
Automatically set chat format from gguf (#1110)
Show description for da003d8
abetlen
authored
da003d8
View commit details
Copy full SHA for da003d8
View code at this point
Browse repository at this point
Commits on Jan 19, 2024
feat: Expose gguf model metadata in metadata property
abetlen
committed
5a34c57
View commit details
Copy full SHA for 5a34c57
View code at this point
Browse repository at this point
Commits on Jan 17, 2024
Move helper classes to _internals submodule
abetlen
committed
cc4630e
View commit details
Copy full SHA for cc4630e
View code at this point
Browse repository at this point
Loading
You can’t perform that action at this time.