Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
youknowone
RustPython
Repository navigation
Code
Issues
11
(11)
Pull requests
2
(2)
Actions
Projects
Security and quality
Insights
More
items
Commits
Breadcrumbs
History for
RustPython
crates
stdlib
src
_tokenize.rs
on
rustpython-cpython
User selector
All users
Datepicker
All time
Commit history
Commits on Oct 31, 2026
Synchronize tokenizer state across concurrent iteration (#9499)
Show description for 1aca06a
youknowdot
and
codex
authored
1aca06a
View commit details
Copy full SHA for 1aca06a
View code at this point
Browse repository at this point
Commits on Oct 30, 2026
Match incomplete-statement tokenizer EOF recovery (#9491)
Show description for b7e6e58
youknowdot
and
codex
authored
b7e6e58
View commit details
Copy full SHA for b7e6e58
View code at this point
Browse repository at this point
Commits on Oct 29, 2026
Match tokenizer token metadata with CPython 3.15 (#9445)
Show description for 5f95fd8
youknowdot
and
codex
authored
5f95fd8
View commit details
Copy full SHA for 5f95fd8
View code at this point
Browse repository at this point
Commits on Oct 21, 2026
Share immutable tokenizer state between iterations (#9265)
Show description for 6f2d4a2
1ndahous3
authored
6f2d4a2
View commit details
Copy full SHA for 6f2d4a2
View code at this point
Browse repository at this point
Commits on Oct 18, 2026
Align lazy imports and f/t-string interpolation with Python 3.15 (#9179)
Show description for 9f6f771
youknowdot
authored
9f6f771
View commit details
Copy full SHA for 9f6f771
View code at this point
Browse repository at this point
Commits on Oct 7, 2026
Take SyntaxError messages and ranges from the parser (#8983)
Show description for a403341
3 people
authored
a403341
View commit details
Copy full SHA for a403341
View code at this point
Browse repository at this point
Commits on Sep 22, 2026
Show stdin traceback lines; omit StopIteration None args (#8778)
Show description for f56bfc9
youknowone
authored
f56bfc9
View commit details
Copy full SHA for f56bfc9
View code at this point
Browse repository at this point
Commits on Jul 28, 2026
Fix SymbolUsge::Iter, os.rename, sre_engine (#8390)
Show description for 8c8caec
youknowone
authored
8c8caec
View commit details
Copy full SHA for 8c8caec
View code at this point
Browse repository at this point
Commits on May 4, 2026
Warn on `unreachable_pub` (#7762)
ShaharNaveh
authored
c3afe01
View commit details
Copy full SHA for c3afe01
View code at this point
Browse repository at this point
Commits on Mar 14, 2026
Update ruff to `0.15.6` (#7427)
Show description for 17ac738
ShaharNaveh
authored
17ac738
View commit details
Copy full SHA for 17ac738
View code at this point
Browse repository at this point
Commits on Mar 12, 2026
fmt
youknowone
committed
c06cf05
View commit details
Copy full SHA for c06cf05
View code at this point
Browse repository at this point
Commits on Mar 10, 2026
Rewrite _tokenize with 2-phase model
Show description for f090ae3
youknowone
committed
f090ae3
View commit details
Copy full SHA for f090ae3
View code at this point
Browse repository at this point
Loading
You can’t perform that action at this time.