Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
removecode
sqlglot
Repository navigation
Code
Pull requests
Actions
Projects
Security and quality
Insights
More
items
Commits
Breadcrumbs
History for
sqlglot
sqlglot
tokenizer_core.py
on
main
User selector
All users
Datepicker
All time
Commit history
Commits on Jul 13, 2026
Fix(tokenizer)!: handle escaped quote before closing multi-char delimiter, preserve escapes in raw strings (#7870)
Show description for 8c7941f
georgesittas
authored
8c7941f
View commit details
Copy full SHA for 8c7941f
View code at this point
Browse repository at this point
Commits on Jul 8, 2026
Fix(clickhouse)!: use a dedicated token for PROJECTION closes #7837
georgesittas
committed
f37c71e
View commit details
Copy full SHA for f37c71e
View code at this point
Browse repository at this point
Commits on Jun 19, 2026
fix(postgres): support jsonpath @? operator CODEX (#7766)
fpatz
authored
02e2469
View commit details
Copy full SHA for 02e2469
View code at this point
Browse repository at this point
Commits on Jun 15, 2026
feat(snowflake)!: add UNDROP support for all Snowflake Time Travel object types (#7735)
Show description for 2e7f8b7
Danielhaiman
and
dhaiman-varonis
authored
2e7f8b7
View commit details
Copy full SHA for 2e7f8b7
View code at this point
Browse repository at this point
Commits on May 19, 2026
feat(postgres): add support for PostGIS 3D distance operator <<->> (#7655)
Show description for cc448ac
vnataliia
authored
cc448ac
View commit details
Copy full SHA for cc448ac
View code at this point
Browse repository at this point
Commits on May 12, 2026
fix(redshift)!: roundtrip support for CURRENT_USER_ID and USER (#7633)
Show description for 87cc106
fivetran-kwoodbeck
authored
87cc106
View commit details
Copy full SHA for 87cc106
View code at this point
Browse repository at this point
Commits on May 8, 2026
feat(postgres)!: parse CREATE TYPE statements (#7616)
Show description for ae58fd1
3 people
authored
ae58fd1
View commit details
Copy full SHA for ae58fd1
View code at this point
Browse repository at this point
Commits on Apr 23, 2026
perf(tokens): cache TokenizerCore per thread (#7547)
Show description for 63f8dc6
tobymao
authored
63f8dc6
View commit details
Copy full SHA for 63f8dc6
View code at this point
Browse repository at this point
Commits on Apr 6, 2026
Refactor: use ruff UP rule to modernize coding style (#7459)
georgesittas
authored
08b51e8
View commit details
Copy full SHA for 08b51e8
View code at this point
Browse repository at this point
Commits on Apr 1, 2026
fix(bigquery): support hyphen, numbers, single dot as JSON keys (#7420)
Show description for 9068242
geooo109
and
georgesittas
authored
9068242
View commit details
Copy full SHA for 9068242
View code at this point
Browse repository at this point
Commits on Mar 18, 2026
perf: optimize parser fast path for simple table references
Show description for 1697bc3
tobymao
and
claude
committed
1697bc3
View commit details
Copy full SHA for 1697bc3
View code at this point
Browse repository at this point
Commits on Mar 17, 2026
perf: move instance variables to __init__ for perf
Show description for 0ac52aa
tobymao
committed
0ac52aa
View commit details
Copy full SHA for 0ac52aa
View code at this point
Browse repository at this point
Commits on Mar 12, 2026
feat: support multi-word DESCRIBE kinds in Snowflake (#7260)
Show description for dc4a7ef
sabir-akhadov-localstack
and
claude
authored
dc4a7ef
View commit details
Copy full SHA for dc4a7ef
View code at this point
Browse repository at this point
Commits on Mar 11, 2026
Chore(parser)!: Move `ParserCore` back to `Parser` (#7268)
Show description for a13995e
VaggelisD
authored
a13995e
View commit details
Copy full SHA for a13995e
View code at this point
Browse repository at this point
Commits on Mar 9, 2026
feat: fast path for tokenizer (#7226)
Show description for 4ae6c3d
tobymao
authored
4ae6c3d
View commit details
Copy full SHA for 4ae6c3d
View code at this point
Browse repository at this point
Commits on Mar 2, 2026
Chore: consolidate `SecurityProperty` and `SqlSecurityProperty` (#7174)
jwhitaker-gridcog
authored
ab8331c
View commit details
Copy full SHA for ab8331c
View code at this point
Browse repository at this point
Commits on Feb 25, 2026
feat(clickhouse): support nested JSON subcolumn access (#7140)
Show description for 483791d
3 people
authored
483791d
View commit details
Copy full SHA for 483791d
View code at this point
Browse repository at this point
Commits on Feb 24, 2026
chore(tokenizer): Replace SPACE_CHARS with str.isspace (#7134)
VaggelisD
authored
ea424bf
View commit details
Copy full SHA for ea424bf
View code at this point
Browse repository at this point
feat(clickhouse)!: Transpile numeric literals with underscores from ClickHouse to other dialects (#7132)
Show description for 8ee0646
fivetran-amrutabhimsenayachit
and
VaggelisD
authored
8ee0646
View commit details
Copy full SHA for 8ee0646
View code at this point
Browse repository at this point
Commits on Feb 23, 2026
feat!!: remove rust and build c (#7120)
Show description for 0a0cc95
3 people
authored
0a0cc95
View commit details
Copy full SHA for 0a0cc95
View code at this point
Browse repository at this point
Commits on Feb 20, 2026
chore(tokenizer)!: Split core functionality to TokenizerCore (#7116)
VaggelisD
authored
37fa8c7
View commit details
Copy full SHA for 37fa8c7
View code at this point
Browse repository at this point
Loading
You can’t perform that action at this time.