Skip to content

Add tests for the C tokenizer and expose it as a private module#27924

Merged
pablogsal merged 5 commits intopython:mainfrom
pablogsal:test_c_tokenizer
Aug 24, 2021
Merged

Add tests for the C tokenizer and expose it as a private module#27924
pablogsal merged 5 commits intopython:mainfrom
pablogsal:test_c_tokenizer