You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Line continuation of blank line emits NEWLINE #81802
Both C and Python tokenizers emit NEWLINE tokens on continued blank lines. Because of this it is possible to emit repeated NEWLINEs, which some tools don't expect to happen.
I've attached example source file which is tokenized into 3 NEWLINE tokens in a row.
Activity
miedzinski commentedon Jul 18, 2019
Both C and Python tokenizers emit NEWLINE tokens on continued blank lines. Because of this it is possible to emit repeated NEWLINEs, which some tools don't expect to happen.
I've attached example source file which is tokenized into 3 NEWLINE tokens in a row.
lysnikolaou commentedon Oct 12, 2023
This is no longer relevant after the changes to the tokenizer for PEP 701, so I'm closing it.