black/blib2to3/pgen2
Benjamin Woodruff f8617f975d
Add support for always tokenizing async/await as keywords
Fixes #593

I looked into this bug with @ambv and @carljm, and we reached the
conclusion was that it's not possible for the tokenizer to determine if
async/await is a keyword inside all possible generators without breaking
the grammar for older versions of Python.

Instead, we introduce a new tokenizer mode for Python 3.7+ that will
cause all async/await instances to get parsed as a reserved keyword,
which should fix async/await inside generators.
2019-05-09 17:59:29 +02:00
..
__init__.py Initial commit 2018-03-14 12:55:32 -07:00
__init__.pyi Initial commit 2018-03-14 12:55:32 -07:00
conv.py Initial commit 2018-03-14 12:55:32 -07:00
driver.py Add support for always tokenizing async/await as keywords 2019-05-09 17:59:29 +02:00
driver.pyi Add support for always tokenizing async/await as keywords 2019-05-09 17:59:29 +02:00
grammar.py Mention atomic cache creation in the change log 2019-03-14 17:17:50 +01:00
grammar.pyi Initial commit 2018-03-14 12:55:32 -07:00
literals.py Initial commit 2018-03-14 12:55:32 -07:00
literals.pyi Initial commit 2018-03-14 12:55:32 -07:00
parse.py Initial commit 2018-03-14 12:55:32 -07:00
parse.pyi Initial commit 2018-03-14 12:55:32 -07:00
pgen.py Initial commit 2018-03-14 12:55:32 -07:00
pgen.pyi Initial commit 2018-03-14 12:55:32 -07:00
token.py Remove unnecessary shebang lines (#189) 2018-05-04 13:52:17 -07:00
token.pyi Initial commit 2018-03-14 12:55:32 -07:00
tokenize.py Add support for always tokenizing async/await as keywords 2019-05-09 17:59:29 +02:00
tokenize.pyi Add support for always tokenizing async/await as keywords 2019-05-09 17:59:29 +02:00