f8617f975d
Fixes #593 I looked into this bug with @ambv and @carljm, and we reached the conclusion was that it's not possible for the tokenizer to determine if async/await is a keyword inside all possible generators without breaking the grammar for older versions of Python. Instead, we introduce a new tokenizer mode for Python 3.7+ that will cause all async/await instances to get parsed as a reserved keyword, which should fix async/await inside generators. |
||
|---|---|---|
| .. | ||
| pgen2 | ||
| __init__.py | ||
| __init__.pyi | ||
| Grammar.txt | ||
| LICENSE | ||
| PatternGrammar.txt | ||
| pygram.py | ||
| pygram.pyi | ||
| pytree.py | ||
| pytree.pyi | ||
| README | ||
A subset of lib2to3 taken from Python 3.7.0b2. Commit hash: 9c17e3a1987004b8bcfbe423953aad84493a7984 Reasons for forking: - consistent handling of f-strings for users of Python < 3.6.2 - backport of BPO-33064 that fixes parsing files with trailing commas after *args and **kwargs - backport of GH-6143 that restores the ability to reformat legacy usage of `async` - support all types of string literals - better ability to debug (better reprs) - INDENT and DEDENT don't hold whitespace and comment prefixes - ability to Cythonize Change Log: - Changes default logger used by Driver