black/blib2to3/pgen2
Benjamin Woodruff 448885b256
Move tokenizer config onto grammar, rename flag
Based on the feedback in
https://github.com/python/black/pull/845#issuecomment-490622711

- Remove TokenizerConfig, and add a field to Grammar instead.
- Pass the Grammar to the tokenizer.
- Rename `ASYNC_IS_RESERVED_KEYWORD` to `ASYNC_KEYWORDS` and
  `ASYNC_IS_VALID_IDENTIFIER` to `ASYNC_IDENTIFIERS`.
2019-05-09 17:59:29 +02:00
..
__init__.py Initial commit 2018-03-14 12:55:32 -07:00
__init__.pyi Initial commit 2018-03-14 12:55:32 -07:00
conv.py Initial commit 2018-03-14 12:55:32 -07:00
driver.py Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00
driver.pyi Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00
grammar.py Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00
grammar.pyi Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00
literals.py Initial commit 2018-03-14 12:55:32 -07:00
literals.pyi Initial commit 2018-03-14 12:55:32 -07:00
parse.py Initial commit 2018-03-14 12:55:32 -07:00
parse.pyi Initial commit 2018-03-14 12:55:32 -07:00
pgen.py Initial commit 2018-03-14 12:55:32 -07:00
pgen.pyi Initial commit 2018-03-14 12:55:32 -07:00
token.py Remove unnecessary shebang lines (#189) 2018-05-04 13:52:17 -07:00
token.pyi Initial commit 2018-03-14 12:55:32 -07:00
tokenize.py Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00
tokenize.pyi Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00