black/blib2to3
Benjamin Woodruff 448885b256
Move tokenizer config onto grammar, rename flag
Based on the feedback in
https://github.com/python/black/pull/845#issuecomment-490622711

- Remove TokenizerConfig, and add a field to Grammar instead.
- Pass the Grammar to the tokenizer.
- Rename `ASYNC_IS_RESERVED_KEYWORD` to `ASYNC_KEYWORDS` and
  `ASYNC_IS_VALID_IDENTIFIER` to `ASYNC_IDENTIFIERS`.
2019-05-09 17:59:29 +02:00
..
pgen2 Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00
__init__.py Initial commit 2018-03-14 12:55:32 -07:00
__init__.pyi Initial commit 2018-03-14 12:55:32 -07:00
Grammar.txt Parse complex expressions in parameters after * and ** 2018-04-17 20:34:02 +01:00
LICENSE Link to GitHub + HTTPS + typos (#303) 2018-06-06 09:50:08 -07:00
PatternGrammar.txt Initial commit 2018-03-14 12:55:32 -07:00
pygram.py Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00
pygram.pyi Move tokenizer config onto grammar, rename flag 2019-05-09 17:59:29 +02:00
pytree.py Don't mark subtrees as changed that were already marked. 2018-06-09 19:49:20 -07:00
pytree.pyi Clean up typing ignores, fix build 2018-03-15 23:26:56 -07:00
README Changes default logger used by blib2to3 Driver (#732) 2019-03-14 13:39:42 +01:00

A subset of lib2to3 taken from Python 3.7.0b2.
Commit hash: 9c17e3a1987004b8bcfbe423953aad84493a7984

Reasons for forking:
- consistent handling of f-strings for users of Python < 3.6.2
- backport of BPO-33064 that fixes parsing files with trailing commas after
  *args and **kwargs
- backport of GH-6143 that restores the ability to reformat legacy usage of
  `async`
- support all types of string literals
- better ability to debug (better reprs)
- INDENT and DEDENT don't hold whitespace and comment prefixes
- ability to Cythonize

Change Log:
- Changes default logger used by Driver