
I know I know, this is the second reorganization of the docs. I'm not saying the first one was bad or anything... but.. actually wait nah, *it was bad*. Anyway, welcome to probably my biggest commit. The main thing with this reorganization was to introduce nesting to the documentation! Having all of the docs be part of the main TOC was becoming too much. There wasn't much room to expand either. Finally, the old setup required a documentation generation step which was just annoying. The goals of this reorganization was to: 1. Significantly restructure the docs to be discoverable and understandable 2. Add room for further docs (like guides or contributing docs) 3. Get rid of the doc generation step (it was slow and frustrating) 4. Unblock other improvements and also just make contributing to the docs easier Another important change with this is that we are no longer using GitHub as a documentation host. While GitHub does support Markdown based docs actually pretty well, the lack of any features outside of GitHub Flavoured Markdown is quite limiting. ReadTheDocs is just much better suited for documentation. You can use reST, MyST, CommonMark, and all of their great features like toctrees and admonitions. Related to this change, we're adopting MyST as our flavour of Markdown. MyST introduces neat syntax extensions to Markdown that pretty much gives us the best of both worlds. The ease of use and simplicity of MD and the flexibility and expressiveness of reST. Also recommonmark is deprecated now. This switch was possible now we don't use GH as a docs host. MyST docs have to be built to really be usable / pretty, so the MD docs are going to look pretty bad on GH, but that's fine now! Another thing that should be noted is that the README has been stripped of most content since it was confusing. Users would read the README and then think some feature or bug was fixed already and is available in a release when in reality, they weren't. They were reading effectively the latest docs without knowing. See also: https://github.com/psf/black/issues/1759 FYI: CommonMark is a rationalized version of Markdown syntax -- Commit history before merge: * Switch to MyST-Parser + doc config cleanup recommonmark is being deprecated in favour of MyST-Parser. This change is welcomed, especially since MyST-Parser has syntax extensions for the Commonmark standard. Effectively we get to use a language that's powerful and expressive like ReST, but get the simplicity of Markdown. The rest of this effort will be using some MyST features. This reorganization efforts aims to remove as much duplication as possible. The regeneration step once needed is gone, significantly simplifing our Sphinx documentation configuration. * Tell pipenv we replaced recommonmark for MyST-Parser Also update `docs/requirements.txt` * Delete all auto generated content * Switch prettier for mdformat (plus a few plugins) **FYI: THIS WAS EFFECTIVELY REVERTED, SEE THIRD TO LAST COMMIT** prettier doesn't support MyST's syntax extensions which are going to be used in this reorganization effort so we have to switch formatter. Unfortanately mdformat's style is different from prettier's so time to reformat the whole repo too. We're excluding .github/ISSUE_TEMPLATE because I have no idea whether its changes are safe, so let's play it safe. * Fix the heading levels in CHANGES.md + a link MyST-Parser / sphinx's linkcheck complains otherwise. * Move reference docs into a docs/contributing dir They're for contributors of Black anyway. Also added a note in the summary document warning about the lack of attention the reference has been dealing with. * Rewrite and setup the new landing page + main TOC - add some more detail about Black's beta status - add licensing info - add external links in the main TOC for GitHub, PyPI, and IRC - prepare main TOC for new structure * Break out AUTHORS into its own file Not only was the AUTHORS list quite long, this makes it easy to include it in the Sphinx docs with just a simple symlink. * Add license to docs via a simple include Yes the document is orphaned but it is linked to in the landing page (docs/index.rst). * Add "The Black Code Style" section This mostly was a restructuring commit, there has been a few updates but not many. The main goal was to split "current style" and "planned changes to the style that haven't happened yet" to avoid confusion. * Add "Getting Started" page This is basically a quick start + even more. This commit is certainly one of most creatively involved in this effort. * Add "Usage and Configuration" section This commit was as much restructuring as new content. Instead of being in one giant file, usage and configuration documentation can expand without bloating a single file. * Add "Integrations" section Just a restructuring commit ... * Add "Guides" section This is a promising area of documentation that could easily grow in the future, let's prepare for that! * Add "Contributing" section This is also another area that I expect to see significant growth in. Contributors to Black could definitely do with some more specific docs that clears up certain parts of our slightly confusing project (it's only confusing because we're getting big and old!). * Rewrite CONTRIBUTING.md to just point to RTD * Rewrite README.md to delegate most info to RTD * Address feedback + a lot of corrections and edits I know I said I wanted to do these after landing this but given there's going to be no time between this being merged and a release getting pushed, I want these changes to make it in. - drop the number flag for mdformat - to reduce diffs, see also: https://mdformat.readthedocs.io/en/stable/users/style.html#ordered-lists - the GH issue templates should be safe by mdformat, so get rid of the exclude - clarify our configuration position - i.e. stop claiming we don't have many options, instead say we want as little formatting knobs as possible - lots and lots of punctuation, spelling, and grammar corrections (thanks Jelle!) - use RTD as the source for the CHANGELOG too - visual style cleanups - add docs about our .gitignore behaviour - expand GHA Action docs - clarify we want the PR number in the CHANGELOG entry - claify Black's behaviour for with statements post Python 3.9 - italicize a bunch of "Black"s Thank you goes to Jelle, Taneli (hukkinj1 on GH), Felix (felix-hilden on GH), and Wouter (wbolster on GH) for the feedback! * Merge remote-tracking branch 'upstream/master' into reorganize-docs-v2 merge conflicts suck, although these ones weren't too bad. * Add changelog entry + fix merge conflict resolution error I consider this important enough to be worthy of a changelog entry :) * Merge branch 'master' into reorganize-docs-v2 Co-authored-by: Łukasz Langa <lukasz@langa.pl> * Actually let's continue using prettier Prettier works fine for all of the default MyST syntax so let's not rock the boat as much. Dropping the mdformat commit was merge-conflict filled so here's additional commit instead. * Address Cooper's, Taneli's, and Jelle's feedback Lots of wording improvements by Cooper. Taneli suggested to disable the enabled by default MyST syntax not supported by Prettier and I agreed. And Jelle found one more spelling error! * More minor fixes
228 lines
9.8 KiB
Markdown
228 lines
9.8 KiB
Markdown
# The basics
|
|
|
|
Foundational knowledge on using and configuring Black.
|
|
|
|
_Black_ is a well-behaved Unix-style command-line tool:
|
|
|
|
- it does nothing if no sources are passed to it;
|
|
- it will read from standard input and write to standard output if `-` is used as the
|
|
filename;
|
|
- it only outputs messages to users on standard error;
|
|
- exits with code 0 unless an internal error occurred (or `--check` was used).
|
|
|
|
## Usage
|
|
|
|
To get started right away with sensible defaults:
|
|
|
|
```sh
|
|
black {source_file_or_directory}
|
|
```
|
|
|
|
You can run _Black_ as a package if running it as a script doesn't work:
|
|
|
|
```sh
|
|
python -m black {source_file_or_directory}
|
|
```
|
|
|
|
### Command line options
|
|
|
|
_Black_ has quite a few knobs these days, although _Black_ is opinionated so style
|
|
configuration options are deliberately limited and rarely added. You can list them by
|
|
running `black --help`.
|
|
|
|
<details>
|
|
|
|
<summary>Help output</summary>
|
|
|
|
```
|
|
Usage: black [OPTIONS] [SRC]...
|
|
|
|
The uncompromising code formatter.
|
|
|
|
Options:
|
|
-c, --code TEXT Format the code passed in as a string.
|
|
-l, --line-length INTEGER How many characters per line to allow.
|
|
[default: 88]
|
|
|
|
-t, --target-version [py27|py33|py34|py35|py36|py37|py38|py39]
|
|
Python versions that should be supported by
|
|
Black's output. [default: per-file auto-
|
|
detection]
|
|
|
|
--pyi Format all input files like typing stubs
|
|
regardless of file extension (useful when
|
|
piping source on standard input).
|
|
|
|
-S, --skip-string-normalization
|
|
Don't normalize string quotes or prefixes.
|
|
-C, --skip-magic-trailing-comma
|
|
Don't use trailing commas as a reason to
|
|
split lines.
|
|
|
|
--check Don't write the files back, just return the
|
|
status. Return code 0 means nothing would
|
|
change. Return code 1 means some files
|
|
would be reformatted. Return code 123 means
|
|
there was an internal error.
|
|
|
|
--diff Don't write the files back, just output a
|
|
diff for each file on stdout.
|
|
|
|
--color / --no-color Show colored diff. Only applies when
|
|
`--diff` is given.
|
|
|
|
--fast / --safe If --fast given, skip temporary sanity
|
|
checks. [default: --safe]
|
|
|
|
--include TEXT A regular expression that matches files and
|
|
directories that should be included on
|
|
recursive searches. An empty value means
|
|
all files are included regardless of the
|
|
name. Use forward slashes for directories
|
|
on all platforms (Windows, too). Exclusions
|
|
are calculated first, inclusions later.
|
|
[default: \.pyi?$]
|
|
|
|
--exclude TEXT A regular expression that matches files and
|
|
directories that should be excluded on
|
|
recursive searches. An empty value means no
|
|
paths are excluded. Use forward slashes for
|
|
directories on all platforms (Windows, too).
|
|
Exclusions are calculated first, inclusions
|
|
later. [default: /(\.direnv|\.eggs|\.git|\.
|
|
hg|\.mypy_cache|\.nox|\.tox|\.venv|venv|\.svn|_bu
|
|
ild|buck-out|build|dist)/]
|
|
|
|
--extend-exclude TEXT Like --exclude, but adds additional files
|
|
and directories on top of the excluded
|
|
ones (useful if you simply want to add to
|
|
the default).
|
|
|
|
--force-exclude TEXT Like --exclude, but files and directories
|
|
matching this regex will be excluded even
|
|
when they are passed explicitly as
|
|
arguments.
|
|
|
|
|
|
--stdin-filename TEXT The name of the file when passing it through
|
|
stdin. Useful to make sure Black will
|
|
respect --force-exclude option on some
|
|
editors that rely on using stdin.
|
|
|
|
-q, --quiet Don't emit non-error messages to stderr.
|
|
Errors are still emitted; silence those with
|
|
2>/dev/null.
|
|
|
|
-v, --verbose Also emit messages to stderr about files
|
|
that were not changed or were ignored due to
|
|
exclusion patterns.
|
|
|
|
--version Show the version and exit.
|
|
--config FILE Read configuration from FILE path.
|
|
-h, --help Show this message and exit.
|
|
```
|
|
|
|
</details>
|
|
|
|
## Configuration via a file
|
|
|
|
_Black_ is able to read project-specific default values for its command line options
|
|
from a `pyproject.toml` file. This is especially useful for specifying custom
|
|
`--include` and `--exclude`/`--force-exclude`/`--extend-exclude` patterns for your
|
|
project.
|
|
|
|
**Pro-tip**: If you're asking yourself "Do I need to configure anything?" the answer is
|
|
"No". _Black_ is all about sensible defaults. Applying those defaults will have your
|
|
code in compliance with many other _Black_ formatted projects.
|
|
|
|
### What on Earth is a `pyproject.toml` file?
|
|
|
|
[PEP 518](https://www.python.org/dev/peps/pep-0518/) defines `pyproject.toml` as a
|
|
configuration file to store build system requirements for Python projects. With the help
|
|
of tools like [Poetry](https://python-poetry.org/) or
|
|
[Flit](https://flit.readthedocs.io/en/latest/) it can fully replace the need for
|
|
`setup.py` and `setup.cfg` files.
|
|
|
|
### Where _Black_ looks for the file
|
|
|
|
By default _Black_ looks for `pyproject.toml` starting from the common base directory of
|
|
all files and directories passed on the command line. If it's not there, it looks in
|
|
parent directories. It stops looking when it finds the file, or a `.git` directory, or a
|
|
`.hg` directory, or the root of the file system, whichever comes first.
|
|
|
|
If you're formatting standard input, _Black_ will look for configuration starting from
|
|
the current working directory.
|
|
|
|
You can use a "global" configuration, stored in a specific location in your home
|
|
directory. This will be used as a fallback configuration, that is, it will be used if
|
|
and only if _Black_ doesn't find any configuration as mentioned above. Depending on your
|
|
operating system, this configuration file should be stored as:
|
|
|
|
- Windows: `~\.black`
|
|
- Unix-like (Linux, MacOS, etc.): `$XDG_CONFIG_HOME/black` (`~/.config/black` if the
|
|
`XDG_CONFIG_HOME` environment variable is not set)
|
|
|
|
Note that these are paths to the TOML file itself (meaning that they shouldn't be named
|
|
as `pyproject.toml`), not directories where you store the configuration. Here, `~`
|
|
refers to the path to your home directory. On Windows, this will be something like
|
|
`C:\\Users\UserName`.
|
|
|
|
You can also explicitly specify the path to a particular file that you want with
|
|
`--config`. In this situation _Black_ will not look for any other file.
|
|
|
|
If you're running with `--verbose`, you will see a blue message if a file was found and
|
|
used.
|
|
|
|
Please note `blackd` will not use `pyproject.toml` configuration.
|
|
|
|
### Configuration format
|
|
|
|
As the file extension suggests, `pyproject.toml` is a
|
|
[TOML](https://github.com/toml-lang/toml) file. It contains separate sections for
|
|
different tools. _Black_ is using the `[tool.black]` section. The option keys are the
|
|
same as long names of options on the command line.
|
|
|
|
Note that you have to use single-quoted strings in TOML for regular expressions. It's
|
|
the equivalent of r-strings in Python. Multiline strings are treated as verbose regular
|
|
expressions by Black. Use `[ ]` to denote a significant space character.
|
|
|
|
<details>
|
|
<summary>Example <code>pyproject.toml</code></summary>
|
|
|
|
```toml
|
|
[tool.black]
|
|
line-length = 88
|
|
target-version = ['py37']
|
|
include = '\.pyi?$'
|
|
extend-exclude = '''
|
|
# A regex preceded with ^/ will apply only to files and directories
|
|
# in the root of the project.
|
|
^/foo.py # exclude a file named foo.py in the root of the project (in addition to the defaults)
|
|
'''
|
|
```
|
|
|
|
</details>
|
|
|
|
### Lookup hierarchy
|
|
|
|
Command-line options have defaults that you can see in `--help`. A `pyproject.toml` can
|
|
override those defaults. Finally, options provided by the user on the command line
|
|
override both.
|
|
|
|
_Black_ will only ever use one `pyproject.toml` file during an entire run. It doesn't
|
|
look for multiple files, and doesn't compose configuration from different levels of the
|
|
file hierarchy.
|
|
|
|
## Next steps
|
|
|
|
You've probably noted that not all of the options you can pass to _Black_ have been
|
|
covered. Don't worry, the rest will be covered in a later section.
|
|
|
|
A good next step would be configuring auto-discovery so `black .` is all you need
|
|
instead of laborously listing every file or directory. You can get started by heading
|
|
over to [File collection and discovery](./file_collection_and_discovery.md).
|
|
|
|
Another good choice would be setting up an
|
|
[integration with your editor](../integrations/editors.md) of choice or with
|
|
[pre-commit for source version control](../integrations/source_version_control.md).
|