]> granicus.if.org Git - python/commit
projects / python / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: c2745d2) | patch
bpo-12486: Document tokenize.generate_tokens() as public API (#6957)
authorThomas Kluyver <takowl@gmail.com>
Tue, 5 Jun 2018 17:26:39 +0000 (19:26 +0200)
committerCarol Willing <carolcode@willingconsulting.com>
Tue, 5 Jun 2018 17:26:39 +0000 (10:26 -0700)
commitc56b17bd8c7a3fd03859822246633d2c9586f8bd
tree346fb8b3a6614679232792b3f46398b33e5f3c0etree | snapshot
parentc2745d2d05546d76f655ab450eb23d1af39e0b1ccommit | diff
bpo-12486: Document tokenize.generate_tokens() as public API (#6957)

* Document tokenize.generate_tokens()

* Add news file

* Add test for generate_tokens

* Document behaviour around ENCODING token

* Add generate_tokens to __all__
Doc/library/tokenize.rst diff | blob | history
Lib/test/test_tokenize.py diff | blob | history
Lib/tokenize.py diff | blob | history
Misc/NEWS.d/next/Library/2018-05-17-22-14-58.bpo-12486.HBeh62.rst [new file with mode: 0644] blob
Unnamed repository; edit this file 'description' to name the repository.