]> granicus.if.org Git - python/commit
normalize latin-1 and utf-8 variant encodings like the builtin tokenizer does
authorBenjamin Peterson <benjamin@python.org>
Fri, 9 Oct 2009 21:43:09 +0000 (21:43 +0000)
committerBenjamin Peterson <benjamin@python.org>
Fri, 9 Oct 2009 21:43:09 +0000 (21:43 +0000)
commitd3afadaa4908df544e0181c11199e59b1bfb5c37
tree5b214ec4a85f64411b50dd40499bf9a7691d4a5f
parentffc08fcad6d91a50224914e94eae6505b2e55548
normalize latin-1 and utf-8 variant encodings like the builtin tokenizer does
Lib/test/test_tokenize.py
Lib/tokenize.py
Misc/NEWS