]> granicus.if.org Git - python/commit
Merged revisions 75299 via svnmerge from
authorBenjamin Peterson <benjamin@python.org>
Fri, 9 Oct 2009 21:53:27 +0000 (21:53 +0000)
committerBenjamin Peterson <benjamin@python.org>
Fri, 9 Oct 2009 21:53:27 +0000 (21:53 +0000)
commit0c7f9c96f5fbe8c445ccd3e2ee315f2e2f45a3ca
tree0deb207baf2fc47748cb82897cbb5bb445a26dba
parentae2fa6fad26cbbef8ad408b4f5188d2a7a9f8c89
Merged revisions 75299 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/branches/py3k

........
  r75299 | benjamin.peterson | 2009-10-09 16:43:09 -0500 (Fri, 09 Oct 2009) | 1 line

  normalize latin-1 and utf-8 variant encodings like the builtin tokenizer does
........
Lib/test/test_tokenize.py
Lib/tokenize.py
Misc/NEWS