]> granicus.if.org Git - python/commit
Bug 3347: robotparser failed because it didn't convert bytes to string.
authorJeremy Hylton <jeremy@alum.mit.edu>
Fri, 18 Jul 2008 20:59:44 +0000 (20:59 +0000)
committerJeremy Hylton <jeremy@alum.mit.edu>
Fri, 18 Jul 2008 20:59:44 +0000 (20:59 +0000)
commit73fd46d24e45c34f0fb87261e5471584a7c273df
treecf36eca08149e5fe933a90b71e7b3b3a1521305a
parent48577d1944c6b03be12bd7b144eb22db6bd6d296
Bug 3347: robotparser failed because it didn't convert bytes to string.

The solution is to convert bytes to text via utf-8.  I'm not entirely
sure if this is safe, but it looks like robots.txt is expected to be
ascii.
Lib/test/test_robotparser.py
Lib/urllib/robotparser.py