single: World Wide Web
single: URL
single: robots.txt
+
+.. note::
+ The :mod:`robotparser` module has been renamed :mod:`urllib.robotparser` in
+ Python 3.0.
+ The :term:`2to3` tool will automatically adapt imports when converting
+ your sources to 3.0.
This module provides a single class, :class:`RobotFileParser`, which answers
questions about whether or not a particular user agent can fetch a URL on the
Documentation
-------------
+- Document that robotparse has been renamed to urllib.robotparser in
+ Python 3.0.
+
- Document that urlparse has been renamed to urllib.parse in Python 3.0.
- Document that urllib2 is split across multiple modules and renamed in