]> granicus.if.org Git - python/commit
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request...
authorRémi Lapeyre <remi.lapeyre@henki.fr>
Sun, 16 Jun 2019 06:48:57 +0000 (08:48 +0200)
committerTal Einat <taleinat@gmail.com>
Sun, 16 Jun 2019 06:48:57 +0000 (09:48 +0300)
commit8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668
tree7b22a0fce0ff2d1170bfbbc41f929bcc8d68fc9f
parent3a1d50e7e573efb577714146bed5c03b9c95f466
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)

Co-Authored-By: Tal Einat <taleinat+github@gmail.com>
Lib/test/test_robotparser.py
Lib/urllib/robotparser.py
Misc/NEWS.d/next/Library/2019-06-11-19-34-29.bpo-35922.rxpzWr.rst [new file with mode: 0644]