]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
projects / thirdparty / Python / cpython.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 159ae24) | patch
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request...
authorMiss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
Sun, 16 Jun 2019 07:10:06 +0000 (00:10 -0700)
committerGitHub <noreply@github.com>
Sun, 16 Jun 2019 07:10:06 +0000 (00:10 -0700)
commit45d6547acfb9ae1639adbe03dd14f38cd0642ca2
tree28e30a63d8ff5b43b22152c3a93153f97e15ae51tree | snapshot
parent159ae24895272dce5fd53dd8e54809743e4f394fcommit | diff
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)

Co-Authored-By: Tal Einat <taleinat+github@gmail.com>
(cherry picked from commit 8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668)

Co-authored-by: Rémi Lapeyre <remi.lapeyre@henki.fr>
Lib/test/test_robotparser.py diff | blob | blame | history
Lib/urllib/robotparser.py diff | blob | blame | history
Misc/NEWS.d/next/Library/2019-06-11-19-34-29.bpo-35922.rxpzWr.rst [new file with mode: 0644] blob
Mirror of https://github.com/python/cpython.git