]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
projects / thirdparty / Python / cpython.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: fbba343) | patch
gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555)
authorSerhiy Storchaka <storchaka@gmail.com>
Thu, 7 May 2026 19:06:57 +0000 (22:06 +0300)
committerGitHub <noreply@github.com>
Thu, 7 May 2026 19:06:57 +0000 (22:06 +0300)
commit310fe88994249a5a02e20d1211b8fc067e34aa78
treeb63c3500395b737850b61091c2a5b1217ef95200tree | snapshot
parentfbba343622c9e4a38c8ef0f0b0e311164394d76acommit | diff
gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555)

Disallow all access in urllib.robotparser if the robots.txt file is
unreachable due to server or network errors.
Lib/test/test_robotparser.py diff | blob | blame | history
Lib/urllib/robotparser.py diff | blob | blame | history
Misc/NEWS.d/next/Library/2025-09-05-20-50-35.gh-issue-79638.Y-JfaH.rst [new file with mode: 0644] blob
Mirror of https://github.com/python/cpython.git