]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
[3.15] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525...
authorMiss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
Sun, 5 Jul 2026 11:44:44 +0000 (13:44 +0200)
committerGitHub <noreply@github.com>
Sun, 5 Jul 2026 11:44:44 +0000 (11:44 +0000)
commit2a5f9e0e24f270c77d0eb11b69fe99e6c8aecd8f
tree9aa8db4947229ef56f0dc4c29c79380691a6466e
parent0416fcd7cf454b3b8d87467f3b6442a647136a1a
[3.15] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525) (GH-153107)

This change was accidentally reverted by f0daba1652c (gh-106693,
GH-149514), which only intended to revert the ob_sval change.
The tests were already restored by GH-149569.
(cherry picked from commit 70100b9ea0b43a95226eee45652a5735bb91e9c7)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Lib/urllib/robotparser.py
Misc/NEWS.d/next/Library/2025-09-05-20-50-35.gh-issue-79638.Y-JfaH.rst [new file with mode: 0644]