]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
[3.13] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525...
authorMiss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
Sun, 5 Jul 2026 11:37:12 +0000 (13:37 +0200)
committerGitHub <noreply@github.com>
Sun, 5 Jul 2026 11:37:12 +0000 (11:37 +0000)
commitd35cfee409db4eceeaa389c206e4a18eeb6eaf9d
treedd35d2646307cf58f862cdffb6e00d85a8b6ee4e
parent18735fdbea61248919106d9d3d9428e1552ea62a
[3.13] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525) (GH-153109)

This change was accidentally reverted by f0daba1652c (gh-106693,
GH-149514), which only intended to revert the ob_sval change.
The tests were already restored by GH-149569.
(cherry picked from commit 70100b9ea0b43a95226eee45652a5735bb91e9c7)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Lib/urllib/robotparser.py
Misc/NEWS.d/next/Library/2025-09-05-20-50-35.gh-issue-79638.Y-JfaH.rst [new file with mode: 0644]