]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
gh-153404: Silently ignore non-decimal digits in robots.txt Crawl-delay and Request...
authortonghuaroot (童话) <tonghuaroot@gmail.com>
Fri, 17 Jul 2026 05:54:46 +0000 (13:54 +0800)
committerGitHub <noreply@github.com>
Fri, 17 Jul 2026 05:54:46 +0000 (05:54 +0000)
commit597ec2d7e5f8bbd5a1eb9e6780444cae46cec3ea
tree87110bcba2696dcfbd72d6ebd493034b8055180d
parentf62050d65743f0c895f7e6d665936c4e86aa39d5
gh-153404: Silently ignore non-decimal digits in robots.txt Crawl-delay and Request-rate (GH-153405)

str.isdigit() returned True for non-decimal Unicode digits such as
U+00B2 SUPERSCRIPT TWO, which int() then rejected with ValueError.
Lib/test/test_robotparser.py
Lib/urllib/robotparser.py
Misc/NEWS.d/next/Library/2026-07-09-16-35-47.gh-issue-153404.daRkes.rst [new file with mode: 0644]