]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
[3.13] gh-153404: Silently ignore non-decimal digits in robots.txt Crawl-delay and...
authorMiss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
Fri, 17 Jul 2026 06:12:42 +0000 (08:12 +0200)
committerGitHub <noreply@github.com>
Fri, 17 Jul 2026 06:12:42 +0000 (06:12 +0000)
commit05f0b61e6d67621c88c0cf0d900181dc1d32ca0c
tree421c6e855b24fbfa8d4e9b113baee8b9fad14c16
parent7a87bd61d608b6a159f853ffb6d76d70d68c64b7
[3.13] gh-153404: Silently ignore non-decimal digits in robots.txt Crawl-delay and Request-rate (GH-153405) (GH-153832)

str.isdigit() returned True for non-decimal Unicode digits such as
U+00B2 SUPERSCRIPT TWO, which int() then rejected with ValueError.
(cherry picked from commit 597ec2d7e5f8bbd5a1eb9e6780444cae46cec3ea)

Co-authored-by: tonghuaroot (童话) <tonghuaroot@gmail.com>
Lib/test/test_robotparser.py
Lib/urllib/robotparser.py
Misc/NEWS.d/next/Library/2026-07-09-16-35-47.gh-issue-153404.daRkes.rst [new file with mode: 0644]