]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
[3.10] gh-133767: Fix use-after-free in the unicode-escape decoder with an error...
authorSerhiy Storchaka <storchaka@gmail.com>
Mon, 2 Jun 2025 15:55:48 +0000 (18:55 +0300)
committerGitHub <noreply@github.com>
Mon, 2 Jun 2025 15:55:48 +0000 (17:55 +0200)
commitab9893c40609935e0d40a6d2a7307ea51aec598b
tree2cdd218a54de2e1aeef6827c281c05c8a49a4e68
parentf85e71a008cf1cfeae8984c784ccbd7665e5deb9
[3.10] gh-133767: Fix use-after-free in the unicode-escape decoder with an error handler (GH-129648) (GH-133944) (GH-134345)

If the error handler is used, a new bytes object is created to set as
the object attribute of UnicodeDecodeError, and that bytes object then
replaces the original data. A pointer to the decoded data will became invalid
after destroying that temporary bytes object. So we need other way to return
the first invalid escape from _PyUnicode_DecodeUnicodeEscapeInternal().

_PyBytes_DecodeEscape() does not have such issue, because it does not
use the error handlers registry, but it should be changed for compatibility
with _PyUnicode_DecodeUnicodeEscapeInternal().
(cherry picked from commit 9f69a58623bd01349a18ba0c7a9cb1dad6a51e8e)
(cherry picked from commit 6279eb8c076d89d3739a6edb393e43c7929b429d)
(cherry picked from commit a75953b347716fff694aa59a7c7c2489fa50d1f5)
(cherry picked from commit 0c33e5baedf18ebcb04bc41dff7cfc614d5ea5fe)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
Include/cpython/bytesobject.h
Include/cpython/unicodeobject.h
Lib/test/test_codeccallbacks.py
Lib/test/test_codecs.py
Misc/NEWS.d/next/Security/2025-05-09-20-22-54.gh-issue-133767.kN2i3Q.rst [new file with mode: 0644]
Objects/bytesobject.c
Objects/unicodeobject.c
Parser/string_parser.c