]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)
authorMiss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
Wed, 12 Feb 2020 10:35:10 +0000 (02:35 -0800)
committerGitHub <noreply@github.com>
Wed, 12 Feb 2020 10:35:10 +0000 (02:35 -0800)
commitefd878cdb46d9c7038d93fb36eb1ff7dc5baf9ec
tree25eaf1cdfc0890bc3bc3c8bf71748e6750836ff7
parent0b8f738eb3ee0110461e7da28c0b6b452f91999d
bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)

* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
(cherry picked from commit 0cc6b5e559b8303b18fdd56c2befd900fe7b5e35)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
Lib/test/test_exceptions.py
Misc/NEWS.d/next/Core and Builtins/2020-01-05-13-36-08.bpo-39219.uHtKd4.rst [new file with mode: 0644]
Parser/tokenizer.c