]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)
authorSerhiy Storchaka <storchaka@gmail.com>
Wed, 12 Feb 2020 10:17:00 +0000 (12:17 +0200)
committerGitHub <noreply@github.com>
Wed, 12 Feb 2020 10:17:00 +0000 (12:17 +0200)
commit0cc6b5e559b8303b18fdd56c2befd900fe7b5e35
treeff67b4924030ac8600837f8aea60bb5eb48473ad
parentf4f445b69306c68a2ba8ce8eb8c6cb3064db5fe7
bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)

* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
Lib/test/test_exceptions.py
Misc/NEWS.d/next/Core and Builtins/2020-01-05-13-36-08.bpo-39219.uHtKd4.rst [new file with mode: 0644]
Parser/tokenizer.c