From: Tal Einat Date: Wed, 24 Oct 2018 07:32:37 +0000 (+0300) Subject: [3.6] bpo-33899: Mention tokenize behavior change in What's New (GH-10073) (GH-10075) X-Git-Tag: v3.6.8rc1~187 X-Git-Url: http://git.ipfire.org/cgi-bin/gitweb.cgi?a=commitdiff_plain;h=9a0476283393f9988d0946491052d7724a7f9d21;p=thirdparty%2FPython%2Fcpython.git [3.6] bpo-33899: Mention tokenize behavior change in What's New (GH-10073) (GH-10075) (cherry picked from commit dfba1f67e7f1381ceb7cec8fbcfa37337620a9b0) https://bugs.python.org/issue33899 --- diff --git a/Doc/whatsnew/3.6.rst b/Doc/whatsnew/3.6.rst index 96a8831cd6ff..009584428fc1 100644 --- a/Doc/whatsnew/3.6.rst +++ b/Doc/whatsnew/3.6.rst @@ -2433,3 +2433,8 @@ Notable changes in Python 3.6.7 :mod:`xml.dom.minidom` and mod:`xml.sax` modules no longer process external entities by default. See also :issue:`17239`. + +In 3.6.7 the :mod:`tokenize` module now implicitly emits a ``NEWLINE`` token +when provided with input that does not have a trailing new line. This behavior +now matches what the C tokenizer does internally. +(Contributed by Ammar Askar in :issue:`33899`.)