bpo-39718: add TYPE_IGNORE, COLONEQUAL to py38 changes in token (GH-18598)

(cherry picked from commit c2f7eb254bee036afc8a71437ec6aac82f06a1ce)

Co-authored-by: Shantanu <hauntsaninja@users.noreply.github.com>

diff --git a/Doc/library/token.rst b/Doc/library/token.rst
index 1777929be739d1d7387e8dad2d5fc0edfb76f1a8..dab8f0fa9b64fcf348dba3044e8bfef498c63b2a 100644 (file)
--- a/Doc/library/token.rst
+++ b/Doc/library/token.rst
@@ -87,7 +87,7 @@ the :mod:`tokenize` module.
    now tokenized as :data:`NAME` tokens.
 
 .. versionchanged:: 3.8
-   Added :data:`TYPE_COMMENT`.
+   Added :data:`TYPE_COMMENT`, :data:`TYPE_IGNORE`, :data:`COLONEQUAL`.
    Added :data:`AWAIT` and :data:`ASYNC` tokens back (they're needed
    to support parsing older Python versions for :func:`ast.parse` with
    ``feature_version`` set to 6 or lower).

diff --git a/Misc/NEWS.d/next/Documentation/2020-02-21-22-05-20.bpo-39718.xtBoSi.rst b/Misc/NEWS.d/next/Documentation/2020-02-21-22-05-20.bpo-39718.xtBoSi.rst
new file mode 100644 (file)
index 0000000..8072f61
--- /dev/null
+++ b/Misc/NEWS.d/next/Documentation/2020-02-21-22-05-20.bpo-39718.xtBoSi.rst
@@ -0,0 +1 @@
+Update :mod:`token` documentation to reflect additions in Python 3.8
\ No newline at end of file