From: Benjamin Peterson <benjamin@python.org>
Date: Sat, 13 Aug 2011 05:33:21 +0000 (-0500)
Subject: tokenize is just broken on test_pep3131.py
X-Git-Tag: v3.2.2rc1~4
X-Git-Url: http://git.ipfire.org/gitweb.cgi?a=commitdiff_plain;h=963e40256a7047c538eca88a792710c2d6d53ac5;p=thirdparty%2FPython%2Fcpython.git

tokenize is just broken on test_pep3131.py
---

diff --git a/Lib/test/test_tokenize.py b/Lib/test/test_tokenize.py
index d30d5eed094c..9e9656ced60a 100644
--- a/Lib/test/test_tokenize.py
+++ b/Lib/test/test_tokenize.py
@@ -520,6 +520,9 @@ pass the '-ucpu' option to process the full directory.
     >>> tempdir = os.path.dirname(f) or os.curdir
     >>> testfiles = glob.glob(os.path.join(tempdir, "test*.py"))
 
+tokenize is broken on test_pep3131.py because regular expressions are broken on
+the obscure unicode identifiers in it. *sigh*
+    >>> testfiles.remove(os.path.join(tempdir, "test_pep3131.py"))
     >>> if not support.is_resource_enabled("cpu"):
     ...     testfiles = random.sample(testfiles, 10)
     ...