[3.8] bpo-39828: Fix json.tool to catch BrokenPipeError (GH-18779). (GH-18894)

(cherry picked from commit 700cb587303461d5a96456c56902cfdd8ad50e2d)

Co-authored-by: Dong-hee Na <donghee.na92@gmail.com>
Automerge-Triggered-By: @vstinner

bpo-27115: Use Query subclass for IDLE editor Goto (GH-18871)

Replace tkinter tkSimpleDialog.askinteger with a standard IDLE query dialog.
The new box checks for positivity before returning.
(cherry picked from commit 363fab83b8a0e6d924c7a7c577feec6a2812bb8c)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

bpo-36184: Port python-gdb.py to FreeBSD (GH-18873)

python-gdb.py now checks for "take_gil" function name to check if a
frame tries to acquire the GIL, instead of checking for
"pthread_cond_timedwait" which is specific to Linux and can be a
different condition than the GIL.
(cherry picked from commit 6d0ee60740f2862a878f009671b1aaa75aeb0c2a)

Co-authored-by: Victor Stinner <vstinner@python.org>

[3.8] bpo-39850: Add support for abstract sockets in multiprocessing (GH-18866) (GH-18876)

(cherry picked from commit 6012f30beff7fa8396718dfb198ccafc333c565b)

bpo-39903: Fix double decref in _elementtree.Element.__getstate__ (GH-18850)

(cherry picked from commit 88944a44aa84b0f3674939019b1befbc7a9dc874)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

bpo-27115: Move IDLE Query error blanking (GH-18868)

Move required blanking of error text to non-overridden entry_ok().
(Omit news item.)
(cherry picked from commit e53a3932cb01683b0fa8a7448ca25a2e658c39e6)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

bpo-39517: Allow runpy.run_path() to accept path-like objects (GH-18699)

(cherry picked from commit 0911ea5c172264eaefa3efe4a1788159c160920d)

Co-authored-by: Maor Kleinberger <kmaork@gmail.com>

bpo-39885: IDLE context menu clears selection  (GH-18859)

Since clicking to get an IDLE context menu moves the cursor,
any text selection should be and now is cleared.
(cherry picked from commit 4ca060d8ad7c6df1fd4df30f9a14f6aa35380c09)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

bpo-39852: IDLE 'Go to line' deletes selection, updates status (GH-18801)

It appears standard that moving the text insert cursor away from a selection clears the
selection.  Clearing prevents accidental deletion of a possibly off-screen bit of text.
The update is for Ln and Col on the status bar.
(cherry picked from commit 2522db11df102be3baf25ce9e816ebe8ffdb7fcc)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

fix typo: add space (GH-18853)

Fix typo in cmdline.rst
Add space between the `-m` option and the module name (`timeit`).
(cherry picked from commit c580981ba01c4d9f721dbdd88208ba37704e0217)

Co-authored-by: Julin S <48789920+ju-sh@users.noreply.github.com>

bpo-38894: Fix pathlib.Path.glob in the presence of symlinks and insufficient permissions (GH-18815)

Co-authored-by: Matt Wozniski <mwozniski@bloomberg.net>
(cherry picked from commit eb7560a73d46800e4ade4a8869139b48e6c92811)

Co-authored-by: Pablo Galindo <Pablogsal@gmail.com>

[3.8] bpo-39889: Fix unparse.py for subscript. (GH-18824). (GH-18826)

(cherry picked from commit c4928fc1a853f3f84e2b4ec1253d0349137745e5)

bpo-39837: Disable macOS tests on Azure Pipelines (GH-18818)

(cherry picked from commit 31350f9af09dcff7cf6ff4b0a0a7ea595942372e)

Co-authored-by: Steve Dower <steve.dower@python.org>

bpo-17422: slightly more precise language (GH-18682)

(cherry picked from commit e59334ebc9308b0f3ad048ef293c6b49e6456d1a)

Co-authored-by: Caleb Donovick <cdonovick@users.noreply.github.com>

bpo-39868: Update Language Reference for PEP 572. (GH-18793)

(cherry picked from commit 8bae21962bab2fac7630982abd73676b89930902)

Co-authored-by: Brandt Bucher <brandtbucher@gmail.com>

IDLE doc: improve Startup failure subsection. (GH-18771)

Eliminate repeat of 'Options', reported by Jules Lasne, and improve wording elsewhere.

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>
(cherry picked from commit ce305d641074931e4e790f7a83e28f74910644e5)

Co-authored-by: Jules Lasne (jlasne) <jules.lasne@gmail.com>

[3.8] bpo-39808: Improve docs for pathlib.Path.stat() (GH-18719) (GH-18783)

(cherry picked from commit 67152d0ed670227b61b5df683655b196ab04ca1a)

Co-authored-by: Brett Cannon <54418+brettcannon@users.noreply.github.com>
Automerge-Triggered-By: @brettcannon

bpo-13487: Use sys.modules.copy() in inspect.getmodule() for thread safety. (GH-18786)

`list(sys.modules.items())` was apparently not immune to "dictionary
changed size during iteration" errors.

Tested internally using an integration test that has run into this a couple of times in the past two years.  With this patch applied, the test is no longer flaky.
(cherry picked from commit 85cf1d514b84dc9a4bcb40e20a12e1d82ff19f20)

Co-authored-by: Gregory P. Smith <gps@google.com>

Add a missing space after a period in 'typing.TypedDict' documentation (GH-18784)

(cherry picked from commit d4a09c13ddd91a9bc1b4ba76ff4e8a153334a1e2)

Co-authored-by: Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>

Fix misleading statement about mixed-type numeric comparisons (GH-18615) (#18773)

(cherry picked from commit 9f1cb1bb49476246de5d9ed5fe680301cf7f7571)

Co-authored-by: Mark Dickinson <mdickinson@enthought.com>
Co-authored-by: Mark Dickinson <dickinsm@gmail.com>

bpo-39831: Remove outdated comment. (GH-18764)

(cherry picked from commit ae75a294352e9b9487f5dc8e88f068e7e6974dc2)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

bpo-39674: Update collections ABC deprecation doc (GH-18748)

 bpo-39776: Lock ++interp->tstate_next_unique_id. (GH-18746) (#18746) (#18752)

- Threads created by PyGILState_Ensure() could have a duplicate tstate->id.

(cherry picked from commit b3b9ade4a3d3fe00d933bcd8fc5c5c755d1024f9)

bpo-39778: Add clarification about tp_traverse and ownership (GH-18754)

Automerge-Triggered-By: @pablogsal
(cherry picked from commit 6df421fe87a9418d6c59f89dbc5d5573b6826855)

Co-authored-by: Pablo Galindo <Pablogsal@gmail.com>

[3.8] bpo-39831: Fix a reference leak in PyErr_WarnEx(). (GH-18750) (GH-18761)

(cherry picked from commit 2d2f855)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

bpo-38597: Never statically link extension initialization code on Windows (GH-18724)

(cherry picked from commit ce3a4984089b8e0ce5422ca32d75ad057b008074)

Co-authored-by: Steve Dower <steve.dower@python.org>

[3.8] bpo-39778: Don't traverse weak-reference lists OrderedDict's tp_traverse and tp_clear (GH-18749) (GH-18756)

Objects do not own weak references to them directly through the __weakref__ list so these
do not need to be traversed by the GC.

(cherry picked from commit 0c2b509)

bpo-38380: Update macOS & Windows builds to SQLite v3.31.1 (GH-18678)

Automerge-Triggered-By: @zooba
(cherry picked from commit 1382c3289bcfd34ac6811fdf9aa5bc09ca8c320e)

Co-authored-by: Erlend Egeberg Aasland <erlend.aasland@innova.no>

bpo-39764: Make Task.get_stack accept ag_frame (GH-18669)

Co-authored-by: blurb-it[bot] <43283697+blurb-it[bot]@users.noreply.github.com>
(cherry picked from commit 4482337decdbd0c6e2150346a68b3616bda664aa)

Co-authored-by: Lidi Zheng <scallopsky@gmail.com>

bpo-38971: Open file in codecs.open() closes if exception raised. (GH-17666)

Open issue in the BPO indicated a desire to make the implementation of
codecs.open() at parity with io.open(), which implements a try/except to
assure file stream gets closed before an exception is raised.
(cherry picked from commit 2565edec2c974b2acca03b4cc5025e83f903ddd7)

Co-authored-by: Chris A <christopher.aporta@gmail.com>

bpo-38410: Properly handle PySys_Audit() failures (GH-18658)

_PyEval_SetAsyncGenFinalizer() and _PyEval_SetAsyncGenFirstiter()
didn't include proper error handling for their PySys_Audit() calls.

Co-authored-by: Zackery Spytz <zspytz@gmail.com>

[3.8] bpo-38913: Fix segfault in Py_BuildValue("(sGH-O)", ...) if entered with exception raised. (GH-18656). (GH-18732)

(cherry picked from commit 28d0bcac8b7e6dbd28311f1283dabb6a4d649fcb)

bpo-39378: partial of PickleState struct should be traversed. (GH-18046)

(cherry picked from commit 1f577ce363121d590b51abf5c41d1bcf3d751436)

Co-authored-by: Hai Shi <shihai1992@gmail.com>

[3.8] bpo-39815: add cached_property to all (GH-18726) (GH-18728)

Automerge-Triggered-By: @pablogsal.
(cherry picked from commit 217dce9ee6e3cf27a0cedbe1e4a6455776373ec2)

Co-authored-by: Hakan Çelik <hakancelik96@outlook.com>

bpo-39769: Fix compileall ddir for subpkgs. (GH-18676) (GH-18718)

Fix compileall.compile_dir() ddir= behavior on sub-packages.

Fixes compileall.compile_dir's ddir parameter and compileall command
line flag `-d` to no longer write the wrong pathname to the generated
pyc file for submodules beneath the root of the directory tree being
compiled.  This fixes a regression introduced with Python 3.5.

Tests backported from GH 02673352b5db6ca4d3dc804965facbedfe66425d, the
implementation is different due to intervening code changes.  But still
quiet simple.

Why was the bug ever introduced?  The refactoring to add parallel
execution kept the ddir -> dfile computations but discarded the results
instead of sending them to compile_file().  This fixes that.  Lack of tests
meant this went unnoticed.

[3.8] Explicitly initialize like the surrounding code (GH-18717)

[3.8] Fix syntax (GH-18716)

[3.8] bpo-39794: Add --without-decimal-contextvar (GH-18702)

(cherry picked from commit 815280eb160af637e1347213659f9236adf78f80)

bpo-39548: Fix handling of 'WWW-Authenticate' header for Digest Auth (GH-18338)

* bpo-39548: Fix handling of 'WWW-Authenticate' header for Digest authentication

 - The 'qop' value in the 'WWW-Authenticate' header is optional. The
   presence of 'qop' in the header should be checked before its value
   is parsed with 'split'.

Signed-off-by: Stephen Balousek <stephen@balousek.net>
* bpo-39548: Fix handling of 'WWW-Authenticate' header for Digest authentication

 - Add NEWS item

Signed-off-by: Stephen Balousek <stephen@balousek.net>
* Update Misc/NEWS.d/next/Library/2020-02-06-05-33-52.bpo-39548.DF4FFe.rst

Co-Authored-By: Brandt Bucher <brandtbucher@gmail.com>
Co-authored-by: Brandt Bucher <brandtbucher@gmail.com>
(cherry picked from commit 5e260e0fde211829fcb67060cfd602f4b679f802)

Co-authored-by: Stephen Balousek <sbalousek@users.noreply.github.com>

bpo-39789: Update Windows release build machines to VS 2019 (GH-18695)

Also fixes some potential Nuget build issues.
(cherry picked from commit 03153dd1459fab94f294a118ed1525e34d58601a)

Co-authored-by: Steve Dower <steve.dower@python.org>

bpo-39718: add TYPE_IGNORE, COLONEQUAL to py38 changes in token (GH-18598)

(cherry picked from commit c2f7eb254bee036afc8a71437ec6aac82f06a1ce)

Co-authored-by: Shantanu <hauntsaninja@users.noreply.github.com>

bpo-13790: Change 'string' to 'specification' in format doc (GH-18690)

(cherry picked from commit 916895f93905f8b8dad677cceff501833f5a633a)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

bpo-39781: Do not jump when select in IDLE codecontext (GH-18683)

Previously, the button-up part of selecting with a mouse was treated as a click
that meant 'jump' to this line, which modified the context and undid the selection
(cherry picked from commit c705fd1e89ccb8f6d414ec817b4616546147d877)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

bpo-39699: Don't silence make on Azure and Github CIs (GH-18583)

Co-authored-by: Ammar Askar <ammar_askar@hotmail.com>

Doc: int -> int or Py_ssize_t (GH-18663)

(cherry picked from commit 57c7a0bdf4f7da8cf47f797f075950f6b8c98b99)

Co-authored-by: Inada Naoki <songofacandy@gmail.com>

bpo-38403: Update nuspec file for deprecated field and git repository (GH-18657)

(cherry picked from commit d6448919702142123d937a54f20a81aeaf8d2acc)

Co-authored-by: Steve Dower <steve.dower@python.org>

Post 3.8.2

Merge tag 'v3.8.2' into 3.8

Python 3.8.2

bpo-30566: Fix IndexError when using punycode codec (GH-18632)

Trying to decode an invalid string with the punycode codec
shoud raise UnicodeError.

(cherry picked from commit ba22e8f174309979d90047c5dc64fcb63bc2c32e)

Co-authored-by: Berker Peksag <berker.peksag@gmail.com>

Python 3.8.2

bpo-39128: Added algorithm description (GH-18624)

GH- [bpo-39128](https://bugs.python.org/issue39128): happy eyeballs description

GH- [3.9] 39128 - happy eyeballs description (GH-18624)
GH- [3.8] 39128 - happy eyeballs description (GH-18624)

https://bugs.python.org/issue39128
(cherry picked from commit 8af4712a16e4b7d1b60f1faec13cd7a88da95f6a)

Co-authored-by: idomic <michael.ido@gmail.com>

Add note to Mac installer ReadMe about macOS 10.15 Gatekeeper changes. (GH-18647)

Give proper credit for figuring out and writing PEP-3118 tests. (GH-18644) (#18646)

(cherry picked from commit b942ba03b8530f26240d4e36567d2ff42d701420)

Authored-by: Stefan Krah <skrah@bytereef.org>

Give proper credits for the memoryview implementation. (GH-18626) (#18642)

(cherry picked from commit ee3bac4cba56b51ce924f13d77b97131eec1a865)

Authored-by: Stefan Krah <skrah@bytereef.org>

bpo-39649: Remove obsolete check for `__args__` in bdb.Bdb.format_stack_entry (GH-18531)

Appears to be obsolete since 75bb54c3d8.

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>
(cherry picked from commit 4015d1cda3cdba869103779eb6ff32ad798ff885)

Co-authored-by: Daniel Hahler <git@thequod.de>

bpo-39654: Update pyclbr doc to reflect additional information returned (GH-18528)

Full nested function and class info makes it a module browser.

Co-authored-by: blurb-it[bot] <43283697+blurb-it[bot]@users.noreply.github.com>
Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>
(cherry picked from commit aea045adb8c90394264908670cbc495c5a41b65e)

Co-authored-by: Hakan Çelik <hakancelik96@outlook.com>

bpo-39681: Fix C pickle regression with minimal file-like objects (GH-18592) (#18630)

Fix a regression where the C pickle module wouldn't allow unpickling from a
file-like object that doesn't expose a readinto() method.
(cherry picked from commit 9f37872e307734666a7169f7be6e3370d3068282)

Co-authored-by: Antoine Pitrou <antoine@python.org>
Co-authored-by: Antoine Pitrou <pitrou@free.fr>

[3.8] bpo-39427: Document -X opt options in the CLI --help and the man page (GH-18131) (GH-18133)

https://bugs.python.org/issue39427

Automerge-Triggered-By: @pablogsal
(cherry picked from commit 41f0ef6abbd304409c55612a08788cdd59fbc8a3)

Co-authored-by: Pablo Galindo <Pablogsal@gmail.com>

bpo-39576: Clarify the word size for the 32-bit build. (GH-18616) (#18618)

(cherry picked from commit b76518d43fb82ed9e5d27025d18c90a23d525c90)

Authored-by: Stefan Krah <skrah@bytereef.org>

bpo-17422: Language reference should specify restrictions on class namespace (GH-18559)

The language reference now specifies restrictions on class namespaces.  Adapted from a patch by Ethan Furman.
(cherry picked from commit fbe2e0bb8a7ee75d0f9d57682436dac7d69e202e)

Co-authored-by: ananthan-123 <ananthakrishnan15.2001@gmail.com>

bpo-39382: Avoid dangling object use in abstract_issubclass() (GH-18530)

Hold reference of __bases__ tuple until tuple item is done with, because by
dropping the reference the item may be destroyed.
(cherry picked from commit 1c56f8ffad44478b4214a2bf8eb7cf51c28a347a)

Co-authored-by: Yonatan Goldschmidt <yon.goldschmidt@gmail.com>

bpo-39576: docs: set context for decimal arbitrary precision arithmetic (GH-18594) (#18597)

(cherry picked from commit a025d4ca99fb4c652465368e0b4eb03cf4b316b9)

Authored-by: Stefan Krah <skrah@bytereef.org>

fix(doc): set correct RST syntax for c:function (GH-18589)

The current content is not rendered since the syntax is not correct.
(cherry picked from commit d4d17fd2cf69e7c8f4cd03fbf2d575370945b952)

Co-authored-by: Julien Danjou <julien@danjou.info>

bpo-38657: Clarify numeric padding behaviour in string formatting (GH-17036)

Make the definition of the width more explicit that it includes any
extra signs added by other options.

https://bugs.python.org/issue38657

Automerge-Triggered-By: @Mariatta
(cherry picked from commit 424e5686d82235e08f8108b8bbe034bc91421689)

Co-authored-by: Pete Wicken <2273100+JamoBox@users.noreply.github.com>

bpo-39576: Prevent memory error for overly optimistic precisions (GH-18581) (#18584)

(cherry picked from commit 90930e65455f60216f09d175586139242dbba260)

Authored-by: Stefan Krah <skrah@bytereef.org>

bpo-39184: Fix incorrect return value (GH-18580)

https://bugs.python.org/issue39184

Automerge-Triggered-By: @zooba
(cherry picked from commit 6c444d0dab8f06cf304263b34beb299101cef3de)

Co-authored-by: Steve Dower <steve.dower@python.org>

Valgrind no longer supports --db-attach=yes. (GH-18568) (#18576)

(cherry picked from commit c0cb8beb389da3ba67ad31b1ecc95e100b6292ab)

Co-authored-by: Stefan Krah <skrah@bytereef.org>
Co-authored-by: Stefan Krah <skrah@bytereef.org>

Use the new recommended number of repetitions in the refleak tests. (GH-18569) (#18574)

(cherry picked from commit 1246d892038a693304549f8574e6c2784b91589a)

Co-authored-by: Stefan Krah <skrah@bytereef.org>
Co-authored-by: Stefan Krah <skrah@bytereef.org>

Update runall.bat to the latest Windows build system. (GH-18571) (#18573)

(cherry picked from commit 9b833e00e447a3b8b6966686bff701f549c66263)

Co-authored-by: Stefan Krah <skrah@bytereef.org>
Co-authored-by: Stefan Krah <skrah@bytereef.org>

bpo-39572: Document ’total’ flag of TypedDict (GH-18554)

(cherry picked from commit ab6423fe2de0ed5f8a0dc86a9c7070229326b0f0)

Co-authored-by: ananthan-123 <ananthakrishnan15.2001@gmail.com>

bpo-39555: Fix distutils test to handle _d suffix on Windows debug build (GH-18357) (GH-18548)

https://bugs.python.org/issue39555

Co-authored-by: Steve Dower <steve.dower@python.org>
(cherry picked from commit ab0d892288f3058856a8213333e8c3e4ed8a562b)

bpo-39432: Implement PEP-489 algorithm for non-ascii "PyInit_*" symbol names in distutils (GH-18150) (GH-18546)

Make it export the correct init symbol also on Windows.

https://bugs.python.org/issue39432
(cherry picked from commit 9538bc9185e934bee2bd5ae2cda2b2e92a61906d)

Co-authored-by: Stefan Behnel <stefan_ml@behnel.de>

Post 3.8.2rc2

Merge tag 'v3.8.2rc2' into 3.8

Python 3.8.2rc2

[3.8] bpo-39546: argparse: Honor allow_abbrev=False for specified prefix_chars (GH-18337) (GH-18543)

When `allow_abbrev` was first added, disabling the abbreviation of
long options broke the grouping of short flags ([bpo-26967](https://bugs.python.org/issue26967)).  As a fix,
b1e4d1b603 (contained in v3.8) ignores `allow_abbrev=False` for a
given argument string if the string does _not_ start with "--"
(i.e. it doesn't look like a long option).

This fix, however, doesn't take into account that long options can
start with alternative characters specified via `prefix_chars`,
introducing a regression: `allow_abbrev=False` has no effect on long
options that start with an alternative prefix character.

The most minimal fix would be to replace the "starts with --" check
with a "starts with two prefix_chars characters".  But
`_get_option_tuples` already distinguishes between long and short
options, so let's instead piggyback off of that check by moving the
`allow_abbrev` condition into `_get_option_tuples`.

https://bugs.python.org/issue39546
(cherry picked from commit 8edfc47baec7ff4cb1b9db83dd35c8ffc1d498a4)

Co-authored-by: Kyle Meyer <kyle@kyleam.com>
https://bugs.python.org/issue39546

Automerge-Triggered-By: @encukou

bpo-39663: IDLE: Add additional tests for pyparse (GH-18536)

Test when find_good_parse_start should return 0.

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>
(cherry picked from commit ffda25f6b825f3dee493b6f0746266a4dd6989f0)

Co-authored-by: Cheryl Sabella <cheryl.sabella@gmail.com>

Python 3.8.2rc2

[3.8] bpo-39453: Fix contains method of list to hold strong references (GH-18204)

bpo-32892: Update the documentation for handling constants in AST. (GH-18514)

(cherry picked from commit 85a2eef473a2c9ed3ab9c6ee339891fe99adbbc9)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

Revert "[3.8] bpo-27657: Fix urlparse() with numeric paths (GH-16839)" (GH-18525)

This reverts commit 0f3187c1ce3b3ace60f6c1691dfa3d4e744f0384.

The change broke the backwards compatibility of parsing behavior in a
patch release of Python (3.8.1). A decision was taken to revert this
patch in 3.8.2.

In https://bugs.python.org/issue27657 it was decided that the previous
behavior like

>>> urlparse('localhost:8080')
ParseResult(scheme='', netloc='', path='localhost:8080', params='', query='', fragment='')

>>> urlparse('undefined:8080')
ParseResult(scheme='', netloc='', path='undefined:8080', params='', query='', fragment='')

needs to be preserved in patch releases as number of users rely upon it.

Explicitly mention the releases involved with the revert in NEWS.
Adopt the wording suggested by @ned-deily.

[3.8] closes bpo-39630: Update pointers to string literals to be const char *. (GH-18511)

(cherry picked from commit 7386a70746cf9aaf2d95db75d9201fb124f085df)

Co-authored-by: Andy Lester <andy@petdance.com>

closes bpo-39619 Fix os.chroot on HP-UX 11.31 (GH-18495)

Setting `-D_XOPEN_SOURCE=700` on HP-UX causes system functions such as chroot to be undefined.  This change stops `_XOPEN_SOURCE` begin set on HP-UX

Co-authored-by: Benjamin Peterson <benjamin@python.org>
(cherry picked from commit a9edf44a2de9b23a1690b36cdfeed7b41ab763bd)

Co-authored-by: Ian Norton <inorton@gmail.com>

bpo-39545: Document changes in the support of await in f-strings. (GH-18456)

https://bugs.python.org/issue39545
(cherry picked from commit f632736023502816f2e6bd714d1b48c81aa2ccc1)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

[3.8] bpo-39606: allow closing async generators that are already closed (GH-18475) (GH-18501)

The fix for [bpo-39386](https://bugs.python.org/issue39386) attempted to make it so you couldn't reuse a
agen.aclose() coroutine object. It accidentally also prevented you
from calling aclose() at all on an async generator that was already
closed or exhausted. This commit fixes it so we're only blocking the
actually illegal cases, while allowing the legal cases.

The new tests failed before this patch. Also confirmed that this fixes
the test failures we were seeing in Trio with Python dev builds:
  https://github.com/python-trio/trio/pull/1396

https://bugs.python.org/issue39606
(cherry picked from commit 925dc7fb1d0db85dc137afa4cd14211bf0d67414)

Co-authored-by: Nathaniel J. Smith <njs@pobox.com>
https://bugs.python.org/issue39606

Automerge-Triggered-By: @njsmith

bpo-39184: Add audit events to functions in `fcntl`, `msvcrt`, `os`, `resource`,  `shutil`, `signal`, `syslog` (GH-18407)

Co-authored-by: Saiyang Gou <gousaiyang@163.com>

closes bpo-39621: Make buf arg to md5_compress be const. (GH-18497)

(cherry picked from commit 597ebed748d0b0c061f8c108bd98270d103286c1)

Co-authored-by: Andy Lester <andy@petdance.com>

bpo-39474: Fix AST pos for expressions like (a)(b), (a)[b] and (a).b. (GH-18477)

(cherry picked from commit 6e619c48b8e804ece9521453fc8da0640a04d5b1)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

bpo-21016: pydoc and trace use sysconfig (GH-18476)

bpo-21016, bpo-1294959: The pydoc and trace modules now use the
sysconfig module to get the path to the Python standard library, to
support uncommon installation path like /usr/lib64/python3.9/ on
Fedora.

Co-Authored-By: Jan Matějek <jmatejek@suse.com>
(cherry picked from commit 4fac7ed43ebf1771a8fe86fdfe7b9991f3be78cd)

Co-authored-by: Victor Stinner <vstinner@python.org>

bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)

* Always set the text attribute.
* Correct the offset attribute for non-ascii sources.
(cherry picked from commit 0cc6b5e559b8303b18fdd56c2befd900fe7b5e35)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>

bpo-39605: Remove a cast that causes a warning. (GH-18473)

(cherry picked from commit 95905ce0f41fd42eb1ef60ddb83f057401c3d52f)

Co-authored-by: Benjamin Peterson <benjamin@python.org>

bpo-39595: Improve zipfile.Path performance (GH-18406) (GH-18472)

* Improve zipfile.Path performance on zipfiles with a large number of entries.

* 📜🤖 Added by blurb_it.

* Add bpo to blurb

* Sync with importlib_metadata 1.5 (6fe70ca)

* Update blurb.

* Remove compatibility code

* Add stubs module, omitted from earlier commit

Co-authored-by: blurb-it[bot] <43283697+blurb-it[bot]@users.noreply.github.com>
(cherry picked from commit e5bd73632e77dc5ab0cab77e48e94ca5e354be8a)

Co-authored-by: Jason R. Coombs <jaraco@jaraco.com>
Co-authored-by: Jason R. Coombs <jaraco@jaraco.com>

closes bpo-39605: Fix some casts to not cast away const. (GH-18453)

gcc -Wcast-qual turns up a number of instances of casting away constness of pointers. Some of these can be safely modified, by either:

Adding the const to the type cast, as in:

-    return _PyUnicode_FromUCS1((unsigned char*)s, size);
+    return _PyUnicode_FromUCS1((const unsigned char*)s, size);

or, Removing the cast entirely, because it's not necessary (but probably was at one time), as in:

-    PyDTrace_FUNCTION_ENTRY((char *)filename, (char *)funcname, lineno);
+    PyDTrace_FUNCTION_ENTRY(filename, funcname, lineno);

These changes will not change code, but they will make it much easier to check for errors in consts
(cherry picked from commit e6be9b59a911626d6597fe148c32f0342bd2bd24)

Co-authored-by: Andy Lester <andy@petdance.com>

docs: macos - change "versiona" to "versions" (GH-18467) (GH-18469)

(cherry picked from commit 029e8401b7741cc0964b5f38d2c2264749dbff6b)

Co-authored-by: @RandyMcMillan <randy.lee.mcmillan@gmail.com>

bpo-39299: Add more tests for mimetypes and its cli. (GH-17949)

* Add tests for case insensitive check of types and extensions as fallback.
* Add tests for data url with no comma.
* Add tests for read_mime_types.
* Add tests for the mimetypes cli and refactor __main__ code to private function.
* Restore mimetypes.knownfiles value at the end of the test.
(cherry picked from commit d8efc1495194228c3a4cd472200275d6491d8e2d)

Co-authored-by: Karthikeyan Singaravelan <tir.karthi@gmail.com>

Post 3.8.2rc1

Merge tag 'v3.8.2rc1' into 3.8

Python 3.8.2rc1

bpo-38374: Remove weakref.ReferenceError from docs (GH-18452)

Reflecting changes to the code, removed weakref.ReferenceError from weakref.rst and exceptions.rst.

Issue submitter provided evidence that the `weakref.ReferenceError` alias for `ReferenceError` was removed from the code in 2007.  Working with @gvanrossum at PyCascades CPython sprint we looked at the code and confirmed that `weakref.ReferenceError` was no longer in `weakref.py`.

Based on that analysis I removed references `weakref.ReferenceError` from the two documents where it was still being referenced: `weakref.rst` and `exceptions.rst`.

https://bugs.python.org/issue38374
(cherry picked from commit 4eb9f4313cfaea6a9611221024a1c54f5662cc37)

Co-authored-by: Roger Hurwitz <rogerhurwitz@gmail.com>

bpo-39600: Adjust code, add idlelib/NEWS item (GH-18449)

Complete previous patch.
(cherry picked from commit 96ce22706735779cf8cc46eaaa5ac61359364b5a)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>

bpo-39594: Fix typo in os.times documentation (GH-18443)

There was an extra space in the url markup, causing the documentation not rendered properly.

https://bugs.python.org/issue39594
(cherry picked from commit 37c55b2b49a3acb7c56c9f6a5062bc6e4e35bc1c)

Co-authored-by: Roger Hurwitz <rogerhurwitz@gmail.com>

bpo-13826: Clarify Popen constructor example (GH-18438)

Clarifies that the use of `shlex.split` is more instructive than
normative, and provides a simpler example.

https://bugs.python.org/issue13826
(cherry picked from commit 95d024d585bd3ed627437a2f0cbc783c8a014c8a)

Co-authored-by: Tim D. Smith <github@tim-smith.us>