]> git.ipfire.org Git - thirdparty/Python/cpython.git/commit
gh-115634: Fix ProcessPoolExecutor deadlock with max_tasks_per_child (GH-140900)
authorGregory P. Smith <68491+gpshead@users.noreply.github.com>
Fri, 3 Jul 2026 06:08:47 +0000 (23:08 -0700)
committerGitHub <noreply@github.com>
Fri, 3 Jul 2026 06:08:47 +0000 (23:08 -0700)
commitb706767d8fd7d21afc3f156fb9c173bc99855e0e
tree8f7085a0e3fd7320e28e86a04de2a64cd917a60c
parent0a13efc3fb0bf0896612ed20decce3ce4eb5e05b
gh-115634: Fix ProcessPoolExecutor deadlock with max_tasks_per_child (GH-140900)

The idle worker semaphore counts task completions, not idle workers, so
it can hold a stale token released by a worker that later exited upon
reaching its max_tasks_per_child limit. The worker replacement path
consumed such tokens and skipped spawning a replacement, deadlocking
the remaining queued tasks once no workers were left.

Replace dead workers based on len(self._processes) without consulting
the semaphore. The submit() path is unchanged, preserving on-demand
spawning and idle worker reuse.

Replace the documentation note added in GH-140897 with a versionchanged
entry now that the bug is fixed.

Based on a fix proposed by Tabrez Mohammed.
Doc/library/concurrent.futures.rst
Lib/concurrent/futures/process.py
Lib/test/test_concurrent_futures/test_process_pool.py
Misc/NEWS.d/next/Library/2025-11-02-05-28-56.gh-issue-115634.JbcNnF.rst [new file with mode: 0644]