From: Tom Krizek <tkrizek@isc.org>
Date: Tue, 22 Aug 2023 16:39:51 +0000 (+0200)
Subject: Allow re-runs of qmin system test
X-Git-Tag: v9.19.17~35^2~2
X-Git-Url: http://git.ipfire.org/gitweb.cgi?a=commitdiff_plain;h=be2123a8e9926782dcc40cd93c2482f175c4d368;p=thirdparty%2Fbind9.git

Allow re-runs of qmin system test

The qmin test is inherently unstable. It fails quite often with failure
modes described in GL #904. Allow the pytest runner to re-run the test
up to 3 times to only detect a more persistent and reproducible failures
rather than random noise caused by the nature of the test.
---

diff --git a/bin/tests/system/qmin/tests_sh_qmin.py b/bin/tests/system/qmin/tests_sh_qmin.py
index 2566c78e0f1..607732232e2 100644
--- a/bin/tests/system/qmin/tests_sh_qmin.py
+++ b/bin/tests/system/qmin/tests_sh_qmin.py
@@ -9,6 +9,10 @@
 # See the COPYRIGHT file distributed with this work for additional
 # information regarding copyright ownership.
 
+import pytest_custom_markers
 
+
+# The qmin test is inherently unstable, see GL #904 for details.
+@pytest_custom_markers.flaky(max_runs=3)
 def test_qmin(run_tests_sh):
     run_tests_sh()