From: Nicki Křížek <nicki@isc.org>
Date: Fri, 19 Jun 2026 11:09:42 +0000 (+0000)
Subject: Raise respdiff third-party and recent-named disagreement thresholds
X-Git-Url: http://git.ipfire.org/gitweb.cgi?a=commitdiff_plain;h=a8413fa94c348696012e7de548abccb6cefb85c9;p=thirdparty%2Fbind9.git

Raise respdiff third-party and recent-named disagreement thresholds

The third-party comparison is right at the 0.4 % threshold, making it
fail quite often. The current range of observed values ranges from
0.3-0.5 %. Raise the threshold to 0.5 %.

The recent-named comparison produces values ranging from 0.05 to 0.12 %,
but appears to be more sensitive to time of the day when the test runs.
Raise the threshold to 0.15 %.

Both results are stable within the specified ranges across the last
three releases in both main and bind-9.20 series.
---

diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml
index 3e51e541cc2..b433532c33f 100644
--- a/.gitlab-ci.yml
+++ b/.gitlab-ci.yml
@@ -2463,7 +2463,7 @@ respdiff-third-party:
     CC: gcc
     CFLAGS: "${CFLAGS_COMMON}"
     EXTRA_CONFIGURE: "-Doptimization=g"
-    MAX_DISAGREEMENTS_PERCENTAGE: "0.4"
+    MAX_DISAGREEMENTS_PERCENTAGE: "0.5"
   script:
     - bash respdiff.sh -s third_party -q "${PWD}/100k_mixed.txt" -c 1 -w "${PWD}/rspworkdir" -r "${PWD}/respdiff" "${CI_PROJECT_DIR}"
     - cd ../.. && ninja -C build clean >/dev/null 2>&1
@@ -2491,7 +2491,7 @@ respdiff:recent-named:
     CC: gcc
     CFLAGS: "${CFLAGS_COMMON} -DISC_TRACK_PTHREADS_OBJECTS"
     EXTRA_CONFIGURE: "-Doptimization=g"
-    MAX_DISAGREEMENTS_PERCENTAGE: "0.1"
+    MAX_DISAGREEMENTS_PERCENTAGE: "0.15"
 
 # Performance tests