]> git.ipfire.org Git - thirdparty/openembedded/openembedded-core.git/commit
scripts/resulttool: fix ptests results containing a non reproducible path
authorAlexis Lothoré <alexis.lothore@bootlin.com>
Tue, 28 Feb 2023 18:10:50 +0000 (19:10 +0100)
committerRichard Purdie <richard.purdie@linuxfoundation.org>
Sun, 12 Mar 2023 23:36:44 +0000 (23:36 +0000)
commit601eecfddd26bfe2954835a73ed1116bb520235f
treeebb41b31b24c781678ec379f3821fca0338bf34b
parentdf342c81d02dea3f677966602089d4a972bb09bd
scripts/resulttool: fix ptests results containing a non reproducible path

Some ptests results may be wrongly sampled, resulting in some part of the error
being propagated in test name. For example:

"ptestresult.binutils-ld.in testcase /home/pokybuild/yocto-worker/qemumips/build/build-st-1666126/tmp/work/mips32r2-poky-linux/binutils-cross-testsuite/2.40-r0/git/ld/testsuite/ld-ctf/ctf.exp"
"ptestresult.gcc.Couldn't create remote directory /tmp/runtest.455781 on ssh"
"ptestresult.gcc-libstdc++-v3.Couldn't create remote directory /tmp/runtest.3814266 on target"

While the root errors must be fixed in corresponding ptests packages for those
tests, the test results history must still be usable even with this issue

Add new filters to detect if temporary test directories (build-st-*,
/tmp/runtime.*) are present in name. If so, truncate test name. As a side
effect, it will aggregate multiple failing errors into one, but the regression
will still be raised

Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
scripts/lib/resulttool/regression.py