]> git.ipfire.org Git - thirdparty/openembedded/openembedded-core-contrib.git/commit
scripts/resulttool: add mention about new detected tests
authorAlexis Lothoré <alexis.lothore@bootlin.com>
Fri, 21 Jul 2023 11:02:06 +0000 (13:02 +0200)
committerRichard Purdie <richard.purdie@linuxfoundation.org>
Tue, 25 Jul 2023 14:27:30 +0000 (15:27 +0100)
commit01b5cefd07e01c7407bc663842b8a8d502358a6d
tree5eb1378a36b4e506dec6678086e1fe8280ac3688
parent60ff9714328ada93029bde6623f64977178a2de0
scripts/resulttool: add mention about new detected tests

Some regression reports show a lot of "PASSED->None" transitions. When such
big lot of identical transitions are observed, it could be that tests are
now failing, but it could also be that some tests has been renamed.

To detect such case, add a log in regression report to report the number of
new tests (i.e: tests that are present in target results but not in base
result). This new log also allows to know about newly added tests bases

Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
scripts/lib/resulttool/regression.py