]> git.ipfire.org Git - thirdparty/openembedded/openembedded-core-contrib.git/commit
oeqa/core/runner: add helper to know about expected failures
authorAlexis Lothoré <alexis.lothore@bootlin.com>
Fri, 9 Jun 2023 06:47:59 +0000 (08:47 +0200)
committerRichard Purdie <richard.purdie@linuxfoundation.org>
Sat, 17 Jun 2023 10:46:45 +0000 (11:46 +0100)
commit34595858b14f628a8282777b91c841add6ebe1ca
tree227b92ad3ade8700585f480b4660bfc17af7b285
parentbebe52ae9576393ebb9d7405fc77fba21e84ba5b
oeqa/core/runner: add helper to know about expected failures

Testing framework currently uses the unittest.expectedFailure decorator for
tests that can have intermittent failures (see PTEST_EXPECT_FAILURE = "1")
in core-image-ptest.bb. While it allows upper layers to run tests without
failing on "fragile" tests, it prevents those from knowing more about those
failing tests since they are not accounting as failures (for example we
could want to retrieve some logs about failed tests to improve them, and
eventually to drop expectFailure decorator)

Add a helper to allow upper layers to know about those failures which won't
make global testing session

Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
meta/lib/oeqa/core/runner.py