D6122: tests: add a file listing all the flaky tests
lothiraldan (Boris Feld)
phabricator at mercurial-scm.org
Tue Mar 12 14:11:12 EDT 2019
lothiraldan added a comment.
In https://phab.mercurial-scm.org/D6122#89169, @av6 wrote:
> Another way to do this could be to introduce another special keyword, similar to "slow", so that tests that are known flaky can `#require flaky` or even mark a specific block with `#if flaky`. Obviously fixing test-remotefilelog-bgprefetch.t is a better idea altogether, but I'm not going to claim that it's easy.
For this specific test case, it's not flaky on our Buildbot instance (https://buildbot.mercurial-scm.org/builders/hg%20tests). It only happens on exotic filesystems (like inside a Docker container) and when running the tests in parallel.
Flaky tests on our buildbot instances are usually fixed quite quickly, this contrib file is more for tests that are flaky outside our buildbot setup.
To: lothiraldan, #hg-reviewers
Cc: av6, mercurial-devel
More information about the Mercurial-devel