chore: fix transient random test failures#10122
chore: fix transient random test failures#10122paulbalandan merged 1 commit intocodeigniter4:developfrom
Conversation
0973042 to
e7823b1
Compare
|
The fix here is to acknowledge the fact that the transient failures may be caused by race issues within GitHub Actions. Thus, the script will retry for another round with a fresh random seed. Given that the failures all revolve around The retry mechanism absorbed the flaky test fails in |
|
I've tried various things myself, but since the problem only occurs on GitHub Actions, it's hard to debug. The retry mechanism seems to work, but maybe we should stop running these tests in parallel? |
|
That could work as well. However, running the tests sequentially could take much more time as we incrementally add components, and the default repeat in GitHub Actions is 10. Will that trade off be ok with you? |
michalsn
left a comment
There was a problem hiding this comment.
Okay, let's check how this will work for us now.
Description
Random tests still fails at some points. Trying to probe the likely culprit.
Checklist: