-
Notifications
You must be signed in to change notification settings - Fork 3.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix: Disable unreliable test #11105
fix: Disable unreliable test #11105
Conversation
5cf0d9d
to
ea06304
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There are other ones too. We might want to fix each one of them. #10807
Can you do a |
I can't reproduce it. Did it 25 times, and works every time for me. This specific test failure gets me much more frequently than the other ones. Or at least it fails fast, so if another one would fail, this one happens first. |
Are you only interested in fixed tests, or is disabling an option with an issue to investigate and re-enable? |
A bit concerned if it's related to core functionalities. Perhaps we can skip it only in GitHub Actions but enable it locally. |
}) | ||
// This test regularly fails in Github Actions CI | ||
// t.Run("PendingShuttingdownStoppingWf", func(t *testing.T) { | ||
// // Create and acquire the lock for the first workflow |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Instead of commenting out, it's probably better to do:
t.Run("PendingShuttingdownStoppingWf", func(t *testing.T) {
t.Skip("This test regularly fails in Github Actions CI")
...
}
I don't know if Github Actions also has any environment variables that it sets, but if so, you could make it a conditional based on that environment variable being there
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is just skipped in CI now based on GITHUB_ACTIONS=true.
I've done that now. |
The test PendingShuttingdownStoppingWf regularly fails in github actions unit test stage. This should probably be looked at, but for now stop needing quite so many retries to push through simple changes. Signed-off-by: Alan Clucas <[email protected]>
Signed-off-by: Dillen Padhiar <[email protected]>
Motivation
The test TestSynchronizationForPendingShuttingdownWfs/PendingShuttingdownStoppingWf regularly fails in github actions unit test stage.
This should probably be looked at, but for now stop needing quite so many retries to push through simple changes.
Modifications
Commented out test with a note on reason why.