You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For some tests it's useful to specify ordering -- it makes more sense to validate simple operations before more complex ones. It would be useful to have 2 types of annotations:
Specify dependencies which the test runner respects, i.e. @dependency(EverythingRunsTest) to annotate more complicated tests. This can also speed up failing test runs by immediately failing all dependent tests (or report them as SKIPPED).
Indicate a levels of testing, e.g. @smoke vs. @exhaustive. We'd need to think about the levels (or make them generic as @testlevel(1)) but the idea is that we could easily run a smaller set of tests that still give good coverage, but finish much faster.
The text was updated successfully, but these errors were encountered:
For some tests it's useful to specify ordering -- it makes more sense to validate simple operations before more complex ones. It would be useful to have 2 types of annotations:
@dependency(EverythingRunsTest)
to annotate more complicated tests. This can also speed up failing test runs by immediately failing all dependent tests (or report them as SKIPPED).@smoke
vs.@exhaustive
. We'd need to think about the levels (or make them generic as@testlevel(1)
) but the idea is that we could easily run a smaller set of tests that still give good coverage, but finish much faster.The text was updated successfully, but these errors were encountered: