Tests contaminated

[rvhonorato]

Module/Workflow/Library affected

All tests

Expected behavior

For the tests to be able to be executed in any order

Actual behavior

The order in which the tests are executed affect the results

Steps to reproduce the behavior

Setup:

$ git clone https://github.com/haddocking/haddock3
$ cd haddock3
$ python -m venv .venv
$ source .venv
$ source .venv/bin/activate
$ pip install -e '.[dev]'

This will pass:

$ pytest tests/
$ pytest integration_tests/

This will fail:

$ pytest tests

To make it even more evident;

$ pip install pytest-random-order
$ pytest --random-order

Suggestions on how to fix it

This happens most likely because some of the tests are modifying the test data during its execution - need to identify which one, or which ones are doing that.

Version

ccb3aea581e0a0a930c21f36d135edf1bbdaad06

Additional context