FlaPy is a small tool that allows software developers to automatically check tests for flakiness.
It is the result of research carried out at the Chair of Software Engineering II at the University of Passau, Germany.
Before you begin, ensure you have met the following requirements:
- Python in at least version 3.7.
- You have installed the latest version of
poetry
.pip install poetry
- You have a Linux machine with a recent kernel and activated cgroups.
We refer you to the installation documentation of
BenchExec
, a framework for reliable benchmarking and resource measurement, which we use for running all test cases in isolation.
git clone https://github.com/se2p/FlaPy.git
cd FlaPy
poetry install
poetry build
# Drop first line, which contains the header
./run_csv.sh <(tail -n+2 sample_input.csv)
Results can then be found under ./flapy-results/
To parse the results, use
poetry run results_parser ResultsDir --dir=flapy-results get_passed_failed to_csv --index=False > passed_failed_sample.csv
poetry run results_parser PassedFailed --file_ passed_failed_sample.csv to_test_overview to_csv --index=False > test_overview_sample.csv
An overview of the results can now be found in passed_failed_sample.csv
and test_overview_sample.csv
The project can be built by using the poetry
tool:
poetry build
This command will build two files in the dist
folder:
A tar.gz
archive and a whl
Python wheel file.
See the contributors list
If you want to contact me, please find our contact details on my page at the University of Passau.
This project is licensed under the terms of the GNU Lesser General Public License.