Reduce GitHub Actions unit test durations by removing tox and using test parallelization

Reduce GitHub Actions unit test durations by removing tox and using test parallelization #2812