Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: speed up integration test times & cleanup #921

Closed
wants to merge 2 commits into from

Conversation

bhearsum
Copy link
Contributor

@bhearsum bhearsum commented Jul 15, 2024

We could probably eke more out of this by rearchitecting how they run, but this covers the low hanging fruit that stuck out to me. On my local machine, it takes integration tests from ~5m to ~1m30s.

In CI it looks like it took the CircleCI integration test from ~12min to ~7min, but only made small gains in the already parallelized integration tests for various signers.

This is mostly a quick hack. Feel free to reject it if it's undesirable for any reason.

…ther

We could probably eke more out of this by rearchitecting how they run, but this covers the low hanging fruit that stuck out to me. On my local machine, it takes integration tests from ~5m to ~1m30s.
@bhearsum bhearsum marked this pull request as ready for review July 15, 2024 15:27
@bhearsum bhearsum requested a review from oskirby July 15, 2024 15:27
@oskirby
Copy link
Contributor

oskirby commented Jul 15, 2024

I am little concerned that forking the tests will make it harder to diagnose when a test goes wrong, as it's not clear which log messages came from which test anymore. I prefer the approach we have going on in Github actions where the tests are parallelized across different jobs.

I would actually prefer that we got rid of the run_integration_tests.sh script altogether and instead try to make development easier by running a specific integration test if desired (eg: docker compose run -f tools/autograph-client/integration-tests.yaml <test-name>

@bhearsum
Copy link
Contributor Author

That's fair! I'm happy to toss this PR out.

@bhearsum bhearsum closed this Jul 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants