Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only run plugin tests for new or modified plugins #193

Merged
merged 3 commits into from
Aug 10, 2023

Conversation

kvfairchild
Copy link
Contributor

[Depends on core PR #36]

In the interest of reducing burdensome test time, this moves from running all tests on Travis for every plugin on every PR to only running tests for plugins added or modified by the PR on Travis.

The gap in test coverage introduced by this PR is intended to be closed by instead having each PR initiate a non-blocking Jenkins run for all plugin and integration tests (possibly in conjunction with Issue #172).

Note: parse_plugin_changes.py will replace parse_changed_files.py.

.travis.yml Outdated Show resolved Hide resolved
Katherine Fairchild added 2 commits June 23, 2023 08:16
@kvfairchild kvfairchild requested a review from mschrimpf June 29, 2023 19:12
Copy link
Member

@mschrimpf mschrimpf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good, but why are tests already passing now before the core changes brain-score/core#36 are even merged?

@kvfairchild
Copy link
Contributor Author

looks good, but why are tests already passing now before the core changes brain-score/core#36 are even merged?

For security reasons, changes to travis.yml aren't run as part of the PR tests until it's merged to main.

@kvfairchild kvfairchild merged commit 6f689ea into main Aug 10, 2023
@kvfairchild kvfairchild deleted the kvf/reduce-language-test-time branch August 10, 2023 18:37
shehadak pushed a commit that referenced this pull request Aug 14, 2023
* only run plugin tests for new or modified plugins

* typo

* cleanup

---------

Co-authored-by: Katherine Fairchild <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants