Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-37310: [Python][CI] Enable warnings in PyArrow pytests #37317

Closed

Conversation

danepitkin
Copy link
Member

@danepitkin danepitkin commented Aug 22, 2023

Rationale for this change

Warnings are enabled for some nightly jobs, but not for CI jobs. This is not helpful since devs typically rely on the CI job as part of the PR process.

What changes are included in this PR?

  • Enable warnings as errors in PR CI
  • Remove warnings as errors in Hypothesis tests, which has no PR CI

Are these changes tested?

Will be tested as part of CI.

Are there any user-facing changes?

This affects the dev workflow.

@github-actions
Copy link

⚠️ GitHub issue #37310 has been automatically assigned in GitHub to PR creator.

@@ -150,6 +153,7 @@ jobs:
ARROW_WITH_BROTLI: ON
ARROW_BUILD_TESTS: OFF
PYARROW_TEST_LARGE_MEMORY: ON
PYTEST_ARGS: -W error
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could also leave it out here, and focus on getting no warnings on only linux?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I went ahead and suppressed the single warning, which does have an open issue to resolve. Since not everyone has a mac to debug this, maybe it's better to leave it out though?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would personally leave it out (I think enabling this for a smaller subset of builds will be easier to maintain)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds good! I'll update

@github-actions github-actions bot added awaiting changes Awaiting changes awaiting change review Awaiting change review and removed awaiting review Awaiting review awaiting changes Awaiting changes labels Aug 23, 2023
@danepitkin
Copy link
Member Author

Ready to merge!

@github-actions github-actions bot added awaiting changes Awaiting changes and removed awaiting change review Awaiting change review labels Aug 24, 2023
Copy link
Member

@raulcd raulcd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe late to the party but is there any reason we don't enable it by default when running tests?
https://github.com/apache/arrow/blob/main/ci/scripts/python_test.sh#L62
Maybe it would be better to explicitly disable if we require on a specific job instead of enabling it everywhere?

@danepitkin
Copy link
Member Author

Maybe late to the party but is there any reason we don't enable it by default when running tests? https://github.com/apache/arrow/blob/main/ci/scripts/python_test.sh#L62 Maybe it would be better to explicitly disable if we require on a specific job instead of enabling it everywhere?

Good question! A lot of the integration/testing with old versions or with 3rd party packages on their latest development branch can typically throw a lot of warnings. We have many of these jobs so it might actually be more work to disable all of them then to enable for the ones we want.

@github-actions github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Aug 28, 2023
@danepitkin
Copy link
Member Author

I rebased just now to make sure no new warnings are introduced before merging.

@danepitkin danepitkin marked this pull request as draft October 6, 2023 15:27
@danepitkin
Copy link
Member Author

Closing for now. It would need to be redone after rebasing so may warrant a new PR at that point.

@danepitkin danepitkin closed this Sep 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Python][CI] Enable warnings as errors in pytests for CI jobs
4 participants