Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test: Refactor tests to support ClickHouse Cloud #347

Closed
wants to merge 4 commits into from

Conversation

pan3793
Copy link
Collaborator

@pan3793 pan3793 commented Jul 24, 2024

Summary

Checklist

Delete items not relevant to your PR:

  • Unit and integration tests covering the common scenarios were added
  • A human-readable description of the changes was provided to include in CHANGELOG
  • For significant changes, documentation in https://github.com/ClickHouse/clickhouse-docs was updated with further explanations or tutorials

scala: [ 2.12, 2.13 ]
env:
CLICKHOUSE_CLOUD_HOST: ${{ secrets.INTEGRATIONS_TEAM_TESTS_CLOUD_HOST_SMT }}
CLICKHOUSE_CLOUD_PASSWORD: ${{ secrets.INTEGRATIONS_TEAM_TESTS_CLOUD_PASSWORD_SMT }}
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

were these secrets set up properly? @mzitnik

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep should be fine.

@pan3793 pan3793 changed the title Test with ClickHouse Cloud Test: Refactor tests to support ClickHouse Cloud Jul 24, 2024
@mzitnik
Copy link
Collaborator

mzitnik commented Jul 28, 2024

I will test your branch locally

@mzitnik
Copy link
Collaborator

mzitnik commented Jul 28, 2024

I have also noticed that ClickHouseSingle{XXXX} and clickHouseCloud{XXXX} both running with ./gradlew clean cloudTest

Copy link
Collaborator

@mzitnik mzitnik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In ClickHouseTableDDLSuite when running against cloud we should change to ENGINE=Memory() instead of ENGINE=Log()


def withNodeClient(protocol: ClickHouseProtocol = HTTP)(block: NodeClient => Unit): Unit =
Utils.tryWithResource {
NodeClient(NodeSpec(clickhouseHost, Some(clickhouseHttpPort), Some(clickhouseTcpPort), protocol))
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to add here in case of cloud username, password, and options with a value of ("ssl", "true")

@mzitnik
Copy link
Collaborator

mzitnik commented Aug 4, 2024

@pan3793 I can pull this branch under ClickHouse/spark-clickhouse-connector and do the needed fixes so we could run it with our cloud credentials

@pan3793
Copy link
Collaborator Author

pan3793 commented Aug 6, 2024

close and in favor #349

@pan3793 pan3793 closed this Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants