Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accept a series of one or more regex replacement rules for stream aliasing #26

Open
aaronsteers opened this issue Jun 24, 2022 · 1 comment

Comments

@aaronsteers
Copy link
Contributor

aaronsteers commented Jun 24, 2022

As of now, stream name aliasing is performed one stream at a time. This doesn't scale very well for use cases where we actually want to apply a naming convention or standard 'morph' of stream names between tap and target.

As raised in slack: https://meltano.slack.com/archives/C013EKWA2Q1/p1656091898668519?thread_ts=1656084258.386049&cid=C013EKWA2Q1

Regex approach

With a global regex substitution rule like the camelcase-to-snakecase stack overflow example and demoed here in regex101,

we could convert names like

myTableName
myTableName2
MyTableName3
ThisIsALineOfText87

into names like

MY_TABLE_NAME
MY_TABLE_NAME_2
MY_TABLE_NAME_3
THIS_IS_A_LINE_OF_TEXT_87

which is a common requirement for landing data into Snowflake.

@yjw868
Copy link

yjw868 commented Nov 2, 2022

Hello @aaronsteers, is there any update on this? Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants