Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

allow rows to be removed based on given values #89

Merged
merged 5 commits into from
Feb 13, 2025

Conversation

patrick-troy
Copy link
Collaborator

@patrick-troy patrick-troy commented Feb 5, 2025

Allow rows of data to be removed from specific datasets given a table_name, header and value.

  • The table_name identifies which table to apply this to
  • The header identifies which column to check against
  • The value is the value that needs to match the cell value for that row to be kept
    Currently only works with one table, header and value combination per pipeline

Outputs a new error code to identify which row of the original data has been removed

@patrick-troy patrick-troy merged commit 8fd5d9a into main Feb 13, 2025
3 checks passed
@patrick-troy patrick-troy deleted the remove_rows_invalid_field branch February 13, 2025 08:46
@patrick-troy patrick-troy restored the remove_rows_invalid_field branch February 18, 2025 13:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants