Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Import Sqoop Nifi column names issue #35

Open
apara86 opened this issue Feb 16, 2020 · 0 comments
Open

Import Sqoop Nifi column names issue #35

apara86 opened this issue Feb 16, 2020 · 0 comments

Comments

@apara86
Copy link

apara86 commented Feb 16, 2020

I have a question on Kylo and Nifi. The version of Kylo used is 0.10.1 The version of Nifi used is 1.6.0

When we create a feed for database ingest (using database as source), in the Additional Options step there is no provision to enter the source table column names.

However, in Nifi side, we use ImportSqoop processor which has a mandatory property field called Source Fields and it requires that the columns be entered, separated by commas. If it is not done, we get an error:

ERROR tool.ImportTool: Imported Failed: We found column without column name. Please verify that you've entered all column names in your query if using free form query import (consider adding clause AS if you're using column transformation)

As a work around, we are manually entering the column names in ImportSqoop processor's Source Fields property. But we want it to be directly available from Kylo UI.

For our requirement, we want ImportSqoop processor to take all the columns from the table automatically into this property without manual intervention at Nifi level. Is there any option to include all columns of a database table in the background automatically? Or is there any other possibility of giving this value in UpdateAttribute processor?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant