Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing csv last blank column #10

Open
tkhm opened this issue Aug 11, 2016 · 0 comments
Open

Missing csv last blank column #10

tkhm opened this issue Aug 11, 2016 · 0 comments

Comments

@tkhm
Copy link

tkhm commented Aug 11, 2016

Problem

Converting csv which has blank column at the end of line failed caused by ParquetEncodingException.

The failed csv is like the following(when read the line no.2, the exception will occur):

1,aaa,bbb,ccc,,eee
2,aaa,bbb,ccc,ddd,
3,,,,,eee

Error message's example is here:

Invalid input data. Expecting 6 columns. Input had 5 columns...

How to fix

Here is my fix example: tkhm@0972941
(It works at least for me, should I make a PR?)

I'm not sure it is fit for this project policy, but my solution is that when the column size difference is detected and its diff is 1, add the blank column to the end of list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant