You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Converting csv which has blank column at the end of line failed caused by ParquetEncodingException.
The failed csv is like the following(when read the line no.2, the exception will occur):
1,aaa,bbb,ccc,,eee
2,aaa,bbb,ccc,ddd,
3,,,,,eee
Error message's example is here:
Invalid input data. Expecting 6 columns. Input had 5 columns...
How to fix
Here is my fix example: tkhm@0972941
(It works at least for me, should I make a PR?)
I'm not sure it is fit for this project policy, but my solution is that when the column size difference is detected and its diff is 1, add the blank column to the end of list.
The text was updated successfully, but these errors were encountered:
Problem
Converting csv which has blank column at the end of line failed caused by
ParquetEncodingException
.The failed csv is like the following(when read the line no.2, the exception will occur):
Error message's example is here:
How to fix
Here is my fix example: tkhm@0972941
(It works at least for me, should I make a PR?)
I'm not sure it is fit for this project policy, but my solution is that when the column size difference is detected and its diff is 1, add the blank column to the end of list.
The text was updated successfully, but these errors were encountered: