Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ReadIndexFile does not work if file name contains spaces #9

Open
JDatta opened this issue Apr 22, 2017 · 0 comments
Open

ReadIndexFile does not work if file name contains spaces #9

JDatta opened this issue Apr 22, 2017 · 0 comments
Assignees
Labels

Comments

@JDatta
Copy link
Owner

JDatta commented Apr 22, 2017

The index of TarFileSystem is stored as space separated values in parent file system for later reuse. When we try to read the index back it fails if file name contains spaces.

17/04/22 00:20:32 INFO tar.TarFileSystem: *** Using Tar file system ***
17/04/22 00:20:33 ERROR tar.TarIndex: Invalid Index File: /jd/systems.tar.index

We should either use properly quoted CSV file. Or use some structured format like JSON.

If we support hierarchical index in future to support directories, structured format like JSON seems to be a better choice.

@JDatta JDatta added the bug label Apr 22, 2017
@JDatta JDatta added this to the 2.1_beta release milestone Apr 22, 2017
@JDatta JDatta self-assigned this Apr 22, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant