You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The implementation of the storage module from @ice1e0 has been merged into the master branch. I see this as a breaking change and suggest to publish this therefore in the next major version 4.
In addition I think some additional commands should be added for working with files. Here some samples:
WriteFile - Write an SQL Output to a file on a blob storage
CopyFile - copies a file from one location to another
RemoveFile - removes a file from a blob storage
optional additional commands:
ValidateFile - check if a file is of a specific format and validates the file against a Schema file (XSD or a JSON Schema file)
ConvertFile - converts a file from one file format to another, e.g. xml to json
The text was updated successfully, but these errors were encountered:
I digged a bit into it and I think the mara storage/pipeline module should support path configuration from fsspec. Maybe then supporting storages via the URL without specifically mentioning the storage_alias as other tools like pandas does it.
The implementation of the storage module from @ice1e0 has been merged into the master branch. I see this as a breaking change and suggest to publish this therefore in the next major version 4.
In addition I think some additional commands should be added for working with files. Here some samples:
optional additional commands:
The text was updated successfully, but these errors were encountered: