Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do not include field deletionVector in add action when it is disabled #3055

Closed
Zan-L opened this issue Dec 12, 2024 · 2 comments
Closed

Do not include field deletionVector in add action when it is disabled #3055

Zan-L opened this issue Dec 12, 2024 · 2 comments
Labels
question Further information is requested

Comments

@Zan-L
Copy link

Zan-L commented Dec 12, 2024

Description

Snowflake Delta Diret can't be used on Delta tables produced by delta-rs because it always includes deletionVector: null in add actions and Snowflake doesn't support add actions. Removing that field manually from the log files could make it work. But I'm hoping that this field could be dropped for those that have delta.enableDeletionVectors set to false.

Use Case
Delta Diret

Related Issue(s)

@Zan-L Zan-L added the enhancement New feature or request label Dec 12, 2024
@rtyler
Copy link
Member

rtyler commented Dec 12, 2024

Do you have a contact at Snowflake that can participate in this discussion @Zan-L ? The Delta Lake protocol makes this field optional, and it sounds like their reader has a bug or needs to be upgraded

@Zan-L
Copy link
Author

Zan-L commented Dec 12, 2024

Thanks for the update! Unfortunately, I don't have any yet. It is a preview feature though so the bug could likely come from them. Feel free to close this issue in that case.

@ion-elgreco ion-elgreco added question Further information is requested and removed enhancement New feature or request labels Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants