Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remote_cache: Use upload compression on all code paths #8371

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

fmeum
Copy link
Contributor

@fmeum fmeum commented Feb 11, 2025

We used to (configurably) apply upload compression only to UploadFile, not e.g. UploadBlob. Fix this by moving the logic into the private function that lies on all code paths.

We used to (configurably) apply upload compression only to `UploadFile`, not e.g. `UploadBlob`. Fix this by moving the logic into the private function that lies on all code paths.
@fmeum
Copy link
Contributor Author

fmeum commented Feb 11, 2025

The test failure is legitimate, but I'm not sure whether it actually encodes the intended behavior.

Copy link
Member

@bduffany bduffany left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if this only affects UploadBlob, then LGTM - looks like in practice we're only calling UploadBlob for execution log output (stdout, stderr, and VM logs)

Comment on lines +251 to +253
if *enableUploadCompression {
r.SetCompressor(repb.Compressor_ZSTD)
}
Copy link
Member

@bduffany bduffany Feb 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should avoid mutating r here (if possible?) Ideally have the caller specify the compressor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants