-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use GHA cache for yocto sstate and shared downloads #351
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 13:30
— with
GitHub Actions
Error
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 13:54
— with
GitHub Actions
Error
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 13, 2024 14:20
d6b1c68
to
73411f7
Compare
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 14:20
— with
GitHub Actions
Failure
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 13, 2024 14:23
73411f7
to
61ef848
Compare
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 14:23
— with
GitHub Actions
Failure
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 15:14
— with
GitHub Actions
Failure
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 15:37
— with
GitHub Actions
Failure
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 18:05
— with
GitHub Actions
Error
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 13, 2024 18:12
61ef848
to
e31ddfc
Compare
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 18:13
— with
GitHub Actions
Failure
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 13, 2024 18:30
e31ddfc
to
0408f0a
Compare
klutchell
had a problem deploying
to
balena-staging.com
June 13, 2024 18:30
— with
GitHub Actions
Error
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 13, 2024 18:55
0408f0a
to
668d204
Compare
klutchell
temporarily deployed
to
balena-staging.com
June 13, 2024 18:55
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
June 13, 2024 21:16
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
June 13, 2024 21:16
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
June 13, 2024 21:16
— with
GitHub Actions
Inactive
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 17, 2024 20:12
668d204
to
8e421b1
Compare
klutchell
had a problem deploying
to
balena-staging.com
June 17, 2024 20:12
— with
GitHub Actions
Failure
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 27, 2024 13:26
8e421b1
to
d41dff6
Compare
klutchell
had a problem deploying
to
balena-staging.com
June 27, 2024 13:26
— with
GitHub Actions
Failure
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 27, 2024 15:54
d41dff6
to
e02f61b
Compare
klutchell
temporarily deployed
to
balena-staging.com
June 27, 2024 15:54
— with
GitHub Actions
Inactive
klutchell
had a problem deploying
to
bm.balena-dev.com
June 27, 2024 17:04
— with
GitHub Actions
Error
klutchell
had a problem deploying
to
bm.balena-dev.com
June 27, 2024 17:04
— with
GitHub Actions
Error
klutchell
had a problem deploying
to
bm.balena-dev.com
June 27, 2024 17:04
— with
GitHub Actions
Error
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 27, 2024 17:17
e02f61b
to
2adc2d3
Compare
klutchell
had a problem deploying
to
balena-staging.com
June 27, 2024 17:18
— with
GitHub Actions
Error
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
June 27, 2024 18:27
2adc2d3
to
f314574
Compare
klutchell
temporarily deployed
to
balena-staging.com
July 2, 2024 13:49
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
July 2, 2024 15:18
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
July 2, 2024 15:18
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
July 2, 2024 15:18
— with
GitHub Actions
Inactive
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
July 2, 2024 19:21
773b822
to
277064e
Compare
klutchell
temporarily deployed
to
balena-staging.com
July 2, 2024 19:21
— with
GitHub Actions
Inactive
klutchell
changed the title
Cache yocto sstate and shared downloads via GHA cache
Use GHA cache for yocto sstate and shared downloads
Jul 2, 2024
klutchell
temporarily deployed
to
bm.balena-dev.com
July 2, 2024 20:08
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
July 2, 2024 20:08
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
July 2, 2024 20:08
— with
GitHub Actions
Inactive
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
July 5, 2024 13:34
277064e
to
eb01470
Compare
klutchell
temporarily deployed
to
balena-staging.com
July 5, 2024 13:35
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
July 5, 2024 14:21
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
July 5, 2024 14:21
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
bm.balena-dev.com
July 5, 2024 14:21
— with
GitHub Actions
Inactive
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
September 18, 2024 17:35
eb01470
to
143ce2d
Compare
klutchell
temporarily deployed
to
balena-staging.com
September 18, 2024 17:35
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
balena-cloud.com
September 18, 2024 19:07
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
balena-cloud.com
September 18, 2024 19:07
— with
GitHub Actions
Inactive
klutchell
temporarily deployed
to
balena-cloud.com
September 18, 2024 19:07
— with
GitHub Actions
Inactive
Last test results: https://github.com/balena-os/balena-yocto-scripts/actions/runs/10927276022/job/30333070956?pr=351
|
The current shared NFS cache is insecure as any workflow using our self-hosted runners has full access to all cached files, including private device types and sources. This change drops the NFS in favour of GitHub built-in cache features. These cache entries are very large, near the maximum 10gb size, so they don't last very long in testing. A day or two. However, it means we don't have to maintain a gigantic shared cache and clean it regularly. But we will still sometimes get some faster builds with cache-hit. We could also run a local S3 or NFS instance on the self-hosted runner stack to get more than 10gb of cache storage, but we will have the same issue with permissions being too open to all workflows unless we switch to a public cloud that supports OIDC. Change-type: minor Signed-off-by: Kyle Harding <[email protected]>
Signed-off-by: Kyle Harding <[email protected]>
klutchell
force-pushed
the
kyle/zstd-cache
branch
from
November 1, 2024 13:34
143ce2d
to
358a9e4
Compare
klutchell
had a problem deploying
to
balena-staging.com
November 1, 2024 13:34
— with
GitHub Actions
Failure
Last test results: https://github.com/balena-os/balena-yocto-scripts/actions/runs/11630209275/job/32388667813?pr=351
|
klutchell
had a problem deploying
to
balena-staging.com
November 1, 2024 13:46
— with
GitHub Actions
Failure
Superseded by #443 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The current shared NFS cache is insecure as any workflow using our
self-hosted runners has full access to all cached files, including
private device types and sources.
This change drops the NFS in favour of GitHub built-in cache features.
These cache entries are very large, near the maximum 10gb size,
so they don't last very long in testing. A day or two.
However, it means we don't have to maintain a gigantic shared
cache and clean it regularly. But we will still sometimes
get some faster builds with cache-hit.
We could also run a local S3 or NFS instance on the self-hosted
runner stack to get more than 10gb of cache storage, but we will have
the same issue with permissions being too open to all workflows
unless we switch to a public cloud that supports OIDC.
Change-type: minor