Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable parallel download and extract of node snapshots #2876

Open
powerslider opened this issue Jan 23, 2025 · 0 comments
Open

Enable parallel download and extract of node snapshots #2876

powerslider opened this issue Jan 23, 2025 · 0 comments
Assignees
@powerslider

Comments

@powerslider
Copy link
Contributor

Problem to Solve

omega and mainnet at this point have very large node snapshot archives on GCP. Currently we download and extract them sequentially which is a waste of time given that there are no dependencies in that process.

Proposed Solution

Parallelize with goroutines in order to improve waiting time almost in half.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@powerslider powerslider

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@powerslider