Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce mixer build bundle scope to changed bundles #630

Open
gtkramer opened this issue Oct 29, 2019 · 4 comments
Open

Reduce mixer build bundle scope to changed bundles #630

gtkramer opened this issue Oct 29, 2019 · 4 comments

Comments

@gtkramer
Copy link

If a build only has one package changing that is found in only a small handful of bundles, do all of the bundles need built? Given mixer produces a stateful workspace that is iterative, would it be possible to build bundles only for the bundles that have changed to coincide with how the update is performed? I think existing information to populate Manifest.full should be able to be obtained from existing manifests if I understand how changes work across manifests correctly.

@rchiossi
Copy link
Contributor

The problem right now is that the process of building the bundles is what we use to figure out what changed, but in theory it should be possible with a change in mixer architecture.

@gtkramer
Copy link
Author

gtkramer commented Oct 29, 2019

Ah, that makes sense. That's where the manifest info and includes files are made. I think that's still reasonable to do, and probably unavoidable, but maybe we don't need to install all bundles? Combined with doing the rpm2cpio bits, I think doing less work in parallel would be a big speed up.

@gtkramer
Copy link
Author

I'm not sure how this plays into a possible long-term strategy, but if we want to start farming out work with mixer onto multiple machines, I think it would be useful to have the process/logic already in place to only build the bundles that have changed (and subsequently the update off those bundles).

@reaganlo reaganlo changed the title [performance/question]: Mixer build bundle scope Mixer build bundle scope Oct 30, 2019
@gtkramer gtkramer changed the title Mixer build bundle scope Reduce mixer build bundle scope to changed bundles Oct 30, 2019
@jwakre jwakre self-assigned this Feb 27, 2020
@jwakre jwakre removed their assignment Mar 10, 2020
@insilications
Copy link

Yes, a simple bundle with a few dozen file changes takes more than one hour in a 9900ks in my personal mix update. It would be nice to have the control to customize CL without having to wait more than one hour to update. It is unsustainable for small developers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants