Skip to content
This repository has been archived by the owner on Jun 22, 2022. It is now read-only.

Do all Steps execute parallel? #82

Open
denyslazarenko opened this issue Jun 27, 2018 · 2 comments
Open

Do all Steps execute parallel? #82

denyslazarenko opened this issue Jun 27, 2018 · 2 comments

Comments

@denyslazarenko
Copy link

Is it necessary to divide executions inside my class to be separate Thread or just divide them between Steps? For example, I can to fit KNN, PCA in one class method and parallel them or create two separate classes for them...

@jakubczakon
Copy link
Collaborator

Sorry for late response.
For now steps execute in one thread and when I do parallelization I simply run operations within a single step in parallel rather than execute multiple steps in parallel.

That being said it would be a nice feature to have.
Feel free to PR if you are working on something like that.

@kamil-kaczmarek
Copy link
Member

@tankz0r @jakubczakon

Multiple people asked us about parallel execution of multiple Steps (i.e. training many models simultaneously). We are considering adding some simple parallelization, but at this point I cannot make any commitments about timing. For sure we will keep you updated @tankz0r !

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants