Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support operator pipelining #13

Open
pgaref opened this issue Jun 25, 2019 · 0 comments
Open

Support operator pipelining #13

pgaref opened this issue Jun 25, 2019 · 0 comments
Assignees
@pgaref
Labels
enhancement New feature or request
Milestone
Basic RDD functio...

Comments

@pgaref
Copy link
Collaborator

pgaref commented Jun 25, 2019

No description provided.

@pgaref pgaref added the enhancement New feature or request label Jun 25, 2019
@pgaref pgaref self-assigned this Jun 25, 2019
pgaref added a commit that referenced this issue Jun 26, 2019
@pgaref
Added support for operator pipelining #13
fbf4a63 
* Multiple pipelined functions like filter, map, flatMap are now shipped to SGXWorker at once
* Added special Char (FUNC_END) to distinguish when function serialization is done
* Added special Func type (PIPELINED) when multiple functions should be applied
* TODO: support mapWithIndex special case and Glom
@pgaref pgaref mentioned this issue Jun 26, 2019
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pgaref pgaref

Labels
enhancement New feature or request
Projects
None yet
Milestone
Basic RDD functionality support
Development

No branches or pull requests
1 participant
@pgaref