Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eliminate principle nodes #190

Open
CJ-Wright opened this issue Aug 8, 2019 · 0 comments
Open

Eliminate principle nodes #190

CJ-Wright opened this issue Aug 8, 2019 · 0 comments

Comments

@CJ-Wright
Copy link
Member

Principle nodes are annoying, they require lots of knowledge about how a pipeline operates exactly. They are currently used to designate one or more nodes as nodes which signal to event stream nodes to issue start and stop documents.
It may be possible to inspect the graph in such a way as to not need to do this.

One could examine all the From nodes and then once one get a start doc have the To node issue a start doc. One difficulty here is that we may ingest docs from across headers, which would trigger multiple starts.

One would need to do something similar for stop docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant