Creating conditional flows in Dagster

[lukastk]

Hi all,

I've been trying to get my head around how to create a DAG of the following form:

flowchart
        Document{{"Asset: Document"}} --> A

	A[Is in Spanish or English] -->|Spanish| Spanish
	A -->|English| English

	Spanish[Spanish NER processor] --> Entity
	English[English NER processor] --> Entity

	Entity{{"Asset: Entity"}}

Loading

The above would of course be trivial to implement within the the asset definition of Entity itself, and for a problem this simple that might be the best course of action. However, for more complicated branching logics it would be quite nice if there was an easy way to define the individual ops, connect them, and have them be visualised on the Dagster dashboard.

Thanks in advance for your help!

[garethbrickman]

Looks like it could be a use case for a subsetted graph-backed asset: https://docs.dagster.io/concepts/assets/graph-backed-assets#graph-backed-assets