This repository has been archived by the owner on Sep 12, 2022. It is now read-only.

Design Ideas

Jump to bottom

Julian Pistorius edited this page Feb 1, 2017 · 5 revisions

Workflows

Problem: Celery flows can be cumbersome to monitor & debug

Proposal: Replace with a DAG workflow system like Apache Airflow or Luigi

Can even handle really large files like instance images using Fileflow

More reading: