Luigi

Jump to bottom

Jonathan Janetzki edited this page Jul 27, 2017 · 1 revision

Luigi is our pipelining tool to run multiple jobs at once.
Start the webserver using $ luigid. Use an own screen for this since it will constantly print on the console.
Then start a pipeline using $ ingestion/luigi_pipelines/pipeline.sh <pipeline name>.