Luigi is a Python module that helps you build complex pipelines of batch jobs. Created by Spotify The purpose of Luigi is to address all the plumbing typically associated with long-running batch processes. You want to chain many tasks, automate them, and failures will happen. These tasks can be anything, but are typically long running […]
