Azkaban
Batch workflow job scheduler created at LinkedIn to run Hadoop and Spark big data pipelines.
Why consider Azkaban?
Azkaban is an open-source distributed batch workflow job scheduler and DAG manager written in Java by LinkedIn. Azkaban manages file dependencies between tasks, scheduled cron jobs, SLA alerts, and user authentication with an intuitive web administration interface.
Learn Azkaban by building
Practical setup notes, real use cases, and copy-ready examples in one focused guide.
In this guide2 sections
Overview of Azkaban
Azkaban executes scheduled big data ETL jobs and task dependency graphs.
Quickstart
# Build Azkaban distribution./gradlew build installDistAzkaban is licensed under the Apache License Version 2.0.
Related tools
More options with a similar category or technology profile.
diskus
Minimal, fast alternative to du -sh written in Rust using multi-threaded directory traversal.
peco
Simplistic interactive filtering tool for Unix pipelines, process lists, and file trees.
Dapr CLI
Command-line tool for managing Dapr distributed application runtime environments and sidecars.
Freeze
Generate beautiful image screenshots and SVGs of code snippets and terminal outputs.