Apache DolphinScheduler is a cloud-native visual Big Data workflow scheduler system, committed to “solving complex big-data task dependencies and triggering relationships in data OPS orchestration so that various types of big data tasks can be used out of the box”.
- Decentralized multi-master and multi-worker, HA is supported by itself, overload processing
- All process definition operations are visualized, Visualization process defines key information at a glance, One-click deployment
- Support multi-tenant. Support many task types e.g., spark,flink,hive, mr, shell, python, sub_process
- Support custom task types, Distributed scheduling, and the overall scheduling capability will increase linearly with the scale of the cluster