A distributed and easy-to-expand visual DAG workflow scheduling system
Dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. Its main objectives are as follows:
Decentralized multi-master and multi-worker, HA is supported by itself, overload processing
All process definition operations are visualized, Visualization process defines key information at a glance, One-click deployment
Support pause, recover operation. Support multi-tenant. Support more task types e.g., spark, hive, mr, shell, python, sub_process
Support custom task types, Distributed scheduling, and the overall scheduling capability will increase linearly with the scale of the cluster
Providing your info on Wanted: who's using DolphinScheduler to help improving DolphinScheduler better.