The data source center supports POSTGRESQL, HIVE/IMPALA, SPARK, CLICKHOUSE, SQLSERVER data sources by default.
If you are using MySQL or ORACLE data source, you need to place the corresponding driver package in the lib directory
org.apache.dolphinscheduler.spi.datasource.DataSourceChannel org.apache.dolphinscheduler.spi.datasource.DataSourceChannelFactory org.apache.dolphinscheduler.plugin.datasource.api.client.CommonDataSourceClient
In the first step, the data source plug-in can implement the above interfaces and inherit the general client. For details, refer to the implementation of data source plug-ins such as sqlserver and mysql. The addition methods of all RDBMS plug-ins are the same.
Add the driver configuration in the data source plug-in pom.xml
We provide APIs for external access of all data sources in the dolphin scheduler data source API module
In additional, the
DataSourceChannelFactory extends from
PrioritySPI, this means you can set the plugin priority, when you have two plugin has the same name, you can customize the priority by override the
getIdentify method. The high priority plugin will be load, but if you have two plugin with the same name and same priority, the server will throw
IllegalArgumentException when load the plugin.
Support data sources such as kafka, http, files, sparkSQL, FlinkSQL, etc.