| 机器 | 系统 | dolphinscheduler包 | |
|---|---|---|---|
| 192.168.72.106 | centos7 | apache-dolphinscheduler-3.1.8-bin.tarapache-dolphinscheduler-3.1.8-bin.tarapache-dolphinscheduler-3.1.8-bin.tar | |
| 192.168.72.113 | centos7 | apache-dolphinscheduler-3.1.8-bin.tarapache-dolphinscheduler-3.1.8-bin.tar | |
| 192.168.72.114 | centos7 | apache-dolphinscheduler-3.1.8-bin.tar |
####在192.168.72.106 机器执行ssh-keygen,一路回车
[root@localhost ~]# ssh-keygen
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa):
Created directory '/root/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:JGYZJiatNHjPcp3aB+819pBlvThXUvnskaE+4p3ezKg root@localhost.localdomain
The key's randomart image is:
+---[RSA 2048]----+
| ...o o .|
|. +o.o o o.|
| o = .=.. ..o+|
| o +o+o o.oo+|
| o o oS +.. =.|
| . . o *.ooo .|
| o o.+ooo |
| . ..o= |
| Eoo + |
+----[SHA256]-----+
###########cp 密钥到其他机器,执行ssh-copy-id root@机器ip
[root@localhost ~]# ssh-copy-id root@192.168.72.106
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host '192.168.72.106 (192.168.72.106)' can't be established.
ECDSA key fingerprint is SHA256:I3QFrL+ou1zH5OISbl7yVRWN0aM8VYKUcaLEw8LhWks.
ECDSA key fingerprint is MD5:71:85:e3:f2:a8:5e:75:d2:f9:a5:e3:17:b9:5e:77:88.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@192.168.72.106's password:
Permission denied, please try again.
root@192.168.72.106's password:
Number of key(s) added: 1
Now try logging into the machine, with: "ssh 'root@192.168.72.106'"
and check to make sure that only the key(s) you wanted were added.
[root@localhost ~]# ssh-copy-id root@192.168.72.113
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host '192.168.72.113 (192.168.72.113)' can't be established.
ECDSA key fingerprint is SHA256:I3QFrL+ou1zH5OISbl7yVRWN0aM8VYKUcaLEw8LhWks.
ECDSA key fingerprint is MD5:71:85:e3:f2:a8:5e:75:d2:f9:a5:e3:17:b9:5e:77:88.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@192.168.72.113's password:
Number of key(s) added: 1
Now try logging into the machine, with: "ssh 'root@192.168.72.113'"
and check to make sure that only the key(s) you wanted were added.
[root@localhost ~]# ssh-copy-id root@192.168.72.114
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host '192.168.72.114 (192.168.72.114)' can't be established.
ECDSA key fingerprint is SHA256:I3QFrL+ou1zH5OISbl7yVRWN0aM8VYKUcaLEw8LhWks.
ECDSA key fingerprint is MD5:71:85:e3:f2:a8:5e:75:d2:f9:a5:e3:17:b9:5e:77:88.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@192.168.72.114's password:
Number of key(s) added: 1
Now try logging into the machine, with: "ssh 'root@192.168.72.114'"
and check to make sure that only the key(s) you wanted were added.
#####测试无密码远程登陆
[root@localhost ~]# ssh 192.168.72.106
Last failed login: Tue Dec 9 11:14:53 CST 2025 from 192.168.72.106 on ssh:notty
There was 1 failed login attempt since the last successful login.
Last login: Tue Dec 9 10:58:48 2025 from 192.168.72.1
[root@localhost ~]# exit
logout
Connection to 192.168.72.106 closed.
[root@localhost ~]# ssh 192.168.72.113
Last login: Tue Dec 9 10:58:48 2025 from 192.168.72.1
[root@localhost ~]# exit
logout
Connection to 192.168.72.113 closed.
[root@localhost ~]# ssh 192.168.72.114
Last login: Tue Dec 9 10:58:50 2025 from 192.168.72.1
[root@localhost ~]# exit
logout
Connection to 192.168.72.114 closed.
检查机器是否有java1.8的运行环境,如果没有就需要安装部署jdk
[root@localhost ~]# java -version
-bash: java: command not found
####没有java运行环境需要安装jdk
没有java运行环境。安装jdk可以用yum联网安装(或者如果有本地yum源,可以内网yum安装),也可以用二进制包解压并配置环境变量。
####假如用yun安装openjdk,需要执行以下命令,(如果有yum源)
[root@localhost ~]# yum search openjdk
[root@localhost ~]# sudo yum install java-1.8.0-openjdk-devel
没有yum源用二进制包安装,下载地址https://jdk.java.net/java-se-ri/8-MR3
####将jdk上传到3台对应的机器上
[root@localhost ~]# ll
total 210960
-rw-------. 1 root root 1243 Dec 5 13:48 anaconda-ks.cfg
-rw-r--r-- 1 root root 216015848 Dec 9 11:02 openjdk-8u44-linux-x64.tar.gz
[root@localhost ~]# scp openjdk-8u44-linux-x64.tar.gz root@192.168.72.113:/data/
openjdk-8u44-linux-x64.tar.gz 100% 206MB 82.0MB/s 00:02
[root@localhost ~]# scp openjdk-8u44-linux-x64.tar.gz root@192.168.72.114:/data/
openjdk-8u44-linux-x64.tar.gz 100% 206MB 83.5MB/s 00:02
[root@localhost ~]# mv openjdk-8u44-linux-x64.tar.gz /data/
解压并配置环境变量,3台机器都要操作
[root@localhost ~]# cd /data/
[root@localhost data]# ll
total 210956
-rw-r--r-- 1 root root 216015848 Dec 9 11:02 openjdk-8u44-linux-x64.tar.gz
[root@localhost data]# tar xf openjdk-8u44-linux-x64.tar.gz
[root@localhost data]# ll
total 210956
drwxr-xr-x 9 10 143 219 May 23 2024 java-se-8u44-ri
-rw-r--r-- 1 root root 216015848 Dec 9 11:02 openjdk-8u44-linux-x64.tar.gz
###在/etc/profile文件末尾添加下面4行内容
[root@localhost data]# vim /etc/profile
export JAVA_HOME=/data/java-se-8u44-ri
export JRE_HOME=${JAVA_HOME}/jre
export CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib
export PATH=${JAVA_HOME}/bin:$PATH
####加载环境变量
[root@localhost data]# source /etc/profile
[root@localhost data]# java -version
openjdk version "1.8.0_44"
OpenJDK Runtime Environment (build 1.8.0_44-b02)
OpenJDK 64-Bit Server VM (build 25.40-b25, mixed mode)
3台机器都执行
systemctl stop firewalld
systemctl disable firewalld
dolphin需要一个数据库存放数据,本文档把数据库安装在106机器
参考文档 :https://www.linuxsre.cn/wiki/linux/356
[root@localhost data]# tar xf apache-zookeeper-3.8.5-bin.tar.gz
[root@localhost data]# mv apache-zookeeper-3.8.5-bin zookeeper
[root@localhost data]# cd zookeeper/
[root@localhost zookeeper]# cp conf/zoo_sample.cfg conf/zoo.cfg
##########修改zoo.cfg ,内容如下,注意ip和dir目录的配置
[root@localhost zookeeper]# vim conf/zoo.cfg
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/data/zookeeper/data
LogDir=/data/zookeeper/logs
clientPort=2181
server.1=192.168.72.106:2888:3888
server.2=192.168.72.113:2888:3888
server.3=192.168.72.114:2888:3888
[root@localhost zookeeper]# mkdir -pv /data/zookeeper/{data,logs}
mkdir: created directory ‘/data/zookeeper/data’
mkdir: created directory ‘/data/zookeeper/logs’
[root@localhost zookeeper]# scp -r /data/zookeeper 192.168.72.113:/data/
[root@localhost zookeeper]# scp -r /data/zookeeper 192.168.72.113:/data/
####106机器执行
[root@localhost zookeeper]# echo 1 > data/myid
#####113机器执行
[root@localhost data]# cd zookeeper/
[root@localhost zookeeper]# echo 2 > data/myid
#############################114机器执行
[root@localhost data]# cd zookeeper/
[root@localhost zookeeper]# echo 3 > data/myid
############################3台机器都执行
[root@localhost zookeeper]# ./bin/zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /data/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@localhost zookeeper]# ./bin/zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /data/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost. Client SSL: false.
Mode: follower
上传安装包apache-dolphinscheduler-3.1.8-bin.tar.gz到 106机器即可,别的机器不用上传
###解压
[root@localhost data]# ll
total 869948
-rw-r--r-- 1 root root 674806497 Aug 2 2023 apache-dolphinscheduler-3.1.8-bin.tar.gz
drwxr-xr-x 9 10 143 219 May 23 2024 java-se-8u44-ri
-rw-r--r-- 1 root root 216015848 Dec 9 11:02 openjdk-8u44-linux-x64.tar.gz
[root@localhost data]# tar xf apache-dolphinscheduler-3.1.8-bin.tar.gz
##改一下目录名字
[root@localhost data]# mv apache-dolphinscheduler-3.1.8-bin dolphinscheduler
[root@localhost data]# ll
total 869948
-rw-r--r-- 1 root root 674806497 Aug 2 2023 apache-dolphinscheduler-3.1.8-bin.tar.gz
drwxr-xr-x 11 root root 190 Feb 18 2022 dolphinscheduler
drwxr-xr-x 9 10 143 219 May 23 2024 java-se-8u44-ri
-rw-r--r-- 1 root root 216015848 Dec 9 11:02 openjdk-8u44-linux-x64.tar.gz
修改配置文件
######备份一下配置文件
[root@localhost dolphinscheduler]# cp bin/env/install_env.sh bin/env/install_env.sh.bak
[root@localhost dolphinscheduler]# cp bin/env/dolphinscheduler_env.sh bin/env/dolphinscheduler_env.sh.bak
#########集群配置文件
[root@localhost dolphinscheduler]# vim bin/env/install_env.sh
ips=${ips:-"192.168.72.106,192.168.72.113,192.168.72.114"}
sshPort=${sshPort:-"22"}
masters=${masters:-"192.168.72.113"}
workers=${workers:-"192.168.72.106:default,192.168.72.113:default,192.168.72.114:default"}
alertServer=${alertServer:-"192.168.72.114"}
apiServers=${apiServers:-"192.168.72.106"}
installPath=${installPath:-"/data/dolphinscheduler"}
#deployUser=${deployUser:-"dolphinscheduler"}
deployUser="root"
zkRoot=${zkRoot:-"/dolphinscheduler"}
#############数据库和zookeeper的配置
[root@localhost dolphinscheduler]# vim bin/env/dolphinscheduler_env.sh
export JAVA_HOME=${JAVA_HOME:-/data/java-se-8u44-ri}
export DATABASE=mysql
export SPRING_PROFILES_ACTIVE=${DATABASE}
export SPRING_DATASOURCE_URL="jdbc:mysql://192.168.72.106:3306/dolphinscheduler"
export SPRING_DATASOURCE_USERNAME=dolphinscheduler
export SPRING_DATASOURCE_PASSWORD=dolphinscheduler#321
export SPRING_CACHE_TYPE=${SPRING_CACHE_TYPE:-none}
export SPRING_JACKSON_TIME_ZONE=${SPRING_JACKSON_TIME_ZONE:-UTC}
export MASTER_FETCH_COMMAND_NUM=${MASTER_FETCH_COMMAND_NUM:-10}
export REGISTRY_TYPE=${REGISTRY_TYPE:-zookeeper}
export REGISTRY_ZOOKEEPER_CONNECT_STRING="192.168.72.106:2181,192.168.72.113:2181,192.168.72.114:2181"
export HADOOP_HOME=${HADOOP_HOME:-/opt/soft/hadoop}
export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-/opt/soft/hadoop/etc/hadoop}
export SPARK_HOME1=${SPARK_HOME1:-/opt/soft/spark1}
export SPARK_HOME2=${SPARK_HOME2:-/opt/soft/spark2}
export PYTHON_HOME=${PYTHON_HOME:-/opt/soft/python}
export HIVE_HOME=${HIVE_HOME:-/opt/soft/hive}
export FLINK_HOME=${FLINK_HOME:-/opt/soft/flink}
export DATAX_HOME=${DATAX_HOME:-/opt/soft/datax}
export SEATUNNEL_HOME=${SEATUNNEL_HOME:-/opt/soft/seatunnel}
export CHUNJUN_HOME=${CHUNJUN_HOME:-/opt/soft/chunjun}
export PATH=$HADOOP_HOME/bin:$SPARK_HOME1/bin:$SPARK_HOME2/bin:$PYTHON_HOME/bin:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$DATAX_HOME/bin:$SEATUNNEL_HOME/bin:$CHUNJUN_HOME/bin:$PATH
配置mysql 的 mysql-connector-java-8.0.26.jar 包,需要下载并上传到机器上
[root@localhost data]# ll
total 887384
-rw-r--r-- 1 root root 674806497 Aug 2 2023 apache-dolphinscheduler-3.1.8-bin.tar.gz
-rw-r--r-- 1 root root 15384869 Dec 3 11:07 apache-zookeeper-3.8.5-bin.tar.gz
drwxr-xr-x 11 root root 190 Feb 18 2022 dolphinscheduler
drwxr-xr-x 9 10 143 219 May 23 2024 java-se-8u44-ri
-rw-r--r-- 1 root root 2462364 Nov 27 09:52 mysql-connector-java-8.0.26.jar
-rw-r--r-- 1 root root 216015848 Dec 9 11:02 openjdk-8u44-linux-x64.tar.gz
drwxr-xr-x 8 root root 157 Dec 9 13:17 zookeeper
[root@localhost data]# cp mysql-connector-java-8.0.26.jar dolphinscheduler/master-server/libs/
[root@localhost data]# cp mysql-connector-java-8.0.26.jar dolphinscheduler/worker-server/libs/
[root@localhost data]# cp mysql-connector-java-8.0.26.jar dolphinscheduler/alert-server/libs/
[root@localhost data]# cp mysql-connector-java-8.0.26.jar dolphinscheduler/api-server/libs/
[root@localhost data]# cp mysql-connector-java-8.0.26.jar dolphinscheduler/tools/libs/
初始化数据库
[root@localhost data]# cd dolphinscheduler/
[root@localhost dolphinscheduler]# sh tools/bin/upgrade-schema.sh
####确保这一步没有报错,这里可以登录数据库看一下表的数量是61张表
在106机器上执行install.sh ,会把文件scp到其他机器,并启动
[root@localhost dolphinscheduler]# ./bin/install.sh
1.create directory
2.scp resources
192.168.72.106:default
192.168.72.113:default
192.168.72.114:default
scp dirs to 192.168.72.106//data/dolphinscheduler starting
start to scp bin to 192.168.72.106//data/dolphinscheduler
start to scp master-server to 192.168.72.106//data/dolphinscheduler
start to scp worker-server to 192.168.72.106//data/dolphinscheduler
start to scp alert-server to 192.168.72.106//data/dolphinscheduler
start to scp api-server to 192.168.72.106//data/dolphinscheduler
start to scp ui to 192.168.72.106//data/dolphinscheduler
start to scp tools to 192.168.72.106//data/dolphinscheduler
scp dirs to 192.168.72.106//data/dolphinscheduler complete
scp dirs to 192.168.72.113//data/dolphinscheduler starting
start to scp bin to 192.168.72.113//data/dolphinscheduler
start to scp master-server to 192.168.72.113//data/dolphinscheduler
start to scp worker-server to 192.168.72.113//data/dolphinscheduler
start to scp alert-server to 192.168.72.113//data/dolphinscheduler
start to scp api-server to 192.168.72.113//data/dolphinscheduler
start to scp ui to 192.168.72.113//data/dolphinscheduler
start to scp tools to 192.168.72.113//data/dolphinscheduler
scp dirs to 192.168.72.113//data/dolphinscheduler complete
scp dirs to 192.168.72.114//data/dolphinscheduler starting
start to scp bin to 192.168.72.114//data/dolphinscheduler
start to scp master-server to 192.168.72.114//data/dolphinscheduler
start to scp worker-server to 192.168.72.114//data/dolphinscheduler
start to scp alert-server to 192.168.72.114//data/dolphinscheduler
start to scp api-server to 192.168.72.114//data/dolphinscheduler
start to scp ui to 192.168.72.114//data/dolphinscheduler
start to scp tools to 192.168.72.114//data/dolphinscheduler
scp dirs to 192.168.72.114//data/dolphinscheduler complete
scp copy completed
3.stop server
192.168.72.106:default
192.168.72.113:default
192.168.72.114:default
192.168.72.113 master server is stopping
Begin stop master-server......
no master-server to stop
End stop master-server.
192.168.72.106 worker server is stopping
Begin stop worker-server......
no worker-server to stop
End stop worker-server.
192.168.72.113 worker server is stopping
Begin stop worker-server......
no worker-server to stop
End stop worker-server.
192.168.72.114 worker server is stopping
Begin stop worker-server......
no worker-server to stop
End stop worker-server.
Begin stop alert-server......
no alert-server to stop
End stop alert-server.
192.168.72.106 api server is stopping
Begin stop api-server......
no api-server to stop
End stop api-server.
4.delete zk node
Connecting to 192.168.72.106:2181,192.168.72.113:2181,192.168.72.114:2181
14:29:14.315 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.8.0-5a02a05eddb59aee6ac762f7ea82e92a68eb9c0f, built on 2022-02-25 08:49 UTC
14:29:14.319 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=localhost
14:29:14.319 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_44
14:29:14.319 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
14:29:14.319 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/data/java-se-8u44-ri/jre
14:29:14.319 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/data/dolphinscheduler/bin/../conf:/data/dolphinscheduler/bin/../api-server/libs/HdrHistogram-2.1.12.jar:/data/dolphinscheduler/bin/../api-server/libs/HikariCP-4.0.3.jar:/data/dolphinscheduler/bin/../api-server/libs/Java-WebSocket-1.5.1.jar:/data/dolphinscheduler/bin/../api-server/libs/LatencyUtils-2.0.3.jar:/data/dolphinscheduler/bin/../api-server/libs/accessors-smart-2.4.8.jar:/data/dolphinscheduler/bin/../api-server/libs/aliyun-java-sdk-core-4.5.10.jar:/data/dolphinscheduler/bin/../api-server/libs/aliyun-java-sdk-kms-2.11.0.jar:/data/dolphinscheduler/bin/../api-server/libs/aliyun-java-sdk-ram-3.1.0.jar:/data/dolphinscheduler/bin/../api-server/libs/aliyun-sdk-oss-3.15.1.jar:/data/dolphinscheduler/bin/../api-server/libs/animal-sniffer-annotations-1.19.jar:/data/dolphinscheduler/bin/../api-server/libs/annotations-13.0.jar:/data/dolphinscheduler/bin/../api-server/libs/annotations-4.1.1.4.jar:/data/dolphinscheduler/bin/../api-server/libs/asm-9.1.jar:/data/dolphinscheduler/bin/../api-server/libs/aspectjweaver-1.9.7.jar:/data/dolphinscheduler/bin/../api-server/libs/audience-annotations-0.12.0.jar:/data/dolphinscheduler/bin/../api-server/libs/auto-service-annotations-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/automaton-1.11-8.jar:/data/dolphinscheduler/bin/../api-server/libs/avro-1.7.7.jar:/data/dolphinscheduler/bin/../api-server/libs/aws-java-sdk-core-1.12.160.jar:/data/dolphinscheduler/bin/../api-server/libs/aws-java-sdk-emr-1.12.160.jar:/data/dolphinscheduler/bin/../api-server/libs/aws-java-sdk-kms-1.12.160.jar:/data/dolphinscheduler/bin/../api-server/libs/aws-java-sdk-s3-1.12.160.jar:/data/dolphinscheduler/bin/../api-server/libs/aws-java-sdk-sagemaker-1.12.160.jar:/data/dolphinscheduler/bin/../api-server/libs/bcpkix-jdk15on-1.68.jar:/data/dolphinscheduler/bin/../api-server/libs/bcprov-jdk15on-1.68.jar:/data/dolphinscheduler/bin/../api-server/libs/bonecp-0.8.0.RELEASE.jar:/data/dolphinscheduler/bin/../api-server/libs/byte-buddy-1.9.16.jar:/data/dolphinscheduler/bin/../api-server/libs/checker-qual-3.12.0.jar:/data/dolphinscheduler/bin/../api-server/libs/classgraph-4.8.83.jar:/data/dolphinscheduler/bin/../api-server/libs/classmate-1.5.1.jar:/data/dolphinscheduler/bin/../api-server/libs/clickhouse-cli-client-0.3.2-patch11-shaded.jar:/data/dolphinscheduler/bin/../api-server/libs/clickhouse-grpc-client-0.3.2-patch11-shaded.jar:/data/dolphinscheduler/bin/../api-server/libs/clickhouse-http-client-0.3.2-patch11-shaded.jar:/data/dolphinscheduler/bin/../api-server/libs/clickhouse-jdbc-0.3.2-patch11.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-beanutils-1.9.4.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-cli-1.2.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-codec-1.11.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-collections-3.2.2.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-collections4-4.1.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-compiler-3.1.7.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-compress-1.21.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-configuration2-2.1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-dbcp-1.4.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-io-2.11.0.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-lang-2.6.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-lang3-3.12.0.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-logging-1.1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-math3-3.1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-net-3.6.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-pool-1.6.jar:/data/dolphinscheduler/bin/../api-server/libs/commons-text-1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/cron-utils-9.1.6.jar:/data/dolphinscheduler/bin/../api-server/libs/curator-client-5.3.0.jar:/data/dolphinscheduler/bin/../api-server/libs/curator-framework-5.3.0.jar:/data/dolphinscheduler/bin/../api-server/libs/curator-recipes-5.3.0.jar:/data/dolphinscheduler/bin/../api-server/libs/datanucleus-api-jdo-4.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/datanucleus-core-4.1.17.jar:/data/dolphinscheduler/bin/../api-server/libs/datanucleus-rdbms-4.1.19.jar:/data/dolphinscheduler/bin/../api-server/libs/derby-10.14.2.0.jar:/data/dolphinscheduler/bin/../api-server/libs/dnsjava-2.1.7.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-api-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-common-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-dao-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-data-quality-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-all-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-api-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-athena-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-clickhouse-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-db2-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-hive-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-mysql-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-oracle-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-postgresql-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-presto-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-redshift-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-spark-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-datasource-sqlserver-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-meter-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-registry-all-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-registry-api-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-registry-etcd-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-registry-mysql-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-registry-zookeeper-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-remote-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-scheduler-api-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-scheduler-quartz-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-service-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/druid-1.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-spi-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-all-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-api-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-blocking-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-chunjun-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-conditions-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-dataquality-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-datax-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-dependent-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-dinky-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-dvc-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-emr-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-flink-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-flink-stream-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-hivecli-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-http-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-jupyter-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-k8s-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-mlflow-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-mr-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-openmldb-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-pigeon-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-procedure-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-python-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-pytorch-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-sagemaker-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-seatunnel-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-shell-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-spark-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-sql-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-sqoop-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-subprocess-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-switch-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-task-zeppelin-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/dolphinscheduler-ui-3.1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/error_prone_annotations-2.5.1.jar:/data/dolphinscheduler/bin/../api-server/libs/failsafe-2.4.4.jar:/data/dolphinscheduler/bin/../api-server/libs/failureaccess-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/generex-1.0.2.jar:/data/dolphinscheduler/bin/../api-server/libs/grpc-api-1.41.0.jar:/data/dolphinscheduler/bin/../api-server/libs/grpc-context-1.41.0.jar:/data/dolphinscheduler/bin/../api-server/libs/grpc-core-1.41.0.jar:/data/dolphinscheduler/bin/../api-server/libs/grpc-grpclb-1.41.0.jar:/data/dolphinscheduler/bin/../api-server/libs/grpc-netty-1.41.0.jar:/data/dolphinscheduler/bin/../api-server/libs/grpc-protobuf-1.41.0.jar:/data/dolphinscheduler/bin/../api-server/libs/grpc-protobuf-lite-1.41.0.jar:/data/dolphinscheduler/bin/../api-server/libs/grpc-stub-1.41.0.jar:/data/dolphinscheduler/bin/../api-server/libs/gson-2.9.1.jar:/data/dolphinscheduler/bin/../api-server/libs/guava-31.1-jre.jar:/data/dolphinscheduler/bin/../api-server/libs/guava-retrying-2.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-annotations-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-auth-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-client-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-common-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-hdfs-client-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-mapreduce-client-common-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-mapreduce-client-core-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-mapreduce-client-jobclient-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-yarn-api-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-yarn-client-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hadoop-yarn-common-3.2.4.jar:/data/dolphinscheduler/bin/../api-server/libs/hbase-noop-htrace-4.1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/hibernate-validator-6.2.2.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/hive-common-2.3.9.jar:/data/dolphinscheduler/bin/../api-server/libs/hive-jdbc-2.3.9.jar:/data/dolphinscheduler/bin/../api-server/libs/hive-metastore-2.3.9.jar:/data/dolphinscheduler/bin/../api-server/libs/hive-serde-2.3.9.jar:/data/dolphinscheduler/bin/../api-server/libs/hive-service-2.3.9.jar:/data/dolphinscheduler/bin/../api-server/libs/hive-service-rpc-2.3.9.jar:/data/dolphinscheduler/bin/../api-server/libs/hive-storage-api-2.4.0.jar:/data/dolphinscheduler/bin/../api-server/libs/httpasyncclient-4.1.5.jar:/data/dolphinscheduler/bin/../api-server/libs/httpclient-4.5.13.jar:/data/dolphinscheduler/bin/../api-server/libs/httpcore-4.4.15.jar:/data/dolphinscheduler/bin/../api-server/libs/httpcore-nio-4.4.15.jar:/data/dolphinscheduler/bin/../api-server/libs/httpmime-4.5.13.jar:/data/dolphinscheduler/bin/../api-server/libs/ini4j-0.5.4.jar:/data/dolphinscheduler/bin/../api-server/libs/ion-java-1.0.2.jar:/data/dolphinscheduler/bin/../api-server/libs/j2objc-annotations-1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-annotations-2.13.4.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-core-2.13.4.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-core-asl-1.9.13.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-databind-2.13.4.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-dataformat-cbor-2.13.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-dataformat-yaml-2.13.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-datatype-jdk8-2.13.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-datatype-jsr310-2.13.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-jaxrs-base-2.13.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-jaxrs-json-provider-2.13.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-mapper-asl-1.9.13.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-module-jaxb-annotations-2.13.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jackson-module-parameter-names-2.13.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jakarta.activation-api-1.2.2.jar:/data/dolphinscheduler/bin/../api-server/libs/jakarta.annotation-api-1.3.5.jar:/data/dolphinscheduler/bin/../api-server/libs/jakarta.servlet-api-4.0.4.jar:/data/dolphinscheduler/bin/../api-server/libs/jakarta.validation-api-2.0.2.jar:/data/dolphinscheduler/bin/../api-server/libs/jakarta.websocket-api-1.1.2.jar:/data/dolphinscheduler/bin/../api-server/libs/jakarta.xml.bind-api-2.3.3.jar:/data/dolphinscheduler/bin/../api-server/libs/jamon-runtime-2.3.1.jar:/data/dolphinscheduler/bin/../api-server/libs/janino-3.0.16.jar:/data/dolphinscheduler/bin/../api-server/libs/javax.activation-api-1.2.0.jar:/data/dolphinscheduler/bin/../api-server/libs/javax.annotation-api-1.3.2.jar:/data/dolphinscheduler/bin/../api-server/libs/javax.el-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/javax.jdo-3.2.0-m3.jar:/data/dolphinscheduler/bin/../api-server/libs/javax.servlet-api-3.1.0.jar:/data/dolphinscheduler/bin/../api-server/libs/javolution-5.5.1.jar:/data/dolphinscheduler/bin/../api-server/libs/jaxb-api-2.3.1.jar:/data/dolphinscheduler/bin/../api-server/libs/jboss-logging-3.4.3.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/jcip-annotations-1.0-1.jar:/data/dolphinscheduler/bin/../api-server/libs/jdo-api-3.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/jdom2-2.0.6.1.jar:/data/dolphinscheduler/bin/../api-server/libs/jersey-servlet-1.19.jar:/data/dolphinscheduler/bin/../api-server/libs/jetcd-common-0.5.11.jar:/data/dolphinscheduler/bin/../api-server/libs/jetcd-core-0.5.11.jar:/data/dolphinscheduler/bin/../api-server/libs/jettison-1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-client-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-continuation-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-http-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-io-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-security-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-server-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-servlet-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-servlets-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-util-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-util-ajax-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-webapp-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jetty-xml-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/jline-2.12.jar:/data/dolphinscheduler/bin/../api-server/libs/jmespath-java-1.12.160.jar:/data/dolphinscheduler/bin/../api-server/libs/jna-5.10.0.jar:/data/dolphinscheduler/bin/../api-server/libs/jna-platform-5.10.0.jar:/data/dolphinscheduler/bin/../api-server/libs/joda-time-2.10.13.jar:/data/dolphinscheduler/bin/../api-server/libs/jpam-1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/json-1.8.jar:/data/dolphinscheduler/bin/../api-server/libs/json-path-2.7.0.jar:/data/dolphinscheduler/bin/../api-server/libs/json-smart-2.4.8.jar:/data/dolphinscheduler/bin/../api-server/libs/jsp-api-2.1.jar:/data/dolphinscheduler/bin/../api-server/libs/jsqlparser-4.4.jar:/data/dolphinscheduler/bin/../api-server/libs/jsr305-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/jta-1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/jul-to-slf4j-1.7.36.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-admin-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-client-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-common-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-core-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-crypto-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-identity-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-server-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-simplekdc-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerb-util-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerby-asn1-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerby-config-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerby-pkix-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerby-util-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kerby-xdr-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/kotlin-stdlib-1.6.21.jar:/data/dolphinscheduler/bin/../api-server/libs/kotlin-stdlib-common-1.6.21.jar:/data/dolphinscheduler/bin/../api-server/libs/kotlin-stdlib-jdk7-1.6.21.jar:/data/dolphinscheduler/bin/../api-server/libs/kotlin-stdlib-jdk8-1.6.21.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-client-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-admissionregistration-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-apiextensions-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-apps-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-autoscaling-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-batch-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-certificates-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-common-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-coordination-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-core-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-discovery-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-events-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-extensions-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-flowcontrol-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-metrics-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-networking-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-node-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-policy-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-rbac-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-scheduling-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/kubernetes-model-storageclass-5.10.2.jar:/data/dolphinscheduler/bin/../api-server/libs/libfb303-0.9.3.jar:/data/dolphinscheduler/bin/../api-server/libs/libthrift-0.9.3.jar:/data/dolphinscheduler/bin/../api-server/libs/log4j-1.2-api-2.17.2.jar:/data/dolphinscheduler/bin/../api-server/libs/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/data/dolphinscheduler/bin/../api-server/libs/logback-classic-1.2.11.jar:/data/dolphinscheduler/bin/../api-server/libs/logback-core-1.2.11.jar:/data/dolphinscheduler/bin/../api-server/libs/logging-interceptor-4.9.3.jar:/data/dolphinscheduler/bin/../api-server/libs/lz4-java-1.4.0.jar:/data/dolphinscheduler/bin/../api-server/libs/mapstruct-1.3.1.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/metrics-core-4.2.11.jar:/data/dolphinscheduler/bin/../api-server/libs/micrometer-core-1.9.3.jar:/data/dolphinscheduler/bin/../api-server/libs/micrometer-registry-prometheus-1.9.3.jar:/data/dolphinscheduler/bin/../api-server/libs/mssql-jdbc-6.1.0.jre8.jar:/data/dolphinscheduler/bin/../api-server/libs/mybatis-3.5.10.jar:/data/dolphinscheduler/bin/../api-server/libs/mybatis-plus-3.5.2.jar:/data/dolphinscheduler/bin/../api-server/libs/mybatis-plus-annotation-3.5.2.jar:/data/dolphinscheduler/bin/../api-server/libs/mybatis-plus-boot-starter-3.5.2.jar:/data/dolphinscheduler/bin/../api-server/libs/mybatis-plus-core-3.5.2.jar:/data/dolphinscheduler/bin/../api-server/libs/mybatis-plus-extension-3.5.2.jar:/data/dolphinscheduler/bin/../api-server/libs/mybatis-spring-2.0.7.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-all-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-buffer-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-codec-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-common-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-handler-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-resolver-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-tcnative-2.0.48.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-tcnative-classes-2.0.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-transport-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-transport-native-epoll-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/netty-transport-native-unix-common-4.1.53.Final.jar:/data/dolphinscheduler/bin/../api-server/libs/nimbus-jose-jwt-9.8.1.jar:/data/dolphinscheduler/bin/../api-server/libs/okhttp-2.7.5.jar:/data/dolphinscheduler/bin/../api-server/libs/okhttp-4.9.3.jar:/data/dolphinscheduler/bin/../api-server/libs/okio-2.8.0.jar:/data/dolphinscheduler/bin/../api-server/libs/opencsv-2.3.jar:/data/dolphinscheduler/bin/../api-server/libs/opentracing-api-0.33.0.jar:/data/dolphinscheduler/bin/../api-server/libs/opentracing-noop-0.33.0.jar:/data/dolphinscheduler/bin/../api-server/libs/opentracing-util-0.33.0.jar:/data/dolphinscheduler/bin/../api-server/libs/oshi-core-6.1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/paranamer-2.3.jar:/data/dolphinscheduler/bin/../api-server/libs/parquet-hadoop-bundle-1.8.1.jar:/data/dolphinscheduler/bin/../api-server/libs/perfmark-api-0.23.0.jar:/data/dolphinscheduler/bin/../api-server/libs/postgresql-42.4.1.jar:/data/dolphinscheduler/bin/../api-server/libs/presto-jdbc-0.238.1.jar:/data/dolphinscheduler/bin/../api-server/libs/proto-google-common-protos-2.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/protobuf-java-2.5.0.jar:/data/dolphinscheduler/bin/../api-server/libs/protobuf-java-util-3.17.2.jar:/data/dolphinscheduler/bin/../api-server/libs/protostuff-api-1.7.2.jar:/data/dolphinscheduler/bin/../api-server/libs/protostuff-collectionschema-1.7.2.jar:/data/dolphinscheduler/bin/../api-server/libs/protostuff-core-1.7.2.jar:/data/dolphinscheduler/bin/../api-server/libs/protostuff-runtime-1.7.2.jar:/data/dolphinscheduler/bin/../api-server/libs/py4j-0.10.9.jar:/data/dolphinscheduler/bin/../api-server/libs/quartz-2.3.2.jar:/data/dolphinscheduler/bin/../api-server/libs/re2j-1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/reflections-0.9.12.jar:/data/dolphinscheduler/bin/../api-server/libs/reload4j-1.2.18.3.jar:/data/dolphinscheduler/bin/../api-server/libs/simpleclient-0.15.0.jar:/data/dolphinscheduler/bin/../api-server/libs/simpleclient_common-0.15.0.jar:/data/dolphinscheduler/bin/../api-server/libs/simpleclient_tracer_common-0.15.0.jar:/data/dolphinscheduler/bin/../api-server/libs/simpleclient_tracer_otel-0.15.0.jar:/data/dolphinscheduler/bin/../api-server/libs/simpleclient_tracer_otel_agent-0.15.0.jar:/data/dolphinscheduler/bin/../api-server/libs/slf4j-api-1.7.36.jar:/data/dolphinscheduler/bin/../api-server/libs/snakeyaml-1.31.jar:/data/dolphinscheduler/bin/../api-server/libs/snappy-java-1.1.8.4.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-aop-5.3.22.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-beans-5.3.19.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-actuator-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-actuator-autoconfigure-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-autoconfigure-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-configuration-processor-2.6.1.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-actuator-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-aop-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-jdbc-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-jetty-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-json-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-logging-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-quartz-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-boot-starter-web-2.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-cloud-commons-3.1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-cloud-context-3.1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-cloud-kubernetes-commons-2.1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-cloud-kubernetes-fabric8-autoconfig-2.1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-cloud-kubernetes-fabric8-config-2.1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-cloud-starter-3.1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-cloud-starter-bootstrap-3.1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-cloud-starter-kubernetes-fabric8-config-2.1.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-context-5.3.19.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-context-support-5.3.22.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-core-5.3.19.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-expression-5.3.22.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-jcl-5.3.22.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-jdbc-5.3.19.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-ldap-1.1.2.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-plugin-core-2.0.0.RELEASE.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-plugin-metadata-2.0.0.RELEASE.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-retry-1.3.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-security-crypto-5.7.3.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-security-rsa-1.0.10.RELEASE.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-tx-5.3.19.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-web-5.3.22.jar:/data/dolphinscheduler/bin/../api-server/libs/spring-webmvc-5.3.22.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-bean-validators-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-boot-starter-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-core-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-data-rest-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-oas-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-schema-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-spi-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-spring-web-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-spring-webflux-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-spring-webmvc-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-swagger-common-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-swagger-ui-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/springfox-swagger2-3.0.0.jar:/data/dolphinscheduler/bin/../api-server/libs/stax-api-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/stax2-api-4.2.1.jar:/data/dolphinscheduler/bin/../api-server/libs/swagger-annotations-1.5.20.jar:/data/dolphinscheduler/bin/../api-server/libs/swagger-annotations-2.1.2.jar:/data/dolphinscheduler/bin/../api-server/libs/swagger-models-1.5.20.jar:/data/dolphinscheduler/bin/../api-server/libs/swagger-models-2.1.2.jar:/data/dolphinscheduler/bin/../api-server/libs/tephra-api-0.6.0.jar:/data/dolphinscheduler/bin/../api-server/libs/token-provider-1.0.1.jar:/data/dolphinscheduler/bin/../api-server/libs/tomcat-embed-el-9.0.65.jar:/data/dolphinscheduler/bin/../api-server/libs/transaction-api-1.1.jar:/data/dolphinscheduler/bin/../api-server/libs/unirest-java-3.7.04-standalone.jar:/data/dolphinscheduler/bin/../api-server/libs/websocket-api-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/websocket-client-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/websocket-common-9.4.48.v20220622.jar:/data/dolphinscheduler/bin/../api-server/libs/woodstox-core-5.3.0.jar:/data/dolphinscheduler/bin/../api-server/libs/zeppelin-client-0.10.1.jar:/data/dolphinscheduler/bin/../api-server/libs/zeppelin-common-0.10.1.jar:/data/dolphinscheduler/bin/../api-server/libs/zjsonpatch-0.3.0.jar:/data/dolphinscheduler/bin/../api-server/libs/zookeeper-3.8.0.jar:/data/dolphinscheduler/bin/../api-server/libs/zookeeper-jute-3.8.0.jar:/data/dolphinscheduler/bin/../api-server/libs/mysql-connector-java-8.0.26.jar
14:29:14.320 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
14:29:14.320 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
14:29:14.320 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
14:29:14.320 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
14:29:14.320 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
14:29:14.320 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.10.0-1160.71.1.el7.x86_64
14:29:14.321 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
14:29:14.321 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
14:29:14.321 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/data/dolphinscheduler
14:29:14.321 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.free=971MB
14:29:14.321 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.max=1007MB
14:29:14.321 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.total=1007MB
14:29:14.329 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=192.168.72.106:2181,192.168.72.113:2181,192.168.72.114:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@51e2adc7
14:29:14.338 [main] INFO org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
14:29:14.360 [main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 1048575 Bytes
14:29:14.412 [main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=false
14:29:14.415 [main] DEBUG org.apache.zookeeper.ZooKeeperMain - Processing deleteall
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/cli/DefaultParser
at org.apache.zookeeper.cli.DeleteAllCommand.parse(DeleteAllCommand.java:52)
at org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:438)
at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:367)
at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:350)
at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:293)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.cli.DefaultParser
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 5 more
5.startup
192.168.72.106:default
192.168.72.113:default
192.168.72.114:default
192.168.72.113 master server is starting
Begin start master-server......
starting master-server, logging to /data/dolphinscheduler/master-server/logs
Overwrite master-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
End start master-server.
192.168.72.106 worker server is starting
Begin start worker-server......
starting worker-server, logging to /data/dolphinscheduler/worker-server/logs
Overwrite worker-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
End start worker-server.
192.168.72.113 worker server is starting
Begin start worker-server......
starting worker-server, logging to /data/dolphinscheduler/worker-server/logs
Overwrite worker-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
End start worker-server.
192.168.72.114 worker server is starting
Begin start worker-server......
starting worker-server, logging to /data/dolphinscheduler/worker-server/logs
Overwrite worker-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
End start worker-server.
Begin start alert-server......
starting alert-server, logging to /data/dolphinscheduler/alert-server/logs
Overwrite alert-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
End start alert-server.
192.168.72.106 api server is starting
Begin start api-server......
starting api-server, logging to /data/dolphinscheduler/api-server/logs
Overwrite api-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
End start api-server.
query server status
====================== dolphinscheduler server config =============================
1.dolphinscheduler server node config hosts:[ 192.168.72.106,192.168.72.113,192.168.72.114 ]
2.master server node config hosts:[ 192.168.72.113 ]
3.worker server node config hosts:[ 192.168.72.106:default,192.168.72.113:default,192.168.72.114:default ]
4.alert server node config hosts:[ 192.168.72.114 ]
5.api server node config hosts:[ 192.168.72.106 ]
====================== dolphinscheduler server status =============================
node server state
192.168.72.113 Begin status master-server......
master-server [ RUNNING ]
End status master-server.
192.168.72.106 Begin status worker-server......
worker-server [ RUNNING ]
End status worker-server.
192.168.72.113 Begin status worker-server......
worker-server [ RUNNING ]
End status worker-server.
192.168.72.114 Begin status worker-server......
worker-server [ RUNNING ]
End status worker-server.
192.168.72.114 Begin status alert-server......
alert-server [ RUNNING ]
End status alert-server.
192.168.72.106 Begin status api-server......
api-server [ RUNNING ]
End status api-server.
执行节点状态检查命令./bin/status-all.sh
可以看到很多角色已经stop
[root@localhost dolphinscheduler]# ./bin/status-all.sh
====================== dolphinscheduler server config =============================
1.dolphinscheduler server node config hosts:[ 192.168.72.106,192.168.72.113,192.168.72.114 ]
2.master server node config hosts:[ 192.168.72.113 ]
3.worker server node config hosts:[ 192.168.72.106:default,192.168.72.113:default,192.168.72.114:default ]
4.alert server node config hosts:[ 192.168.72.114 ]
5.api server node config hosts:[ 192.168.72.106 ]
====================== dolphinscheduler server status =============================
node server state
192.168.72.113 Begin status master-server......
master-server [ STOP ]
End status master-server.
192.168.72.106 Begin status worker-server......
worker-server [ STOP ]
End status worker-server.
192.168.72.113 Begin status worker-server......
worker-server [ STOP ]
End status worker-server.
192.168.72.114 Begin status worker-server......
worker-server [ STOP ]
End status worker-server.
192.168.72.114 Begin status alert-server......
alert-server [ RUNNING ]
End status alert-server.
192.168.72.106 Begin status api-server......
api-server [ STOP ]
End status api-server.
排查日志
[root@localhost dolphinscheduler]# vim api-server/logs/api-server-localhost.localdomain.out
Caused by: org.apache.dolphinscheduler.registry.api.RegistryException: zookeeper connect timeout: 192.168.72.106:2181,192.168.72.113:2181,192.168.72.114:2181
at org.apache.dolphinscheduler.plugin.registry.zookeeper.ZookeeperRegistry.start(ZookeeperRegistry.java:110)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
看到zk连接超时。 处理方案,修改对应机器上的application.yaml 文件connection-timeout 和block-until-connected 都为60s
[root@localhost dolphinscheduler]# vim master-server/conf/application.yaml
[root@localhost dolphinscheduler]# vim worker-server/conf/application.yaml
[root@localhost dolphinscheduler]# vim api-server/conf/application.yaml
registry:
type: zookeeper
zookeeper:
namespace: dolphinscheduler
connect-string: localhost:2181
retry-policy:
base-sleep-time: 60ms
max-sleep: 300ms
max-retries: 5
session-timeout: 30s
connection-timeout: 60s
block-until-connected: 60s
digest: ~
再次启动所有节点
[root@localhost dolphinscheduler]# ./bin/start-all.sh
########再检查节点状态
[root@localhost dolphinscheduler]# ./bin/status-all.sh
====================== dolphinscheduler server config =============================
1.dolphinscheduler server node config hosts:[ 192.168.72.106,192.168.72.113,192.168.72.114 ]
2.master server node config hosts:[ 192.168.72.113 ]
3.worker server node config hosts:[ 192.168.72.106:default,192.168.72.113:default,192.168.72.114:default ]
4.alert server node config hosts:[ 192.168.72.114 ]
5.api server node config hosts:[ 192.168.72.106 ]
====================== dolphinscheduler server status =============================
node server state
192.168.72.113 Begin status master-server......
master-server [ RUNNING ]
End status master-server.
192.168.72.106 Begin status worker-server......
worker-server [ RUNNING ]
End status worker-server.
192.168.72.113 Begin status worker-server......
worker-server [ RUNNING ]
End status worker-server.
192.168.72.114 Begin status worker-server......
worker-server [ RUNNING ]
End status worker-server.
192.168.72.114 Begin status alert-server......
alert-server [ RUNNING ]
End status alert-server.
192.168.72.106 Begin status api-server......
api-server [ RUNNING ]
End status api-server.
全部启动ok
访问页面apiserver的12345端口,初始用户密码 admin/dolphinscheduler123
http://192.168.72.106:12345/dolphinscheduler/ui/