dolphinscheduler 报错: core-site.xml not found

关于dolphinscheduler 在hdfs文件系统中创建目录失败

我使用的是shell 的datax的模式,通过 dolphinscheduler 来调度
调度日志报错 如下

执行的时候,会先创建hdfs的 对应目录,在同步数据集

1. 在执行报错之前, 我已配置了dolphinscheduler 的admin的环境变量
   

export HADOOP_CONF_DIR=/etc/hadoop/conf
export HADOOP_PREFIX=/opt/cloudera/parcels/CDH/lib/hadoop
export HADOOP_HOME=$HADOOP_PREFIX
export HIVE_HOME=$HADOOP_PREFIX/../hive
export HBASE_HOME=$HADOOP_PREFIX/../hbase
export HADOOP_HDFS_HOME=$HADOOP_PREFIX/../hadoop-hdfs
export HADOOP_MAPRED_HOME=$HADOOP_PREFIX/../hadoop-mapreduce
export HADOOP_YARN_HOME=$HADOOP_PREFIX/../hadoop-yarn
export DATAX_HOME=/export/server/datax/
export JAVA_HOME=/export/server/jdk1.8.0_281
export PATH=$PATH:$HADOOP_HOME/bin:$SPARK_HOME/bin:$JAVA_HOME/bin:$HIVE_HOME/bin:$DATAX_HOME/bin

**我执行之前已经配置了环境变量,还是报错, 经过查找 dolphinscheduler 的worker日志发现问题 **

[INFO] 2024-05-08 15:00:17.007 org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[119] - received command : TaskExecuteRequestCommand{
   taskExecutionContext='{"taskInstanceId":28,"taskName":"datax_data_to_hdfs_data","firstSubmitTime":null,"startTime":null,"taskType":"SHELL","host":null,"executePath":null,"logPath":null,"taskJson":null,"processId":0,"processDefineCode":13530253122752,"processDefineVersion":5,"appIds":null,"processInstanceId":15,"scheduleTime":null,"globalParams":null,"executorId":1,"cmdTypeIfComplement":0,"tenantCode":"zhangxp","queue":"default","projectCode":13530245069120,"taskParams":"{\"resourceList\":[{\"id\":4,\"res\":\"insurance_mysql_to_hdfs_full.sh\",\"resourceName\":\"/insurance_scripts/insurance_mysql_to_hdfs_full.sh\"}],\"localParams\":[{\"prop\":\"dt\",\"direct\":\"IN\",\"type\":\"VARCHAR\",\"value\":\" all   2024-05-01\"}],\"rawScript\":\"bash insurance_scripts/insurance_mysql_to_hdfs_full.sh ${dt}\",\"dependence\":{},\"conditionResult\":{\"successNode\":[],\"failedNode\":[]},\"waitStartTimeout\":{},\"switchResult\":{}}","envFile":null,"environmentConfig":null,"definedParams":null,"taskAppId":null,"taskTimeoutStrategy":null,"taskTimeout":2147483647,"workerGroup":"default","delayTime":0,"currentExecutionStatus":null,"resources":{"/insurance_scripts/insurance_mysql_to_hdfs_full.sh":"zhangxp"},"sqlTaskExecutionContext":{"warningGroupId":0,"connectionParams":null,"udfFuncTenantCodeMap":null,"defaultFS":null},"dataxTaskExecutionContext":{"dataSourceId":0,"sourcetype":0,"sourceConnectionParams":null,"dataTargetId":0,"targetType":0,"targetConnectionParams":null},"dependenceTaskExecutionContext":null,"sqoopTaskExecutionContext":{"dataSourceId":0,"sourcetype":0,"sourceConnectionParams":null,"dataTargetId":0,"targetType":0,"targetConnectionParams":null},"varPool":null,"dryRun":0,"paramsMap":null,"procedureTaskExecutionContext":{"connectionParams":null}}'}
[INFO] 2024-05-08 15:00:17.010 org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[142] - task instance local execute path : /tmp/dolphinscheduler/exec/process/13530245069120/13530253122752_5/15/28
[INFO] 2024-05-08 15:00:17.011 org.apache.dolphinscheduler.common.utils.FileUtils:[121] - create dir success /tmp/dolphinscheduler/exec/process/13530245069120/13530253122752_5/15/28
[INFO] 2024-05-08 15:00:17.01