azkaban中提醒“azkaban.jobExecutor.utils.process.ProcessFailureException”报错解答

最新推荐文章于 2022-09-23 14:23:30 发布

原创最新推荐文章于 2022-09-23 14:23:30 发布 · 4.4k 阅读

3 ·

CC 4.0 BY-SA版权

文章标签：

#hadoop #大数据 #sqoop

bug解答专栏收录该内容

22 篇文章

订阅专栏

在Azkaban执行任务时遇到'azkaban.jobExecutor.utils.process.ProcessFailureException'错误，原因是提交的文件格式不正确。通过使用Nodepad++转换文件格式，将文件保存为正确格式，问题得到解决。

09-09-2020 15:54:24 CST test01 INFO - Starting job test01 at 1599638064795
09-09-2020 15:54:24 CST test01 INFO - job JVM args: -Dazkaban.flowid=test01 -Dazkaban.execid=22 -Dazkaban.jobid=test01
09-09-2020 15:54:24 CST test01 INFO - user.to.proxy property was not set, defaulting to submit user azkaban
09-09-2020 15:54:24 CST test01 INFO - Building command job executor. 
09-09-2020 15:54:24 CST test01 INFO - Memory granted for job test01
09-09-2020 15:54:24 CST test01 INFO - 1 commands to execute.
09-09-2020 15:54:24 CST test01 INFO - cwd=/export/servers/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT/executions/22
09-09-2020 15:54:24 CST test01 INFO - effective user is: azkaban
09-09-2020 15:54:24 CST test01 INFO - Command: sh master.sh
09-09-2020 15:54:24 CST test01 INFO - Environment variables: {JOB_OUTPUT_PROP_FILE=/export/servers/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT/executions/22/test01_output_6520288772116028913_tmp, JOB_PROP_FILE=/export/servers/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT/executions/22/test01_props_6637125778460322567_tmp, KRB5CCNAME=/tmp/krb5cc__test01__test01__test01__22__azkaban, JOB_NAME=test01}
09-09-2020 15:54:24 CST test01 INFO - Working directory: /export/servers/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT/executions/22
09-09-2020 15:54:24 CST test01 INFO - master.sh:行2: /export/servers/hadoop/etc/hadoop/: 是一个目录
09-09-2020 15:54:24 CST test01 INFO - Process completed unsuccessfully in 0 seconds.
09-09-2020 15:54:24 CST test01 ERROR - Job run failed!
java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException
 at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:304)
 at azkaban.execapp.JobRunner.runJob(JobRunner.java:784)
 at azkaban.execapp.JobRunner.doRun(JobRunner.java:600)
 at azkaban.execapp.JobRunner.run(JobRunner.java:561)
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException
 at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:130)
 at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:296)
 ... 8 more
09-09-2020 15:54:24 CST test01 ERROR - azkaban.jobExecutor.utils.process.ProcessFailureException cause: azkaban.jobExecutor.utils.process.ProcessFailureException
09-09-2020 15:54:24 CST test01 INFO - Finishing job test01 at 1599638064922 with status FAILED

这种报错信息中说，你提交的文件格式不是utils格式，最重要i是这句话

java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException

我选用把文件在nodepad++上变化格式
具体如下图所示：
在这里插入图片描述
完成保存即可。