DolphinScheduler的异常解决

原创已于 2025-01-17 11:28:42 修改 · 1.9k 阅读

1 ·

CC 4.0 BY-SA版权

文章标签：

#大数据

于 2023-08-16 11:18:17 首次发布

大数据专栏收录该内容

30 篇文章

订阅专栏

本文讲述了在部署开源任务调度平台DolphinScheduler时遇到的问题，工作流停止后无法删除并伴随大量重复日志，涉及错误堆栈和数据库查询操作。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

参考：开源任务调度平台dolphinscheduler部署及使用指南（未完）_开源分布式任务调度平台_省略号的搬运工的博客-优快云博客

一、可能出现的报错（严重）：工作流停止后无法删除，log重复刷屏直至磁盘存满

[ERROR] 2023-08-16 10:14:21.387 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=1038)
[INFO] 2023-08-16 10:14:21.387 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=1038)
[INFO] 2023-08-16 10:14:21.387 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=1038), will handle this
[INFO] 2023-08-16 10:14:21.387 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=1038)
[ERROR] 2023-08-16 10:14:21.387 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[704] - Start workflow error
java.lang.NullPointerException: null
   at org.apache.dolphinscheduler.service.utils.DagHelper.parsePostNodes(DagHelper.java:306)
   at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1314)
   at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:698)
   at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   at java.lang.Thread.run(Thread.java:750)

产生大量日志：

workflowInstanceId=1038

查询DolphinScheduler表的状态:

select t1.id,t1.task_code,t1.state,t2.state from t_ds_task_instance t1 left join t_ds_process_instance t2 on t1.process_instance_id = t2.id where t2.id = 1038;

select id,name,state from t_ds_process_instance where id = 1038 limit 1;

update t_ds_process_instance set state = 7 where id = 1038;

docker cp dolphinscheduler:/opt/apache-dolphinscheduler-3.1.7-bin/standalone-server/logs/dolphinscheduler-standalone.2023-08-18_09.0.log dolphinscheduler-standalone.2023-08-18_09.0.log