BigData-17:Azkaban

Azkaban概述

Azkaban是一个分布式工作流管理器,在LinkedIn上实现,以解决Hadoop作业依赖性问题。我们
有需要按顺序运行的工作,从ETL工作到数据分析产品。
特点:

1)给用户提供了一个非常友好的可视化界面->web界面
2)非常方便的上传工作流-》打成压缩包
3)设置任务间的关系
4)权限设置-》删库到跑路
5)模块化
6)随时停止和启动任务
7)可以查看日志记录

与Oozie对比
和Oozie相对比,azkaban是一个轻量级调度工具。

企业应用的功能并非小众的功能可以使用Azkaban。

1)功能
两个任务流调度器可以调度使用mr,java,脚本工作流任务
都可以进行定时调度…
2)使用
az直接传参
Oozie直接传参,支持EL表达式…
3)定时
az定时执行任务基于时间
Oozie任务基于时间和数据
4)资源
az有严格的权限控制
Oozie无严格权限控制

Azkaban安装部署

准备工作
1)快照
2)上传安装包
alt+p
3)解压重命名
tar -zxvf
mv
4)mysql中azkaban脚本导入
source /root/hd/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql
安装部署
1)创建SSL(安全连接)配置
服务器需要一个证书
keytool -keystore keystore -alias jetty -genkey -keyalg RSA
2)时间同步设置
生成时区文件
tzselect生成
5->9->1->yes
拷贝时区文件
cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
集群时间同步
crt中开启交互窗口 发送
sudo date -s '2018-11-28 20:41:33'
3)修改配置文件
4)启动web服务器
bin/azkaban-web-start.sh
5)启动执行器
bin/azkaban-executor-start.sh
6)访问web
https://192.168.50.183:8443

2025-12-30 14:33:11 - Starting job data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1 at 1767076391941 2025-12-30 14:33:11 - job JVM args: '-Dazkaban.flowid=data-dev-proj-5436b5f721ea4ccfbe2759f26595f830' '-Dazkaban.execid=17115' '-Dazkaban.jobid=data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1' 2025-12-30 14:33:11 - user.to.proxy property was not set, defaulting to submit user azkaban 2025-12-30 14:33:11 - Building command job executor. 2025-12-30 14:33:11 - Memory granted for job data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1 2025-12-30 14:33:11 - 1 commands to execute. 2025-12-30 14:33:11 - cwd=/data/bsmp/portal/azkaban-exec-server-4.0.3.1/executions/17115 2025-12-30 14:33:11 - effective user is: azkaban 2025-12-30 14:33:11 - Command: sh /home/bsmp/portal/proj-flow-executor/bin/flow-start.sh 'eyJmaWxlTmFtZSI6InRhcmdldC1hbGdvcml0aG0tamFyLXdpdGgtZGVwZW5kZW5jaWVzLmphciIsImdsb2JhbER5bmFtaWNQYXJhbXMiOlt7InBhcmFtVHlwZSI6ImZ1bmMiLCJ0aW1lZm9ybWF0IjoiZnVuYyIsInBhcmFtVmFsdWVUeXBlIjoiZnVuYyIsInBhcmFtTmFtZSI6ImR0X25vdyIsInZhbHVlIjoiTk9XKCk6OkRBVEUifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6Im1hbiIsInZhbHVlIjoibWFuIn0seyJwYXJhbVR5cGUiOiJ5eXl5LU1NLWRkIiwidGltZWZvcm1hdCI6Inl5eXktTU0tZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXktTU0tZGQiLCJwYXJhbU5hbWUiOiJlbmRfZGF0ZSIsInZhbHVlIjoiMjAyNS0wNS0yMSJ9LHsicGFyYW1UeXBlIjoieXl5eU1NZGQiLCJ0aW1lZm9ybWF0IjoieXl5eU1NZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXlNTWRkIiwicGFyYW1OYW1lIjoiZW5kZGF5IiwidmFsdWUiOiIyMDI0MDkzMCJ9LHsicGFyYW1UeXBlIjoieXl5eU1NZGQiLCJ0aW1lZm9ybWF0IjoieXl5eU1NZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXlNTWRkIiwicGFyYW1OYW1lIjoiYmVnaW5kYXkiLCJ2YWx1ZSI6IjIwMjQwOTAxIn0seyJwYXJhbVR5cGUiOiJ5eXl5IiwidGltZWZvcm1hdCI6Inl5eXkiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXkiLCJwYXJhbU5hbWUiOiJ5ZWFyIiwidmFsdWUiOiIyMDI0In0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJjdXJfZmxnIiwidmFsdWUiOiJZIn0seyJwYXJhbVR5cGUiOiJ5eXl5LU1NIiwidGltZWZvcm1hdCI6Inl5eXktTU0iLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXktTU0iLCJwYXJhbU5hbWUiOiJ5ZWFyX21vbnRoIiwidmFsdWUiOiIyMDI0LTAyIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJxbXMiLCJ2YWx1ZSI6InFtcyJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoiaGZtIiwidmFsdWUiOiJoZm0ifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImVycCIsInZhbHVlIjoiZXJwIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJlbXMiLCJ2YWx1ZSI6ImVtcyJ9LHsicGFyYW1UeXBlIjoieXl5eU1NIiwidGltZWZvcm1hdCI6Inl5eXlNTSIsInBhcmFtVmFsdWVUeXBlIjoieXl5eU1NIiwicGFyYW1OYW1lIjoieWVhcm1vbnRoIiwidmFsdWUiOiIyMDI0MDIifSx7InBhcmFtVHlwZSI6InRpbWVzdGFtcCIsInRpbWVmb3JtYXQiOiJ0aW1lc3RhbXAiLCJwYXJhbVZhbHVlVHlwZSI6InRpbWVzdGFtcCIsInBhcmFtTmFtZSI6ImF1eF9wcm9jX2lkIiwidmFsdWUiOiIxNzQxMTkwNDAwMDAwIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJpc19kZWwiLCJ2YWx1ZSI6Ik4ifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImJvciIsInZhbHVlIjoiYm9yIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJmaW4iLCJ2YWx1ZSI6ImZpbiJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoicm1iciIsInZhbHVlIjoicm1iciJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoibXIiLCJ2YWx1ZSI6Im1yIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJza2V5IiwidmFsdWUiOiIifSx7InBhcmFtVHlwZSI6Inl5eXktTU0tZGQgSEg6bW06c3MiLCJ0aW1lZm9ybWF0IjoieXl5eS1NTS1kZCBISDptbTpzcyIsInBhcmFtVmFsdWVUeXBlIjoieXl5eS1NTS1kZCBISDptbTpzcyIsInBhcmFtTmFtZSI6ImR0IiwidmFsdWUiOiIyMDI0LTEyLTMxIDAwOjAwOjAwIn0seyJwYXJhbVR5cGUiOiJ5eXl5TU1kZCIsInRpbWVmb3JtYXQiOiJ5eXl5TU1kZCIsInBhcmFtVmFsdWVUeXBlIjoieXl5eU1NZGQiLCJwYXJhbU5hbWUiOiJnX2R0IiwidmFsdWUiOiIyMDI0MTIyNCJ9XSwibWFpbkNsYXNzIjoiY29tLmNyYy5hbGdvcml0aG0uTWFpbkFwcCIsImV4ZWN1dGVQYXRoIjoiL2hvbWUvYmlnZGF0YS1jcmFiYy9leGVjdXRvcnMvNTQzNmI1ZjcyMWVhNGNjZmJlMjc1OWYyNjU5NWY4MzAvNjExMGRlOGY0MjFhNGIwNTg4OTk0MTJkOGEwMWVkYmMvVjEvMTc2NzA3NTk1NTM2OC8iLCJkb3dubG9hZFVybCI6Ii81NDM2YjVmNzIxZWE0Y2NmYmUyNzU5ZjI2NTk1ZjgzMC82MTEwZGU4ZjQyMWE0YjA1ODg5OTQxMmQ4YTAxZWRiYy9WMS8xNzY3MDc1OTU1MzY4L3RhcmdldC1hbGdvcml0aG0tamFyLXdpdGgtZGVwZW5kZW5jaWVzLmphciIsIm1pbmlvLmFjY2Vzcy5rZXkiOiJtaW5pbyIsImV4ZWNVc2VyIjoiYmlnZGF0YS1jcmFiYyIsInR5cGUiOjcsImR5bmFtaWNQYXJhbXMiOlt7InBhcmFtVHlwZSI6Inl5eXlNTSIsInRpbWVmb3JtYXQiOiJ5eXl5TU0iLCJwYXJhbVZhbHVlVHlwZSI6ImRhdGUiLCJwYXJhbU5hbWUiOiJiZWdpbnllYXJtb250aCIsInZhbHVlIjoiMjAyNTA2In0seyJwYXJhbVR5cGUiOiJ5eXl5TU0iLCJ0aW1lZm9ybWF0IjoieXl5eU1NIiwicGFyYW1WYWx1ZVR5cGUiOiJkYXRlIiwicGFyYW1OYW1lIjoiZW5keWVhcm1vbnRoIiwidmFsdWUiOiIyMDI1MDYifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImRpbWNvZGUiLCJ2YWx1ZSI6Im9yZyJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoidGFyZ2V0dHlwZSIsInZhbHVlIjoiZGVyaXZhdGl2ZSJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoib3JnY29kZSIsInZhbHVlIjoiQ0hBMDQwMCJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoicmVwb3J0dHlwZSIsInZhbHVlIjoiUkVMRUFTRS1NT05USCJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoidGFyZ2V0U2hvcnRDb2RlIiwidmFsdWUiOiJYTC1KQ0tKVy1TTkpTTCJ9XSwibWluaW8udXJsIjoiaHR0cDovLzEwLjEzMy4xMTcuMTQwOjkwMDUiLCJtaW5pby5zZWNyZXQua2V5IjoiMXFhekBXU1giLCJzY3JpcHROYW1lIjoidGFyZ2V0LWFsZ29yaXRobS1qYXItd2l0aC1kZXBlbmRlbmNpZXMuamFyIiwic2NyaXB0UGFyYW0iOiIke2JlZ2lueWVhcm1vbnRofSwke2VuZHllYXJtb250aH0sJHtkaW1jb2RlfSwke3RhcmdldHR5cGV9LCR7cmVwb3J0dHlwZX0sJHtvcmdjb2RlfSwke3RhcmdldFNob3J0Q29kZX0iLCJvbmxpbmUuZmlsZS5idWNrZXQiOiJvbmxpbmUifQ==' 17115 2025-12-30 14:33:11 - Command after resolve: sh /home/bsmp/portal/proj-flow-executor/bin/flow-start.sh 'eyJmaWxlTmFtZSI6InRhcmdldC1hbGdvcml0aG0tamFyLXdpdGgtZGVwZW5kZW5jaWVzLmphciIsImdsb2JhbER5bmFtaWNQYXJhbXMiOlt7InBhcmFtVHlwZSI6ImZ1bmMiLCJ0aW1lZm9ybWF0IjoiZnVuYyIsInBhcmFtVmFsdWVUeXBlIjoiZnVuYyIsInBhcmFtTmFtZSI6ImR0X25vdyIsInZhbHVlIjoiTk9XKCk6OkRBVEUifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6Im1hbiIsInZhbHVlIjoibWFuIn0seyJwYXJhbVR5cGUiOiJ5eXl5LU1NLWRkIiwidGltZWZvcm1hdCI6Inl5eXktTU0tZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXktTU0tZGQiLCJwYXJhbU5hbWUiOiJlbmRfZGF0ZSIsInZhbHVlIjoiMjAyNS0wNS0yMSJ9LHsicGFyYW1UeXBlIjoieXl5eU1NZGQiLCJ0aW1lZm9ybWF0IjoieXl5eU1NZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXlNTWRkIiwicGFyYW1OYW1lIjoiZW5kZGF5IiwidmFsdWUiOiIyMDI0MDkzMCJ9LHsicGFyYW1UeXBlIjoieXl5eU1NZGQiLCJ0aW1lZm9ybWF0IjoieXl5eU1NZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXlNTWRkIiwicGFyYW1OYW1lIjoiYmVnaW5kYXkiLCJ2YWx1ZSI6IjIwMjQwOTAxIn0seyJwYXJhbVR5cGUiOiJ5eXl5IiwidGltZWZvcm1hdCI6Inl5eXkiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXkiLCJwYXJhbU5hbWUiOiJ5ZWFyIiwidmFsdWUiOiIyMDI0In0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJjdXJfZmxnIiwidmFsdWUiOiJZIn0seyJwYXJhbVR5cGUiOiJ5eXl5LU1NIiwidGltZWZvcm1hdCI6Inl5eXktTU0iLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXktTU0iLCJwYXJhbU5hbWUiOiJ5ZWFyX21vbnRoIiwidmFsdWUiOiIyMDI0LTAyIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJxbXMiLCJ2YWx1ZSI6InFtcyJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoiaGZtIiwidmFsdWUiOiJoZm0ifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImVycCIsInZhbHVlIjoiZXJwIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJlbXMiLCJ2YWx1ZSI6ImVtcyJ9LHsicGFyYW1UeXBlIjoieXl5eU1NIiwidGltZWZvcm1hdCI6Inl5eXlNTSIsInBhcmFtVmFsdWVUeXBlIjoieXl5eU1NIiwicGFyYW1OYW1lIjoieWVhcm1vbnRoIiwidmFsdWUiOiIyMDI0MDIifSx7InBhcmFtVHlwZSI6InRpbWVzdGFtcCIsInRpbWVmb3JtYXQiOiJ0aW1lc3RhbXAiLCJwYXJhbVZhbHVlVHlwZSI6InRpbWVzdGFtcCIsInBhcmFtTmFtZSI6ImF1eF9wcm9jX2lkIiwidmFsdWUiOiIxNzQxMTkwNDAwMDAwIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJpc19kZWwiLCJ2YWx1ZSI6Ik4ifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImJvciIsInZhbHVlIjoiYm9yIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJmaW4iLCJ2YWx1ZSI6ImZpbiJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoicm1iciIsInZhbHVlIjoicm1iciJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoibXIiLCJ2YWx1ZSI6Im1yIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJza2V5IiwidmFsdWUiOiIifSx7InBhcmFtVHlwZSI6Inl5eXktTU0tZGQgSEg6bW06c3MiLCJ0aW1lZm9ybWF0IjoieXl5eS1NTS1kZCBISDptbTpzcyIsInBhcmFtVmFsdWVUeXBlIjoieXl5eS1NTS1kZCBISDptbTpzcyIsInBhcmFtTmFtZSI6ImR0IiwidmFsdWUiOiIyMDI0LTEyLTMxIDAwOjAwOjAwIn0seyJwYXJhbVR5cGUiOiJ5eXl5TU1kZCIsInRpbWVmb3JtYXQiOiJ5eXl5TU1kZCIsInBhcmFtVmFsdWVUeXBlIjoieXl5eU1NZGQiLCJwYXJhbU5hbWUiOiJnX2R0IiwidmFsdWUiOiIyMDI0MTIyNCJ9XSwibWFpbkNsYXNzIjoiY29tLmNyYy5hbGdvcml0aG0uTWFpbkFwcCIsImV4ZWN1dGVQYXRoIjoiL2hvbWUvYmlnZGF0YS1jcmFiYy9leGVjdXRvcnMvNTQzNmI1ZjcyMWVhNGNjZmJlMjc1OWYyNjU5NWY4MzAvNjExMGRlOGY0MjFhNGIwNTg4OTk0MTJkOGEwMWVkYmMvVjEvMTc2NzA3NTk1NTM2OC8iLCJkb3dubG9hZFVybCI6Ii81NDM2YjVmNzIxZWE0Y2NmYmUyNzU5ZjI2NTk1ZjgzMC82MTEwZGU4ZjQyMWE0YjA1ODg5OTQxMmQ4YTAxZWRiYy9WMS8xNzY3MDc1OTU1MzY4L3RhcmdldC1hbGdvcml0aG0tamFyLXdpdGgtZGVwZW5kZW5jaWVzLmphciIsIm1pbmlvLmFjY2Vzcy5rZXkiOiJtaW5pbyIsImV4ZWNVc2VyIjoiYmlnZGF0YS1jcmFiYyIsInR5cGUiOjcsImR5bmFtaWNQYXJhbXMiOlt7InBhcmFtVHlwZSI6Inl5eXlNTSIsInRpbWVmb3JtYXQiOiJ5eXl5TU0iLCJwYXJhbVZhbHVlVHlwZSI6ImRhdGUiLCJwYXJhbU5hbWUiOiJiZWdpbnllYXJtb250aCIsInZhbHVlIjoiMjAyNTA2In0seyJwYXJhbVR5cGUiOiJ5eXl5TU0iLCJ0aW1lZm9ybWF0IjoieXl5eU1NIiwicGFyYW1WYWx1ZVR5cGUiOiJkYXRlIiwicGFyYW1OYW1lIjoiZW5keWVhcm1vbnRoIiwidmFsdWUiOiIyMDI1MDYifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImRpbWNvZGUiLCJ2YWx1ZSI6Im9yZyJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoidGFyZ2V0dHlwZSIsInZhbHVlIjoiZGVyaXZhdGl2ZSJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoib3JnY29kZSIsInZhbHVlIjoiQ0hBMDQwMCJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoicmVwb3J0dHlwZSIsInZhbHVlIjoiUkVMRUFTRS1NT05USCJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoidGFyZ2V0U2hvcnRDb2RlIiwidmFsdWUiOiJYTC1KQ0tKVy1TTkpTTCJ9XSwibWluaW8udXJsIjoiaHR0cDovLzEwLjEzMy4xMTcuMTQwOjkwMDUiLCJtaW5pby5zZWNyZXQua2V5IjoiMXFhekBXU1giLCJzY3JpcHROYW1lIjoidGFyZ2V0LWFsZ29yaXRobS1qYXItd2l0aC1kZXBlbmRlbmNpZXMuamFyIiwic2NyaXB0UGFyYW0iOiIke2JlZ2lueWVhcm1vbnRofSwke2VuZHllYXJtb250aH0sJHtkaW1jb2RlfSwke3RhcmdldHR5cGV9LCR7cmVwb3J0dHlwZX0sJHtvcmdjb2RlfSwke3RhcmdldFNob3J0Q29kZX0iLCJvbmxpbmUuZmlsZS5idWNrZXQiOiJvbmxpbmUiLCJleGVjdXRlSWQiOiIxNzExNSIsImZpcnN0U2NoZWR1bGUiOmZhbHNlfQ==' 17115 2025-12-30 14:33:11 - Environment variables: {JOB_OUTPUT_PROP_FILE=/data/bsmp/portal/azkaban-exec-server-4.0.3.1/executions/17115/data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1_output_1282755138096799914_tmp, JOB_PROP_FILE=/data/bsmp/portal/azkaban-exec-server-4.0.3.1/executions/17115/data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1_props_1712300918561815302_tmp, KRB5CCNAME=/tmp/krb5cc__data-dev-proj-5436b5f721ea4ccfbe2759f26595f830-V1__data-dev-proj-5436b5f721ea4ccfbe2759f26595f830__data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1__17115__azkaban, JOB_NAME=data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1} 2025-12-30 14:33:11 - Working directory: /data/bsmp/portal/azkaban-exec-server-4.0.3.1/executions/17115 2025-12-30 14:33:11 - Spawned process with id 32413 2025-12-30 14:33:12 - 14:33:12.380 [main] INFO com.aotain.flow.executor.Starter - ---------------------Start parameter list------------------------------- 2025-12-30 14:33:12 - 14:33:12.382 [main] INFO com.aotain.flow.executor.Starter - args[0]: eyJmaWxlTmFtZSI6InRhcmdldC1hbGdvcml0aG0tamFyLXdpdGgtZGVwZW5kZW5jaWVzLmphciIsImdsb2JhbER5bmFtaWNQYXJhbXMiOlt7InBhcmFtVHlwZSI6ImZ1bmMiLCJ0aW1lZm9ybWF0IjoiZnVuYyIsInBhcmFtVmFsdWVUeXBlIjoiZnVuYyIsInBhcmFtTmFtZSI6ImR0X25vdyIsInZhbHVlIjoiTk9XKCk6OkRBVEUifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6Im1hbiIsInZhbHVlIjoibWFuIn0seyJwYXJhbVR5cGUiOiJ5eXl5LU1NLWRkIiwidGltZWZvcm1hdCI6Inl5eXktTU0tZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXktTU0tZGQiLCJwYXJhbU5hbWUiOiJlbmRfZGF0ZSIsInZhbHVlIjoiMjAyNS0wNS0yMSJ9LHsicGFyYW1UeXBlIjoieXl5eU1NZGQiLCJ0aW1lZm9ybWF0IjoieXl5eU1NZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXlNTWRkIiwicGFyYW1OYW1lIjoiZW5kZGF5IiwidmFsdWUiOiIyMDI0MDkzMCJ9LHsicGFyYW1UeXBlIjoieXl5eU1NZGQiLCJ0aW1lZm9ybWF0IjoieXl5eU1NZGQiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXlNTWRkIiwicGFyYW1OYW1lIjoiYmVnaW5kYXkiLCJ2YWx1ZSI6IjIwMjQwOTAxIn0seyJwYXJhbVR5cGUiOiJ5eXl5IiwidGltZWZvcm1hdCI6Inl5eXkiLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXkiLCJwYXJhbU5hbWUiOiJ5ZWFyIiwidmFsdWUiOiIyMDI0In0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJjdXJfZmxnIiwidmFsdWUiOiJZIn0seyJwYXJhbVR5cGUiOiJ5eXl5LU1NIiwidGltZWZvcm1hdCI6Inl5eXktTU0iLCJwYXJhbVZhbHVlVHlwZSI6Inl5eXktTU0iLCJwYXJhbU5hbWUiOiJ5ZWFyX21vbnRoIiwidmFsdWUiOiIyMDI0LTAyIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJxbXMiLCJ2YWx1ZSI6InFtcyJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoiaGZtIiwidmFsdWUiOiJoZm0ifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImVycCIsInZhbHVlIjoiZXJwIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJlbXMiLCJ2YWx1ZSI6ImVtcyJ9LHsicGFyYW1UeXBlIjoieXl5eU1NIiwidGltZWZvcm1hdCI6Inl5eXlNTSIsInBhcmFtVmFsdWVUeXBlIjoieXl5eU1NIiwicGFyYW1OYW1lIjoieWVhcm1vbnRoIiwidmFsdWUiOiIyMDI0MDIifSx7InBhcmFtVHlwZSI6InRpbWVzdGFtcCIsInRpbWVmb3JtYXQiOiJ0aW1lc3RhbXAiLCJwYXJhbVZhbHVlVHlwZSI6InRpbWVzdGFtcCIsInBhcmFtTmFtZSI6ImF1eF9wcm9jX2lkIiwidmFsdWUiOiIxNzQxMTkwNDAwMDAwIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJpc19kZWwiLCJ2YWx1ZSI6Ik4ifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImJvciIsInZhbHVlIjoiYm9yIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJmaW4iLCJ2YWx1ZSI6ImZpbiJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoicm1iciIsInZhbHVlIjoicm1iciJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoibXIiLCJ2YWx1ZSI6Im1yIn0seyJwYXJhbVR5cGUiOiJzdHJpbmciLCJ0aW1lZm9ybWF0Ijoic3RyaW5nIiwicGFyYW1WYWx1ZVR5cGUiOiJzdHJpbmciLCJwYXJhbU5hbWUiOiJza2V5IiwidmFsdWUiOiIifSx7InBhcmFtVHlwZSI6Inl5eXktTU0tZGQgSEg6bW06c3MiLCJ0aW1lZm9ybWF0IjoieXl5eS1NTS1kZCBISDptbTpzcyIsInBhcmFtVmFsdWVUeXBlIjoieXl5eS1NTS1kZCBISDptbTpzcyIsInBhcmFtTmFtZSI6ImR0IiwidmFsdWUiOiIyMDI0LTEyLTMxIDAwOjAwOjAwIn0seyJwYXJhbVR5cGUiOiJ5eXl5TU1kZCIsInRpbWVmb3JtYXQiOiJ5eXl5TU1kZCIsInBhcmFtVmFsdWVUeXBlIjoieXl5eU1NZGQiLCJwYXJhbU5hbWUiOiJnX2R0IiwidmFsdWUiOiIyMDI0MTIyNCJ9XSwibWFpbkNsYXNzIjoiY29tLmNyYy5hbGdvcml0aG0uTWFpbkFwcCIsImV4ZWN1dGVQYXRoIjoiL2hvbWUvYmlnZGF0YS1jcmFiYy9leGVjdXRvcnMvNTQzNmI1ZjcyMWVhNGNjZmJlMjc1OWYyNjU5NWY4MzAvNjExMGRlOGY0MjFhNGIwNTg4OTk0MTJkOGEwMWVkYmMvVjEvMTc2NzA3NTk1NTM2OC8iLCJkb3dubG9hZFVybCI6Ii81NDM2YjVmNzIxZWE0Y2NmYmUyNzU5ZjI2NTk1ZjgzMC82MTEwZGU4ZjQyMWE0YjA1ODg5OTQxMmQ4YTAxZWRiYy9WMS8xNzY3MDc1OTU1MzY4L3RhcmdldC1hbGdvcml0aG0tamFyLXdpdGgtZGVwZW5kZW5jaWVzLmphciIsIm1pbmlvLmFjY2Vzcy5rZXkiOiJtaW5pbyIsImV4ZWNVc2VyIjoiYmlnZGF0YS1jcmFiYyIsInR5cGUiOjcsImR5bmFtaWNQYXJhbXMiOlt7InBhcmFtVHlwZSI6Inl5eXlNTSIsInRpbWVmb3JtYXQiOiJ5eXl5TU0iLCJwYXJhbVZhbHVlVHlwZSI6ImRhdGUiLCJwYXJhbU5hbWUiOiJiZWdpbnllYXJtb250aCIsInZhbHVlIjoiMjAyNTA2In0seyJwYXJhbVR5cGUiOiJ5eXl5TU0iLCJ0aW1lZm9ybWF0IjoieXl5eU1NIiwicGFyYW1WYWx1ZVR5cGUiOiJkYXRlIiwicGFyYW1OYW1lIjoiZW5keWVhcm1vbnRoIiwidmFsdWUiOiIyMDI1MDYifSx7InBhcmFtVHlwZSI6InN0cmluZyIsInRpbWVmb3JtYXQiOiJzdHJpbmciLCJwYXJhbVZhbHVlVHlwZSI6InN0cmluZyIsInBhcmFtTmFtZSI6ImRpbWNvZGUiLCJ2YWx1ZSI6Im9yZyJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoidGFyZ2V0dHlwZSIsInZhbHVlIjoiZGVyaXZhdGl2ZSJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoib3JnY29kZSIsInZhbHVlIjoiQ0hBMDQwMCJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoicmVwb3J0dHlwZSIsInZhbHVlIjoiUkVMRUFTRS1NT05USCJ9LHsicGFyYW1UeXBlIjoic3RyaW5nIiwidGltZWZvcm1hdCI6InN0cmluZyIsInBhcmFtVmFsdWVUeXBlIjoic3RyaW5nIiwicGFyYW1OYW1lIjoidGFyZ2V0U2hvcnRDb2RlIiwidmFsdWUiOiJYTC1KQ0tKVy1TTkpTTCJ9XSwibWluaW8udXJsIjoiaHR0cDovLzEwLjEzMy4xMTcuMTQwOjkwMDUiLCJtaW5pby5zZWNyZXQua2V5IjoiMXFhekBXU1giLCJzY3JpcHROYW1lIjoidGFyZ2V0LWFsZ29yaXRobS1qYXItd2l0aC1kZXBlbmRlbmNpZXMuamFyIiwic2NyaXB0UGFyYW0iOiIke2JlZ2lueWVhcm1vbnRofSwke2VuZHllYXJtb250aH0sJHtkaW1jb2RlfSwke3RhcmdldHR5cGV9LCR7cmVwb3J0dHlwZX0sJHtvcmdjb2RlfSwke3RhcmdldFNob3J0Q29kZX0iLCJvbmxpbmUuZmlsZS5idWNrZXQiOiJvbmxpbmUiLCJleGVjdXRlSWQiOiIxNzExNSIsImZpcnN0U2NoZWR1bGUiOmZhbHNlfQ== 2025-12-30 14:33:12 - 14:33:12.383 [main] INFO com.aotain.flow.executor.Starter - args[1]: 17115 2025-12-30 14:33:12 - 14:33:12.383 [main] INFO com.aotain.flow.executor.Starter - args[2]: /data/bsmp/portal/azkaban-exec-server-4.0.3.1/executions/17115/data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1_output_1282755138096799914_tmp 2025-12-30 14:33:12 - 14:33:12.383 [main] INFO com.aotain.flow.executor.Starter - args[3]: /home/bsmp/portal/proj-flow-executor/lib/proj-flow-executor-4.0.2.27.jar 2025-12-30 14:33:12 - 14:33:12.383 [main] INFO com.aotain.flow.executor.Starter - ------------------------------------------------------------------------ 2025-12-30 14:33:12 - 14:33:12.446 [main] INFO com.aotain.flow.executor.Starter - azkabanPath: /data/bsmp/portal/azkaban-exec-server-4.0.3.1/executions/17115/data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1_output_1282755138096799914_tmp 2025-12-30 14:33:12 - log4j:WARN Continuable parsing error 37 and column 14 2025-12-30 14:33:12 - log4j:WARN jar:file:/data/bsmp/portal/proj-flow-executor/lib/proj-flow-executor-4.0.2.27.jar!/log4j.xml: XML-20148: (Error) Invalid element 'appender' in content of 'log4j:configuration', expected elements '[category, logger, root, categoryFactory]'. 2025-12-30 14:33:12 - log4j:WARN Continuable parsing error 47 and column 44 2025-12-30 14:33:12 - log4j:WARN jar:file:/data/bsmp/portal/proj-flow-executor/lib/proj-flow-executor-4.0.2.27.jar!/log4j.xml: XML-20139: (Error) ID value 'consoleAppenderNoPattern' is not unique. 2025-12-30 14:33:12 - log4j:WARN Continuable parsing error 34 and column 41 2025-12-30 14:33:12 - log4j:WARN jar:file:/data/bsmp/portal/proj-flow-executor/lib/proj-flow-executor-4.0.2.27.jar!/log4j.xml: XML-20140: (Error) IDREF value 'fileAppender' does not match any ID attribute value. 2025-12-30 14:33:12 - log4j:ERROR No appender named [fileAppender] could be found. 2025-12-30 14:33:12 - 14:33:12.660 [main] INFO c.a.f.e.executor.ScriptExecutor - auth /home/bigdata-crabc/executors/5436b5f721ea4ccfbe2759f26595f830/6110de8f421a4b058899412d8a01edbc/V1/1767075955368/ permission...... 2025-12-30 14:33:12 - 14:33:12.661 [main] INFO c.a.f.e.executor.ScriptExecutor - chmodCmd=>chown -R bigdata-crabc.bigdata-crabc /home/bigdata-crabc/executors/5436b5f721ea4ccfbe2759f26595f830/6110de8f421a4b058899412d8a01edbc/V1/1767075955368//* 2025-12-30 14:33:12 - 14:33:12.675 [main] INFO c.a.f.e.executor.ScriptExecutor - auth permission success 2025-12-30 14:33:12 - 14:33:12.675 [main] INFO c.a.f.e.executor.ScriptExecutor - 执行命令: => su - bigdata-crabc -c "java -cp /home/bigdata-crabc/executors/5436b5f721ea4ccfbe2759f26595f830/6110de8f421a4b058899412d8a01edbc/V1/1767075955368/target-algorithm-jar-with-dependencies.jar com.crc.algorithm.MainApp 202506 202506 org derivative RELEASE-MONTH CHA0400 XL-JCKJW-SNJSL " 2025-12-30 14:33:12 - 14:33:12.687 [main] INFO c.a.f.e.executor.ScriptExecutor - cmds=> ["su","-","bigdata-crabc","-c","java -cp /home/bigdata-crabc/executors/5436b5f721ea4ccfbe2759f26595f830/6110de8f421a4b058899412d8a01edbc/V1/1767075955368/target-algorithm-jar-with-dependencies.jar com.crc.algorithm.MainApp 202506 202506 org derivative RELEASE-MONTH CHA0400 XL-JCKJW-SNJSL "] 2025-12-30 14:33:12 - 14:33:12.691 [main] INFO c.a.f.e.executor.AbstractExecutor - do post...... 2025-12-30 14:33:12 - 14:33:12.693 [Thread-0] INFO com.aotain.compoment.LoggerThread - su: user bigdata-crabc does not exist 2025-12-30 14:33:12 - 14:33:12.697 [main] ERROR com.aotain.flow.executor.Starter - Exec failed! 2025-12-30 14:33:12 - java.lang.RuntimeException: exec failed null 2025-12-30 14:33:12 - at com.aotain.flow.executor.Processor.process(Processor.java:86) 2025-12-30 14:33:12 - at com.aotain.flow.executor.Starter.main(Starter.java:43) 2025-12-30 14:33:12 - exit with code : 255 2025-12-30 14:33:12 - Process with id 32413 completed unsuccessfully in 0 seconds. 2025-12-30 14:33:12 - Job run failed! java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 255 at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:331) at azkaban.execapp.JobRunner.runJob(JobRunner.java:812) at azkaban.execapp.JobRunner.doRun(JobRunner.java:601) at azkaban.execapp.JobRunner.run(JobRunner.java:562) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 255 at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:138) at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:323) ... 8 more 2025-12-30 14:33:12 - azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 255 cause: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 255 2025-12-30 14:33:12 - Finishing job data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1 at 1767076392759 with status FAILED e parsing error 34 and column 41 2025-12-30 14:33:12 - log4j:WARN jar:file:/data/bsmp/portal/proj-flow-executor/lib/proj-flow-executor-4.0.2.27.jar!/log4j.xml: XML-20140: (Error) IDREF value 'fileAppender' does not match any ID attribute value. 2025-12-30 14:33:12 - log4j:ERROR No appender named [fileAppender] could be found. 2025-12-30 14:33:12 - 14:33:12.660 [main] INFO c.a.f.e.executor.ScriptExecutor - auth /home/bigdata-crabc/executors/5436b5f721ea4ccfbe2759f26595f830/6110de8f421a4b058899412d8a01edbc/V1/1767075955368/ permission...... 2025-12-30 14:33:12 - 14:33:12.661 [main] INFO c.a.f.e.executor.ScriptExecutor - chmodCmd=>chown -R bigdata-crabc.bigdata-crabc /home/bigdata-crabc/executors/5436b5f721ea4ccfbe2759f26595f830/6110de8f421a4b058899412d8a01edbc/V1/1767075955368//* 2025-12-30 14:33:12 - 14:33:12.675 [main] INFO c.a.f.e.executor.ScriptExecutor - auth permission success 2025-12-30 14:33:12 - 14:33:12.675 [main] INFO c.a.f.e.executor.ScriptExecutor - 执行命令: => su - bigdata-crabc -c "java -cp /home/bigdata-crabc/executors/5436b5f721ea4ccfbe2759f26595f830/6110de8f421a4b058899412d8a01edbc/V1/1767075955368/target-algorithm-jar-with-dependencies.jar com.crc.algorithm.MainApp 202506 202506 org derivative RELEASE-MONTH CHA0400 XL-JCKJW-SNJSL " 2025-12-30 14:33:12 - 14:33:12.687 [main] INFO c.a.f.e.executor.ScriptExecutor - cmds=> ["su","-","bigdata-crabc","-c","java -cp /home/bigdata-crabc/executors/5436b5f721ea4ccfbe2759f26595f830/6110de8f421a4b058899412d8a01edbc/V1/1767075955368/target-algorithm-jar-with-dependencies.jar com.crc.algorithm.MainApp 202506 202506 org derivative RELEASE-MONTH CHA0400 XL-JCKJW-SNJSL "] 2025-12-30 14:33:12 - 14:33:12.691 [main] INFO c.a.f.e.executor.AbstractExecutor - do post...... 2025-12-30 14:33:12 - 14:33:12.693 [Thread-0] INFO com.aotain.compoment.LoggerThread - su: user bigdata-crabc does not exist 2025-12-30 14:33:12 - 14:33:12.697 [main] ERROR com.aotain.flow.executor.Starter - Exec failed! 2025-12-30 14:33:12 - java.lang.RuntimeException: exec failed null 2025-12-30 14:33:12 - at com.aotain.flow.executor.Processor.process(Processor.java:86) 2025-12-30 14:33:12 - at com.aotain.flow.executor.Starter.main(Starter.java:43) 2025-12-30 14:33:12 - exit with code : 255 2025-12-30 14:33:12 - Process with id 32413 completed unsuccessfully in 0 seconds. 2025-12-30 14:33:12 - Job run failed! java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 255 at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:331) at azkaban.execapp.JobRunner.runJob(JobRunner.java:812) at azkaban.execapp.JobRunner.doRun(JobRunner.java:601) at azkaban.execapp.JobRunner.run(JobRunner.java:562) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 255 at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:138) at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:323) ... 8 more 2025-12-30 14:33:12 - azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 255 cause: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 255 2025-12-30 14:33:12 - Finishing job data-dev-flow-f0504ce10d414f0f928139db67f7bd85-V1-5436b5f721ea4ccfbe2759f26595f830-V1 at 1767076392759 with status FAILED
最新发布
12-31
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值