org.apache.rocketmq.client.exception.MQClientException: Connection closed by server or timeout, re

原创 于 2025-10-23 17:30:47 发布 · 410 阅读 · 9 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
文章标签：

# RocketMQ #Connection #Timeout #MQClientException #30000

💡 亲爱的技术伙伴们：

你是否正在为这些问题焦虑——

✅ 简历投出去杳无音信，明明技术不差却总卡在面试？

✅ 每次终面都紧张不已，不知道面试官到底想要什么答案？

✅ 技术知识点零零散散，遇到系统设计题就头脑一片空白？

🎯 《Java高级开发岗面试急救包》—— 专为突破面试瓶颈而生

这不是普通的面试题汇总，而是凝聚多年面试官经验的实战赋能体系。我不仅告诉你答案，更帮你建立面试官的思维模式。

🔗 课程链接：https://edu.youkuaiyun.com/course/detail/40731

🎯 精准人群定位

  • 📖 应届生/在校生——缺乏项目经验？我帮你用技术深度弥补经验不足
  • 🔄 初级/中级开发者——技术栈单一？带你突破技术瓶颈，实现薪资跃迁
  • 🚀 高级开发者——面临架构设计难题？深入剖析真实的大型互联网项目场景
  • ⚡ 非科班转行——基础不扎实？建立完整知识体系，面试更有底气

🔥 《Java高级开发岗面试急救包》（完整技术体系）

🚀 高并发深度实战

  • 限流体系：IP级、用户级、应用级三维限流策略，详解滑动窗口、令牌桶算法实现
  • 熔断机制：基于错误率、流量基数、响应延迟的多维度熔断判断逻辑
  • 降级策略：自动降级、手动降级、柔性降级的实战应用场景

⚡ 高性能架构全解析

  • 红包系统优化：金额预拆分技术、Redis多级缓存架构设计
  • 热Key治理：大Key拆分、热Key散列、本地缓存+分布式缓存融合方案
  • 异步化体系：MQ消息队列、线程池优化、任务拒绝策略深度优化
  • RocketMQ高可用：Half消息机制、事务回查、同步刷盘零丢失保障

🌊 海量数据处理实战

  • 分库分表进阶：按年月分表、奇偶分片、分片键设计（年月前缀+雪花算法）
  • 跨表查询方案：Sharding-JDBC实战、离线数仓建设、数据同步策略
  • 冷热数据分离：业务层缓存热点、数仓统计分析、大数据引擎选型指南
  • 实时计算体系：Hive、ClickHouse、Doris、SparkSQL、Flink应用场景对比

🛠️ 服务器深度调优

  • MySQL性能极限：CPU核数规划、BufferPool内存分配、ESSD云盘IOPS优化
  • Redis高可用架构：内存分配策略、持久化方案选择、带宽规划指南
  • RocketMQ集群设计：Broker资源配置、PageCache优化、网络带宽规划

🔒 系统安全全链路

  • 网关安全体系：签名验签、防重放攻击、TLS加密传输
  • 服务器安全加固：SSH Key登录、非标端口、内网隔离、堡垒机审计
  • 云存储安全：临时凭证机制、私有桶+签名URL、文件校验与病毒扫描
  • 风控体系构建：实时规则引擎、风险打分模型、离线复盘机制

🔄 数据一致性终极方案

  • 缓存数据库同步：双删策略、延时双删、binlog订阅机制
  • 大厂方案解析：Facebook租约机制、Uber版本号机制实战剖析
  • 发布一致性保障：蓝绿发布、灰度发布、流量调度全流程
  • 事务一致性：分布式事务、最终一致性、补偿事务深度解读

👥 项目与团队管理进阶

  • 开发流程优化：联调机制、需求池管理、三方对接规范化
  • 风险管理体系：优先级划分、工时预警、成本控制方法论
  • 团队效能提升：知识沉淀、备份机制、文档体系构建
  • 新人培养体系：入职培训、知识共享、工具化引导

🏗️ 系统稳定性建设

  • 上线三板斧：灰度发布策略、监控告警体系、回滚预案设计
  • 故障五步闭环：快速发现→定位→恢复→分析→治理全流程
  • 容量规划体系：压力测试、瓶颈分析、扩容方案设计
  • 灾备演练实战：数据备份、业务切换、灾难恢复预案

🚀 立即行动，改变从现在开始！

🔗 课程链接：https://edu.youkuaiyun.com/course/detail/40731

不要再让面试成为你职业发展的绊脚石！用7天时间系统准备，轻松应对各种技术面试场景。

💪 投资一份面试急救包，收获一份心仪的Offer！

🎉 一、错误日志

[2025-10-12 14:35:12.888] ERROR 12345 --- [rocketmq-producer-0] c.r.m.p.producer.DefaultMQProducer : [UserOrderProduce] Failed to send message to rocketmq-broker-1
org.apache.rocketmq.client.exception.MQClientException: Connection closed by server or timeout, request timed out after 30000ms.
Caused by: org.apache.rocketmq.client.exception.MQClientException: Connection closed by server or timeout, request timed out after 30000ms.
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocketmq.client.producer.DefaultMQProducer.send消息体到目标Topic时触发
at org.apache.rocket2\uFF1B\uFF0C\u5F53\u547D\u8F6F\u8BBE\u8FD0\u4E2D\u7684\u5DE5\u7269\u9A8C\u542F\u4E0D\u80FD\u4F20\u901A\u5230\u6545\u969C\u7684\u4FE1\u606F\u3002

🎉 二、业务场景

环境：Java 11、RocketMQ 5.3.0、Spring Boot 3.0.8，生产环境部署在AWS EC2实例（2核4G内存），网络延迟约50ms（经ping rocketmq-broker-1验证）。
操作：用户在电商促销期间下单，触发UserOrderProduce服务发送订单消息到user-order-topic。
问题表现：

  • 订单创建失败率从0.5%飙升至12%，错误日志中Connection closed by server or timeout频发。
  • RocketMQ控制台显示user-order-topic的Consume进度停滞在50%。
  • 生产环境CPU使用率从15%突增至75%，HikariCP连接池user-order-pool中可用连接数从50骤降至0。

🎉 三、问题排查过程

📝 1. 初步分析

观察到的错误现象：

  • 消息投递失败率从0.5%→12%，错误日志集中在促销高峰时段（14:30-14:35）。
  • RocketMQ控制台显示user-order-topic的Produce进度为0，Consume进度停滞。
  • 生产环境CPU峰值75%，HikariCP连接池user-order-pool的Available Connections为0。

错误日志关键字提取：

  • 核心异常：org.apache.rocketmq.client.exception.MQClientException
  • 错误消息：Connection closed by server or timeout, request timed out after 30000ms
  • 异常位置：DefaultMQProducer.send消息体到目标Topic时触发
  • 上下文信息：促销活动期间订单量激增（峰值QPS达1200），生产者线程池rocketmq-producer-0任务积压。

初步假设：

  1. 生产者配置问题：线程池或连接池配置不足，导致任务积压。
  2. RocketMQ集群状态异常：Broker节点服务不可用或网络分区。
  3. 数据库连接泄漏：HikariCP连接池未正确释放，导致资源耗尽。

排查方向：

  1. 检查生产者线程池和HikariCP连接池配置。
  2. 验证RocketMQ Broker节点状态及网络延迟。
  3. 监控CPU、内存及数据库连接数。
📝 2. 详细排查步骤

步骤1：检查生产者配置

  • 操作：进入src/main/resources/application.yml，查看rocketmq配置。
  • 结果：producer线程池大小=50，HikariCP连接池大小=100。
  • 分析：促销期间QPS 1200，50线程池可能成为瓶颈，但连接池大小100未触发警告。

步骤2：测试网络延迟

  • 操作：执行ping rocketmq-broker-1 -t，持续5分钟。
  • 结果：丢包率从0%→8%，最大延迟60ms。
  • 分析：网络延迟在可接受范围内，但突发丢包可能引发重试。

步骤3：验证Broker状态

  • 操作：登录RocketMQ控制台，查看user-order-topic的Consume进度和Broker状态。
  • 结果：Consume进度停滞在50%，部分Broker节点显示UNHEALTHY。
  • 分析：Broker节点异常可能中断消息投递。

步骤4：监控资源使用

  • 操作：通过jstack rocketmq-producer-0获取线程堆栈。
  • 结果：发现HikariCP连接池中Leaked Connections=0，但Active Connections=0。
  • 分析：连接池未泄漏，但可用连接数为0，可能因HikariCP参数配置错误。
📝 3. 尝试的解决方案

方案一：调整生产者线程池配置

  • 操作：将producer线程池大小从50改为200，HikariCP连接池大小从100改为300。
  • 结果：任务积压减少，但Consume进度仍停滞。
  • 失败原因：线程池扩容未解决Broker节点问题。

方案二：重启Broker节点

  • 操作：重启异常Broker节点（rocketmq-broker-1）。
  • 结果：Broker状态恢复为HEALTHY，Consume进度开始回升。
  • 失败原因：Broker重启后仍存在配置不一致问题。

方案三：优化RocketMQ配置

  • 操作：在user-order-topic的RocketMQProperties中添加： 
    messageRetryTimes=3
messageRetryWaitTime=5000
  • 结果：重试机制生效，投递失败率降至3%。
  • 失败原因：未解决根本的连接超时问题。

方案四：调整HikariCP参数

  • 操作：修改application.yml： 
    spring.datasource.hikari.max-pool-size=300
spring.datasource.hikari.idle-timeout=60000
spring.datasource.hikari连接等待超时时间=30000
  • 结果：连接池可用连接数恢复至50，Consume进度稳定在90%。
  • 成功原因：优化连接回收策略，避免资源耗尽。

🎉 四、最终解决方案

有效方案：

  1. 调整生产者线程池：producer线程池大小=200，避免任务积压。
  2. 优化HikariCP参数： 
    spring.datasource.hikari.max-pool-size=300
spring.datasource.hikari.idle-timeout=60000
spring.datasource.hikari连接等待超时时间=30000
  3. 增加RocketMQ重试机制： 
    messageRetryTimes=3
messageRetryWaitTime=5000

验证结果：

  • 消息投递失败率降至0.8%，Consume进度稳定在95%以上。
  • 生产环境CPU峰值回落至30%，HikariCP连接池Available Connections稳定在50。

优快云

博主分享

📥博主的人生感悟和目标

Java程序员廖志伟

📙经过多年在优快云创作上千篇文章的经验积累，我已经拥有了不错的写作技巧。同时，我还与清华大学出版社签下了四本书籍的合约，并将陆续出版。

面试备战资料

八股文备战
场景描述链接
时间充裕（25万字）Java知识点大全（高频面试题）Java知识点大全
时间紧急（15万字）Java高级开发高频面试题Java高级开发高频面试题

理论知识专题（图文并茂，字数过万）

技术栈链接
RocketMQRocketMQ详解
KafkaKafka详解
RabbitMQRabbitMQ详解
MongoDBMongoDB详解
ElasticSearchElasticSearch详解
ZookeeperZookeeper详解
RedisRedis详解
MySQLMySQL详解
JVMJVM详解

集群部署（图文并茂，字数过万）

技术栈部署架构链接
MySQL使用Docker-Compose部署MySQL一主二从半同步复制高可用MHA集群Docker-Compose部署教程
Redis三主三从集群（三种方式部署/18个节点的Redis Cluster模式）三种部署方式教程
RocketMQDLedger高可用集群（9节点）部署指南
Nacos+Nginx集群+负载均衡（9节点）Docker部署方案
Kubernetes容器编排安装最全安装教程

开源项目分享

项目名称链接地址
高并发红包雨项目https://gitee.com/java_wxid/red-packet-rain
微服务技术集成demo项目https://gitee.com/java_wxid/java_wxid

管理经验

【公司管理与研发流程优化】针对研发流程、需求管理、沟通协作、文档建设、绩效考核等问题的综合解决方案：https://download.youkuaiyun.com/download/java_wxid/91148718

希望各位读者朋友能够多多支持！

现在时代变了，信息爆炸，酒香也怕巷子深，博主真的需要大家的帮助才能在这片海洋中继续发光发热，所以，赶紧动动你的小手，点波关注❤️，点波赞👍，点波收藏⭐，甚至点波评论✍️，都是对博主最好的支持和鼓励！

🔔如果您需要转载或者搬运这篇文章的话，非常欢迎您私信我哦~

HBase有关ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet
优快云2022博客之星Top39；华为云博主7&，优快云、稀土掘金、微信公众号、阿里云开发者社区、腾讯云社区、博客园、知乎、51CTO同名博主WHYBIGDATA；
09-09 1909
![1.png](https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/fb76ab62a5204f4ea989c971f47ae3c3~tplv-k3u1fbpfcp-watermark.image?)
org.apache.hadoop.ipc.Client: Retrying connect to server
ouyida3的专栏
11-03 3019
2011-08-10 09:57:16,000 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: meimer/130.51.38.219:9001. Already tried 0 time(s). master启动没报错，但是在slave里报错。 解决方法： 1、把slave机器的namenode得format一下
org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:218
我的博客
04-11 1万+
在vmware中安装hadoop伪分布式，使用host-only模式使用hbase shell一直正常，后来为了能上网改为了Briged模式。 启动后再命令端看到了关于hbase的异常信息org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not a...
Call failed on IOException org.apache.hadoop.hbase.DoNotRetryIOException
weixin_44760145的博客
05-20 1189
0: jdbc:phoenix:hadoop102:2181> drop table REALTIME_MALL.DIM_USER_INFO; 21/05/20 21:47:14 WARN client.SyncCoprocessorRpcChannel: Call failed on IOException org.apache.hadoop.hbase.DoNotRetryIOException: org.apache.hadoop.hbase.DoNotRetryIOException: REA
kafka警告---java.io.EOFException: null
热门推荐
一个胖子IT男的博客
06-13 1万+
完成报错信息如下： [2019-06-12 18:12:13.199][WARN ][][ org.apache.kafka.common.network.Selector.poll(Selector.java:276) ] ==> Error in I/O with /192.168.10.165 java.io.EOFException: null at org.apac...
activemq java.io.eofexception,ActiveMQ启动时，警告为java.io.EOFException
weixin_29170089的博客
02-28 2553
am trying to start the ActiveMQ 5.11 and I see a WARNING as below:WARN | Transport Connection to: tcp://127.0.0.1:40890 failed: java.io.EOFExceptionMy activemq.xml is as below:keyStore="file:${JMS_KEY...
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for X
weixin_42213903的博客
10-16 810
ZooKeeper org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for X Opening socket connection to server 192.168.220.130/192.168.220.130:2181. Will not attempt to authenticate using SASL (unknown error)
Spring ActiveMQ Caused By: javax.jms.IllegalStateException: Connection closed
weixin_34192732的博客
09-11 884
根据 http://www.cnblogs.com/yshyee/p/7448808.html 进行JMS操作时，发送跟监听放到不同的项目中进行时，出现以下异常信息： org.springframework.jms.IllegalStateException: Connection closed; nested exception is javax.jms.IllegalStateExcepti...
jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
moxiaolin的博客
11-07 1735
这几日一直在调试我的老古董SSM毕业项目，之前本地调试没有问题，然后部署到远程服务器上就出现问题了，而且偶尔还能正常....... 报错信息如下： Type 异常报告 消息 Request processing failed; nested exception is org.springframework.transaction.CannotCreateTransactionExcepti...
phoenix连接hbase数据库，创建二级索引报错：Error: org.apache.phoenix.exception.PhoenixIOException: Failed after atte...
weixin_34174422的博客
03-06 1346
环境描述： 操作系统版本：CentOS release 6.5 (Final) 内核版本：2.6.32-431.el6.x86_64 phoenix版本：phoenix-4.10.0 hbase版本：hbase-1.2.6 表SYNC_BUSINESS_INFO_BYDAY数据库量：990万+ 问题描述： 通过phoenix客户端连接hbas...
使用IDEA操作Hbase API报错：org.apache.hadoop.hbase.client.RetriesExhaustedException的解决方法:
Nahshon的博客
02-14 1584
使用IDEA操作Hbase API报错：org.apache.hadoop.hbase.client.RetriesExhaustedException的解决方法： 错误详情： Exception in thread “main” org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, ...
21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.gpg.application.cleaner.interval-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.output.fileoutputformat.compress 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.gpg.subcluster.cleaner.interval-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.sharedcache.store.in-memory.staleness-period-mins 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.write.byte-array-manager.count-limit 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.runtime.linux.runc.layer-mounts-to-keep 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.group.mapping.providers.combined 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.running.map.limit 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.webapp.address 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.placement-constraints.scheduler.pool-size 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.multipart.size 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.slow.io.warning.threshold.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.app.mapreduce.am.job.committer.commit-window 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.submithostname 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.edits.asynclogging 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.blockreport.incremental.intervalMsec 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.ifile.readahead 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.state-store.sql.conn-time-out 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.runtime.linux.runc.image-tag-to-manifest-plugin 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.socketcache.capacity 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.select.input.csv.field.delimiter 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.retry.policy.spec 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.reencrypt.batch.size 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.connection.ssl.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.proxyuser.hadoop.hosts 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.read.considerLoad 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.max.slowdisks.to.exclude 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.groups.cache.secs 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.peer.stats.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.replication 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.storage.policy.satisfier.work.multiplier.per.iteration 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.group.mapping.ldap.directory.search.timeout 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.checksum.combine.mode 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.storage.policy.satisfier.max.outstanding.paths 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.sleep-delay-before-sigkill.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.apps.cache.enable 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.automatic.close 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.reencrypt.edek.threads 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.disk-health-checker.disk-free-space-threshold.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.acls.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.short.circuit.replica.stale.threshold.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.health-checker.run-before-startup 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.send.qop.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.jobhistory.intermediate-done-dir 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.slowpeer.collect.interval 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.server-defaults.validity.period.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.client.libjars.wildcard 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.storage.policy.satisfier.address 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.reduce.shuffle.input.buffer.percent 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.audit.loggers 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for io.serializations 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.dispatcher.print-thread-pool.keep-alive-time 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.http.cross-origin.allowed-methods 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.snapshot.capture.openfiles 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.qjournal.queued-edits.limit.mb 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.zk.acl 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.container.stderr.pattern 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.cluster.local.dir 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for ipc.[port_number].cost-provider.impl 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.kerberos.kinit.command 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.metrics.logger.period.seconds 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.viewfs.overload.scheme.target.abfss.impl 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.block.access.token.lifetime 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.delegation.token.max-lifetime 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.drop.cache.behind.writes 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.system-metrics-publisher.timeline-server-v1.enable-batch 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.remove.dead.datanode.batchnum 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.submission-preprocessor.file-refresh-interval-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.num.extra.edits.retained 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.block.placement.ec.classname 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for ipc.client.connect.max.retries.on.timeouts 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.client.resolve.topology.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.qjournal.http.open.timeout.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for ha.health-monitor.connect-retry-interval.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.edekcacheloader.initial.delay.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.rbf.observer.read.enable 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.failover.resolver.useFQDN 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for io.mapfile.bloom.size 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.ftp.data.connection.mode 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client-write-packet-size 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.app.mapreduce.shuffle.log.backups 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.kerberos.principal.pattern 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.webhdfs.socket.connect-timeout 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.scheduler.monitor.enable 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.proxyuser.hadoop.groups 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.select.output.csv.quote.character 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.task.stuck.timeout-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.authorization 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.timeline-service.version 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.am.liveness-monitor.expiry-interval-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.gpg.webapp.address 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.timeline-service.leveldb-timeline-store.path 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.reduce.slowstart.completedmaps 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.delegation.token.max-lifetime 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.ha.automatic-failover.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.socket.write.timeout 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.accesstime.precision 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.group.mapping.ldap.conversion.rule 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for io.mapfile.bloom.error.rate 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.webapp.rest-csrf.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.timeline-service.leveldb-state-store.path 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.scheduler.configuration.zk-store.parent-path 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for ipc.[port_number].backoff.enable 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.timeline-service.writer.flush-interval-seconds 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.posix.acl.inheritance.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.outliers.report.interval 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.kms.client.encrypted.key.cache.low-watermark 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.top.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.retry.throttle.interval 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.jobhistory.webapp.rest-csrf.custom-header 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.webapp.xfs-filter.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for ipc.identity-provider.impl 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.cached.conn.retry 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.submission-preprocessor.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.system.tags 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.runtime.linux.runc.image-tag-to-manifest-plugin.num-manifests-to-cache 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.least-load-policy-selector.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.numa-awareness.numactl.cmd 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.path.based.cache.refresh.interval.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.fs-limits.max-directory-items 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.ha.log-roll.period 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.distributed-scheduling.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.pmem.cache.recovery 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.minicluster.fixed.ports 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.storage.policy.satisfier.queue.limit 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.snapshot.filesystem.limit 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.resource.percentage-physical-cpu-limit 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.fs-limits.max-xattr-size 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.blocks.per.postponedblocks.rescan 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.maintenance.replication.min 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.timeline-service.app-aggregation-interval-secs 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.max.op.size 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.iostatistics.thread.level.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.reducer.unconditional-preempt.delay.sec 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.app.mapreduce.am.hard-kill-timeout-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.connection.ttl 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.storage.policy.permissions.superuser-only 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.df.interval 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.cache.limit.max-single-resource-mb 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.assumed.role.session.duration 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.disk.balancer.block.tolerance.percent 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.webhdfs.netty.high.watermark 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.balance.max.concurrent.moves 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.log.delete.threshold 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.token.tracking.ids.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.assumed.role.credentials.provider 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.log-container-debug-info-on-error.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.kms.client.failover.sleep.max.millis 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.webapp.rest-csrf.custom-header 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.jobhistory.move.thread-count 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for io.compression.codec.zstd.level 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.timeline-service.http-authentication.simple.anonymous.allowed 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.provided.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.sharedcache.client-server.thread-count 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.scheduler.configuration.max.version 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.jobhistory.jobname.limit 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.dispatcher.print-events-info.threshold 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.decommission.blocks.per.interval 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.qjournal.write-txns.timeout.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.subcluster-resolver.class 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.read-lock-reporting-threshold-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.task.timeout 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.resource.memory-mb 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.container-log-monitor.total-size-limit-bytes 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.fileoutputcommitter.algorithm.version 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.framework.name 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.router.clientrm.interceptor-class.pipeline 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.system-metrics-publisher.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.sharedcache.nested-level 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.dns.log-slow-lookups.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.jobhistory.webapp.https.address 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for file.client-write-packet-size 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for ipc.client.ping 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.state-store.sql.idle-time-out 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.gpg.policy.generator.interval 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.gpg.webapp.https.address 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.balancer.max-no-move-interval 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.minicluster.control-resource-monitoring 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.disk.balancer.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.fs.state-store.num-retries 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.uid.cache.secs 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.ha.automatic-failover.zk-base-path 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.speculative.speculative-cap-running-tasks 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.node-labels.am.allow-non-exclusive-allocation 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.du.reserved.calculator 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.block.id.layout.upgrade.threads 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for io.erasurecode.codec.native.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.client.load.resource-types.from-server 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.client.application-client-protocol.poll-timeout-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.datanode.oob.timeout-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.sharedcache.mode 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.hdfs-servers 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.epoch.range 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.federation.gpg.subcluster.heartbeat.expiration-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.map.output.compress 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.token.service.use_ip 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.kms.client.encrypted.key.cache.num.refill.threads 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.edekcacheloader.interval.ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.aux-services.mapreduce_shuffle.class 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.group.mapping.ldap.num.attempts.before.failover 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.du.interval 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.read.uri.cache.enabled 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.zk.retry-interval-ms 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.data.transfer.server.tcpnodelay 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.dir 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.http.client.failover.max.attempts 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.socket.send.buffer 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.client.block.write.locateFollowingBlock.retries 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.jvm.system-properties-to-log 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.enable.retrycache 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.job.encrypted-intermediate-data.buffer.kb 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.nodemanager.resource-plugins.gpu.docker-plugin.nvidia-docker-v1.endpoint 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.data.transfer.client.tcpnodelay 21:37:31.523 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.storage.policy.satisfier.mode 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.webapp.xfs-filter.xframe-options 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.reduce.memory.mb 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.caller.context.enabled 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.nodemanagers.heartbeat-interval-speedup-factor 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.qjournal.prepare-recovery.timeout.ms 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.router.deregister.subcluster.enabled 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.security.sensitive-config-keys 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for mapreduce.client.completion.pollinterval 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.namenode.secondary.http-address 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.router.interceptor.allow-partial-result.enable 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for yarn.resourcemanager.webapp.https.address 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for fs.s3a.retry.throttle.limit 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for dfs.permissions.allow.owner.set.quota 21:37:31.524 [main] DEBUG org.apache.hadoop.conf.Configuration - Handling deprecation for hadoop.domainname.resolver.impl 21:37:31.597 [main] INFO org.apache.hadoop.mapreduce.Job - The url to track the job: http://localhost:8080/ 21:37:31.598 [main] INFO org.apache.hadoop.mapreduce.Job - Running job: job_local1106899704_0001 21:37:31.601 [Thread-5] INFO org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter set in config null 21:37:31.603 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$1@7c6442c2] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:329) at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:613) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1736) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:31.611 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$1@2098d37d] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:329) at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:613) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1737) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:31.612 [Thread-5] DEBUG org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory - Looking for committer factory for path hdfs://192.168.88.101:8020/output 21:37:31.612 [Thread-5] DEBUG org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory - No scheme-specific factory defined in mapreduce.outputcommitter.factory.scheme.hdfs 21:37:31.612 [Thread-5] INFO org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory - No output committer factory defined, defaulting to FileOutputCommitterFactory 21:37:31.613 [Thread-5] DEBUG org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory - Creating FileOutputCommitter for path hdfs://192.168.88.101:8020/output and context TaskAttemptContextImpl{JobContextImpl{jobId=job_local1106899704_0001}; taskId=attempt_local1106899704_0001_m_000000_0, status=''} 21:37:31.613 [Thread-5] DEBUG org.apache.hadoop.mapreduce.lib.output.PathOutputCommitter - Instantiating committer FileOutputCommitter{PathOutputCommitter{context=TaskAttemptContextImpl{JobContextImpl{jobId=job_local1106899704_0001}; taskId=attempt_local1106899704_0001_m_000000_0, status=''}; org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter@9f9d7ce}; outputPath=null, workPath=null, algorithmVersion=0, skipCleanup=false, ignoreCleanupFailures=false} with output path hdfs://192.168.88.101:8020/output and job context TaskAttemptContextImpl{JobContextImpl{jobId=job_local1106899704_0001}; taskId=attempt_local1106899704_0001_m_000000_0, status=''} 21:37:31.614 [Thread-5] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter - File Output Committer Algorithm version is 2 21:37:31.614 [Thread-5] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter - FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 21:37:31.615 [Thread-5] INFO org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 21:37:31.622 [Thread-5] DEBUG org.apache.hadoop.fs.statistics.impl.IOStatisticsContextIntegration - Created instance IOStatisticsContextImpl{id=2, threadId=32, ioStatistics=counters=(); gauges=(); minimums=(); maximums=(); means=(); } 21:37:31.629 [Thread-5] DEBUG org.apache.hadoop.hdfs.DFSClient - /output/_temporary/0: masked={ masked: rwxr-xr-x, unmasked: rwxrwxrwx } 21:37:31.637 [IPC Parameter Sending Thread for xxjdxnj/192.168.88.101:8020] DEBUG org.apache.hadoop.ipc.Client - IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from СIPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С sending #3 org.apache.hadoop.hdfs.protocol.ClientProtocol.mkdirs 21:37:31.649 [IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С] DEBUG org.apache.hadoop.ipc.Client - IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С got value #3 21:37:31.654 [Thread-5] DEBUG org.apache.hadoop.io.retry.RetryInvocationHandler - Exception while invoking call #3 ClientNamenodeProtocolTranslatorPB.mkdirs over null. Not retrying because try once and fail. org.apache.hadoop.ipc.RemoteException: Permission denied: user=С, access=WRITE, inode="/":hadoop:supergroup:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:661) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:501) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermissionWithContext(FSPermissionChecker.java:525) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:395) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1964) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1945) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1904) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:60) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3531) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1173) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:750) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:621) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:589) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:573) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1227) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1246) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1169) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1953) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:3203) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1584) at org.apache.hadoop.ipc.Client.call(Client.java:1529) at org.apache.hadoop.ipc.Client.call(Client.java:1426) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Invoker.invoke(ProtobufRpcEngine2.java:258) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Invoker.invoke(ProtobufRpcEngine2.java:139) at jdk.proxy2/jdk.proxy2.$Proxy11.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.lambda$mkdirs$20(ClientNamenodeProtocolTranslatorPB.java:611) at org.apache.hadoop.ipc.internal.ShadedProtobufHelper.ipc(ShadedProtobufHelper.java:160) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:611) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:437) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:170) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:162) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:100) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:366) at jdk.proxy2/jdk.proxy2.$Proxy12.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2555) at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2531) at org.apache.hadoop.hdfs.DistributedFileSystem$27.doCall(DistributedFileSystem.java:1497) at org.apache.hadoop.hdfs.DistributedFileSystem$27.doCall(DistributedFileSystem.java:1494) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:1511) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:1486) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:2494) at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.setupJob(FileOutputCommitter.java:356) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:541) 21:37:31.663 [IPC Parameter Sending Thread for xxjdxnj/192.168.88.101:8020] DEBUG org.apache.hadoop.ipc.Client - IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from СIPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С sending #4 org.apache.hadoop.hdfs.protocol.ClientProtocol.delete 21:37:31.674 [IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С] DEBUG org.apache.hadoop.ipc.Client - IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С got value #4 21:37:31.675 [Thread-5] DEBUG org.apache.hadoop.ipc.ProtobufRpcEngine2 - Call: delete took 12ms 21:37:31.678 [Thread-5] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local1106899704_0001 org.apache.hadoop.security.AccessControlException: Permission denied: user=С, access=WRITE, inode="/":hadoop:supergroup:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:661) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:501) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermissionWithContext(FSPermissionChecker.java:525) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:395) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1964) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1945) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1904) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:60) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3531) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1173) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:750) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:621) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:589) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:573) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1227) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1246) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1169) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1953) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:3203) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:499) at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:480) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2557) at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2531) at org.apache.hadoop.hdfs.DistributedFileSystem$27.doCall(DistributedFileSystem.java:1497) at org.apache.hadoop.hdfs.DistributedFileSystem$27.doCall(DistributedFileSystem.java:1494) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:1511) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:1486) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:2494) at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.setupJob(FileOutputCommitter.java:356) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:541) Caused by: org.apache.hadoop.ipc.RemoteException: Permission denied: user=С, access=WRITE, inode="/":hadoop:supergroup:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:661) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:501) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermissionWithContext(FSPermissionChecker.java:525) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:395) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1964) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1945) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1904) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:60) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3531) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1173) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:750) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:621) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:589) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:573) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1227) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1246) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1169) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1953) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:3203) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1584) at org.apache.hadoop.ipc.Client.call(Client.java:1529) at org.apache.hadoop.ipc.Client.call(Client.java:1426) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Invoker.invoke(ProtobufRpcEngine2.java:258) at org.apache.hadoop.ipc.ProtobufRpcEngine2$Invoker.invoke(ProtobufRpcEngine2.java:139) at jdk.proxy2/jdk.proxy2.$Proxy11.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.lambda$mkdirs$20(ClientNamenodeProtocolTranslatorPB.java:611) at org.apache.hadoop.ipc.internal.ShadedProtobufHelper.ipc(ShadedProtobufHelper.java:160) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:611) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:437) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:170) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:162) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:100) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:366) at jdk.proxy2/jdk.proxy2.$Proxy12.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2555) ... 9 common frames omitted 21:37:31.683 [Thread-5] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.fs.FileContext$2@15fc336f] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.fs.FileContext.getAbstractFileSystem(FileContext.java:343) at org.apache.hadoop.fs.FileContext.getFileContext(FileContext.java:465) at org.apache.hadoop.fs.FileContext.getFileContext(FileContext.java:442) at org.apache.hadoop.fs.FileContext.getLocalFSFileContext(FileContext.java:428) at org.apache.hadoop.mapred.LocalDistributedCacheManager.close(LocalDistributedCacheManager.java:268) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:598) 21:37:32.626 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$1@77b9d0c7] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:329) at org.apache.hadoop.mapreduce.Job.isUber(Job.java:1866) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1747) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.626 [main] INFO org.apache.hadoop.mapreduce.Job - Job job_local1106899704_0001 running in uber mode : false 21:37:32.628 [main] INFO org.apache.hadoop.mapreduce.Job - map 0% reduce 0% 21:37:32.628 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$6@3b0ee03a] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:730) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1759) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.629 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$1@796065aa] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:329) at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:613) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1736) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.629 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$1@28a6301f] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:329) at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:613) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1737) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.630 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$6@2c306a57] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:730) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1759) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.630 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$1@773e2eb5] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:329) at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:613) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1736) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.631 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$1@d8948cd] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:329) at org.apache.hadoop.mapreduce.Job.isSuccessful(Job.java:625) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1763) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.631 [main] INFO org.apache.hadoop.mapreduce.Job - Job job_local1106899704_0001 failed with state FAILED due to: NA 21:37:32.631 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$8@7abe27bf] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.getCounters(Job.java:818) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1770) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1698) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.651 [main] INFO org.apache.hadoop.mapreduce.Job - Counters: 0 21:37:32.651 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction [as: С (auth:SIMPLE)][action: org.apache.hadoop.mapreduce.Job$1@2679311f] java.lang.Exception: null at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1950) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:329) at org.apache.hadoop.mapreduce.Job.isSuccessful(Job.java:625) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1710) at cn.itcast.mr.dedup.MatrixMultiplication.main(MatrixMultiplication.java:128) 21:37:32.653 [shutdown-hook-0] DEBUG org.apache.hadoop.fs.FileSystem - FileSystem.close() by method: org.apache.hadoop.hdfs.DistributedFileSystem.close(DistributedFileSystem.java:1530)); Key: (С (auth:SIMPLE))@hdfs://192.168.88.101:8020; URI: hdfs://192.168.88.101:8020; Object Identity Hash: 2e075efe 21:37:32.653 [shutdown-hook-0] DEBUG org.apache.hadoop.ipc.Client - stopping client from cache: Client-e9ac678cebb441d58dd3dc3f8f54b798 21:37:32.654 [shutdown-hook-0] DEBUG org.apache.hadoop.ipc.Client - removing client from cache: Client-e9ac678cebb441d58dd3dc3f8f54b798 21:37:32.654 [shutdown-hook-0] DEBUG org.apache.hadoop.ipc.Client - stopping actual client because no more references remain: Client-e9ac678cebb441d58dd3dc3f8f54b798 21:37:32.654 [shutdown-hook-0] DEBUG org.apache.hadoop.ipc.Client - Stopping client 21:37:32.655 [IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С] DEBUG org.apache.hadoop.ipc.Client - IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С: closed 21:37:32.655 [IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С] DEBUG org.apache.hadoop.ipc.Client - IPC Client (1759899303) connection to xxjdxnj/192.168.88.101:8020 from С: stopped, remaining connections 0 21:37:32.655 [shutdown-hook-0] DEBUG org.apache.hadoop.fs.FileSystem - FileSystem.close() by method: org.apache.hadoop.fs.FilterFileSystem.close(FilterFileSystem.java:529)); Key: (С (auth:SIMPLE))@file://; URI: file:///; Object Identity Hash: 2a38dfe6 21:37:32.655 [shutdown-hook-0] DEBUG org.apache.hadoop.fs.FileSystem - FileSystem.close() by method: org.apache.hadoop.fs.RawLocalFileSystem.close(RawLocalFileSystem.java:895)); Key: null; URI: file:///; Object Identity Hash: 6f3a54c5 21:37:32.656 [shutdown-hook-0] DEBUG org.apache.hadoop.hdfs.KeyProviderCache - Invalidating all cached KeyProviders. 21:37:32.656 [Thread-1] DEBUG org.apache.hadoop.util.ShutdownHookManager - Completed shutdown in 0.004 seconds; Timeouts: 0 21:37:32.664 [Thread-1] DEBUG org.apache.hadoop.util.ShutdownHookManager - ShutdownHookManager completed shutdown. Process finished with exit code 1
06-22
import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; public class MatrixMultiplication { public static void main(String[] args) throws Exception { if (args.length != 6) { ...
easy-es插入大数据报错 Connection is closed
全栈工程师
05-30 1026
easy-es插入大数据报错 Connection is closed
【线上问题】Timeout waiting for connection from pool 问题排查
Prior_SX的博客
06-08 4770
【线上问题】Timeout waiting for connection from pool 问题排查
yubaolee_OpenAuthNet_25456_1764964690631.zip
12-07
yubaolee_OpenAuthNet_25456_1764964690631.zip
基于PID控制器和电流控制器的电池充电比较研究（Matlab代码实现）
12-07
基于PID控制器和电流控制器的电池充电比较研究（Matlab代码实现）内容概要：本文主要围绕《基于PID控制器和电流控制器的电池充电比较研究（Matlab代码实现）》展开，介绍了利用Matlab进行电池充电控制策略的仿真与比较研究。重点对比了PID控制器与电流控制器在电池充电过程中的性能表现，涵盖系统建模、控制算法设计、仿真分析及结果评估等内容，旨在为电池管理系统中的充电控制提供优化方案和技术参考。; 适合人群：具备一定自动控制理论基础和Matlab编程能力的电气工程、自动化、能源系统等相关专业的研究生、科研人员及工程技术人员。; 使用场景及目标：①用于电池管理系统中充电控制策略的设计与优化；②开展PID控制与电流控制在动态响应、稳定性、充电效率等方面的性能对比研究；③支持教学实验、科研仿真及实际工程项目中的控制器选型与验证。; 阅读建议：建议读者结合Matlab代码进行仿真实践，重点关注控制器参数设置、系统响应曲线分析及不同工况下的性能差异，同时可扩展至其他先进控制算法（如模糊控制、自适应控制）的对比研究，以深化对电池充电控制技术的理解与应用。
一个基于SpringBoot和MyBatis框架开发的用于高校或公共图书馆自习室资源智能化管理的Web应用程序系统_包含用户注册登录座位预约状态查询取消预约留言反馈及管理员对自习室.zip
12-07
一个基于SpringBoot和MyBatis框架开发的用于高校或公共图书馆自习室资源智能化管理的Web应用程序系统_包含用户注册登录座位预约状态查询取消预约留言反馈及管理员对自习室.zip
nats.swift-Swift资源
最新发布
12-08
Swift client for NATS, the cloud native messaging system.
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
表情包 代码片
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值