hadoop 任务运行到running job就卡住了 INFO mapreduce.Job: Running job: job_XXXXXXX

本文介绍了一种解决MapReduce任务在运行过程中卡在'running job'状态的问题。通过修改mapred-site.xml文件中mapreduce.job.tracker属性,将值设置为Master节点的IP地址,成功解决了任务卡顿的问题。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

执行mapreduce没报错,可是任务运行到running job就卡住在

INFO mapreduce.Job: Running job: job14039055428930004

解决方法 mapred-site.xml下将

  1. <property>
  2.        <name>mapreduce.framework.name</name>
  3.        <value>yarn</value>
  4. </property>

改成

  1. <property>
  2.       <name>mapreduce.job.tracker</name>
  3.       <value>hdfs://192.168.1.120:8001</value>
  4.       <final>true</final>
  5.  </property>

其中ip是master地址。

实测有效。

2025-03-24 20:28:45,787 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at /0.0.0.0:8032 2025-03-24 20:28:50,330 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1742818172876_0003 2025-03-24 20:28:51,633 INFO input.FileInputFormat: Total input files to process : 1 2025-03-24 20:28:52,603 INFO mapreduce.JobSubmitter: number of splits:1 2025-03-24 20:28:53,502 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1742818172876_0003 2025-03-24 20:28:53,502 INFO mapreduce.JobSubmitter: Executing with tokens: [] 2025-03-24 20:28:54,024 INFO conf.Configuration: resource-types.xml not found 2025-03-24 20:28:54,025 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. 2025-03-24 20:28:54,286 INFO impl.YarnClientImpl: Submitted application application_1742818172876_0003 2025-03-24 20:28:54,511 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1742818172876_0003/ 2025-03-24 20:28:54,513 INFO mapreduce.Job: Running job: job_1742818172876_0003 2025-03-24 20:29:17,402 INFO mapreduce.Job: Job job_1742818172876_0003 running in uber mode : false 2025-03-24 20:29:17,404 INFO mapreduce.Job: map 0% reduce 0% 2025-03-24 20:29:18,478 INFO mapreduce.Job: Task Id : attempt_1742818172876_0003_m_000000_0, Status : FAILED Container launch failed for container_1742818172876_0003_01_000002 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.inst
最新发布
03-25
评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值