hadoop 任务运行到running job就卡住了 INFO mapreduce.Job: Running job: job_1403905542893_0004

本文介绍了一种解决MapReduce任务运行时卡在'running job'状态的方法。通过修改mapred-site.xml文件中mapreduce.job.tracker属性的配置,指向正确的Master节点地址,从而解决任务无法继续进行的问题。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

执行mapreduce没报错,可是任务运行到running job就卡住在

INFO mapreduce.Job: Running job: job14039055428930004

解决方法 mapred-site.xml下将

<property>
       <name>mapreduce.framework.name</name>
       <value>yarn</value>
</property>

改成

<property>
      <name>mapreduce.job.tracker</name>
      <value>hdfs://192.168.1.120:8001</value>
      <final>true</final>
 </property>

其中ip是master地址。

我是新手,以上是我解决同问题的方式。不一定正确,可以试试。

2025-03-24 20:28:45,787 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at /0.0.0.0:8032 2025-03-24 20:28:50,330 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1742818172876_0003 2025-03-24 20:28:51,633 INFO input.FileInputFormat: Total input files to process : 1 2025-03-24 20:28:52,603 INFO mapreduce.JobSubmitter: number of splits:1 2025-03-24 20:28:53,502 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1742818172876_0003 2025-03-24 20:28:53,502 INFO mapreduce.JobSubmitter: Executing with tokens: [] 2025-03-24 20:28:54,024 INFO conf.Configuration: resource-types.xml not found 2025-03-24 20:28:54,025 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. 2025-03-24 20:28:54,286 INFO impl.YarnClientImpl: Submitted application application_1742818172876_0003 2025-03-24 20:28:54,511 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1742818172876_0003/ 2025-03-24 20:28:54,513 INFO mapreduce.Job: Running job: job_1742818172876_0003 2025-03-24 20:29:17,402 INFO mapreduce.Job: Job job_1742818172876_0003 running in uber mode : false 2025-03-24 20:29:17,404 INFO mapreduce.Job: map 0% reduce 0% 2025-03-24 20:29:18,478 INFO mapreduce.Job: Task Id : attempt_1742818172876_0003_m_000000_0, Status : FAILED Container launch failed for container_1742818172876_0003_01_000002 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.inst
03-25
评论 26
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值