Hadoop yarn报错：org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce

最新推荐文章于 2023-10-30 20:00:32 发布

cl723401

最新推荐文章于 2023-10-30 20:00:32 发布

阅读量3.4k

点赞数

CC 4.0 BY-SA版权

分类专栏： Java

本文链接：https://blog.youkuaiyun.com/cl723401/article/details/82950866

在启动HDFS和YARN后运行WordCount程序时遇到org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException错误，特别是关于auxService:mapreduce的问题。通过检查和修改yarn-site.xml配置文件，特别是在所有节点中确保配置一致，可以解决这个问题。具体解决方案是在slave节点中添加相关配置，并确保master节点的yarn-site.xml配置正确。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

启动hdfs和yarn后，运行wordcount程序，错误如下：

[root@master hadoop]# hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount /wcinput/input.txt /wcoutput
18/10/06 14:21:43 INFO client.RMProxy: Connecting to ResourceManager at master/192.168.56.100:8032
18/10/06 14:21:45 INFO input.FileInputFormat: Total input paths to process : 1
18/10/06 14:21:46 INFO mapreduce.JobSubmitter: number of splits:1
18/10/06 14:21:46 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1538806803872_0001
18/10/06 14:21:47 INFO impl.YarnClientImpl: Submitted application application_1538806803872_0001
18/10/06 14:21:47 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1538806803872_0001/
18/10/06 14:21:47 INFO mapreduce.Job: Running job: job_1538806803872_0001
18/10/06 14:22:00 INFO mapreduce.Job: Job job_1538806803872_0001 running in uber mode : false
18/10/06 14:22:00 INFO mapreduce.Job:  map 0% reduce 0%
18/10/06 14:22:02 INFO mapreduce.Job: Task Id : attempt_1538806803872_0001_m_000000_0, Status : FAILED
Container launch failed for container_1538806803872_0001_01_000002 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(Serialize