Hadoop第一个demo运行错误

最新推荐文章于 2024-11-21 11:29:53 发布

原创最新推荐文章于 2024-11-21 11:29:53 发布 · 3.7k 阅读

1 ·

CC 4.0 BY-SA版权

Hadoop 专栏收录该内容

4 篇文章

订阅专栏

本文解决了在使用Hadoop MapReduce进行作业提交时遇到的配置问题，具体表现为无法初始化Cluster，提示检查mapreduce.framework.name及对应服务器地址配置。通过引入正确的依赖包解决了此问题。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Exception in thread "main" java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
	at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
	at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
	at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
	at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
	at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
	at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)
	at com.lk.hadoopDemo.WordCountDemo.main(WordCountDemo.java:48)

尝试了网上的解决方法：

引入下面的jar包，但是还是不行。

<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-mapreduce-client-common</artifactId>
    <version>2.4.1</version>
</dependency>

解决方式：需要引入两个jar包

<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-common</artifactId>
<version>2.4.1</version>
</dependency>

<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-jobclient</artifactId>
<version>2.4.1</version>
</dependency>

解决网址：https://www.iteblog.com/archives/840