CentOS 编译hadoop 1.0.4

最新推荐文章于 2022-09-05 11:32:09 发布

vah101

最新推荐文章于 2022-09-05 11:32:09 发布

阅读量1.1k

点赞数

CC 4.0 BY-SA版权

分类专栏： Linux开发

本文链接：https://blog.youkuaiyun.com/vah101/article/details/20712311

Linux开发专栏收录该内容

129 篇文章

订阅专栏

本文介绍了Hadoop的编译过程及常见问题解决方案，包括Ant安装、编译警告排除、依赖包安装等，并指导如何正确部署到集群。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

1. 安装ant

从http://ant.apache.org/下载最新的ant，将其解压缩，然后安装README所述的方法即可完成安装

2. 在hadoop目录下，执行ant -file build.xml进行编译，提示：

compile-rcc-compiler:
[javac] /home/hadoop-1.0.4/build.xml:463: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds

compile-core-classes:
[javac] /home/hadoop-1.0.4/build.xml:487: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds

compile-hdfs-classes:
[javac] /home/hadoop-1.0.4/build.xml:576: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 1 source file to /home/hadoop-1.0.4/build/classes

解决方法是进入build.xml文件，在相应的行加入：

includeantruntime="false"

3. 之后再执行ant -file build.xml，会提示：

create-native-configure:
[exec] configure.ac:47: error: possibly undefined macro: AC_PROG_LIBTOOL
[exec] If this token and others are legitimate, please use m4_pattern_allow.
[exec] See the Autoconf documentation.
[exec] autoreconf: /usr/bin/autoconf failed with exit status: 1

解决方法：

yum install libtool

4. 编译后，要将hadoop/build目录下的内容拷贝到集群的各个结点上，否则在mp的过程中，会提示如下错误：

2014-03-04 17:11:22,593 ERROR org.apache.hadoop.mapred.TaskTracker: Shutting down. Incompatible buildVersion.