解决首次启动Hadoop2.5.x时出现的问题

最新推荐文章于 2024-06-16 15:45:58 发布

原创最新推荐文章于 2024-06-16 15:45:58 发布 · 776 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#hadoop #ubuntu #linux

Hadoop入门专栏收录该内容

3 篇文章

订阅专栏

本文详细介绍了在Ubuntu环境下安装并配置Hadoop的过程中遇到的问题，包括启动Hadoop时出现的错误及其解决方法，重点是环境变量的设置、JAVA_HOME路径的添加以及Hadoop相关库的正确配置。

虚拟机安装的Ubuntu为32位14.04版

启动 Hadoop : $ sbin/start-dfs.sh

接着出现包含以下内容的错误：

WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/<user>/hadoop/hadoop-2.5.1/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
localhost]

sed: -e expression #1, char 6: unknown option to `s'
Client: ssh: Could not resolve hostname client: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not known
library: ssh: Could not resolve hostname library: Name or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known
-c: Unknown cipher type 'cd'
fix: ssh: Could not resolve hostname fix: Name or service not known

the: ssh: Could not resolve hostname the: Name or service not known

....

需要在Ubuntu的环境变量文件（etc/profile）内增加以下参数

#以用户实际路径为准

export HADOOP_PREFIX=/home/<user>/hadoop/hadoop-2.5.1/
export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_PREFIX}/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib"

在 hadoop-env.sh 内增加 JAVA_HOME 路径

export JAVA_HOME=/home/<user>/jdk7