Format HDFS Namenode Error

最新推荐文章于 2021-09-02 10:46:42 发布

原创最新推荐文章于 2021-09-02 10:46:42 发布 · 122 阅读

0 ·

CC 4.0 BY-SA版权

DC_macOS_Home

文章标签：

#big data

博客记录了在bigdatalinux环境下配置Hadoop时遇到的Namenode启动错误。错误信息提示找不到或加载主类。解决方案是更新环境变量配置文件`.bashrc`和`hadoop-env.sh`，设置正确的`JAVA_HOME`和`HADOOP_HOME`路径，确保Hadoop相关目录已添加到PATH中。

记录一个在bigdata linux 配置下的一个namenode的问题

错误：

root@parallels-Parallels-Virtual-Platform:~/app/hadoop-2.7.3# hadoop namenode -format DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. Error: Could not find or load main class org.apache.hadoop.hdfs.server.namenode.NameNode

解决：

.bashrc

export HADOOP_HOME=/home/hadoop/hadoop-3.2.1
export HADOOP_INSTALL=$HADOOP_HOME
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export YARN_HOME=$HADOOP_HOME
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bin
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib/"
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64

hadoop-env.sh

export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64

export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop