Hadoop启动时出现Warning: $HADOOP_HOME is deprecated.警告。

最新推荐文章于 2020-03-30 09:58:57 发布
转载 最新推荐文章于 2020-03-30 09:58:57 发布 · 290 阅读 · 0

本文针对启动Hadoop时出现的警告$HADOOP_HOMEisdeprecated进行了详细的分析，并提供了三种有效的解决方案，包括注释配置文件、设置环境变量以及使更改生效的方法。

一．问题描述。

  当启动Hadoop时出现Warning: $HADOOP_HOME is deprecated.警告。如下图

    

二．问题分析。

  出现该问题是在执行start-all.sh脚本时。因此可进入start-all.sh脚本查找与此警告相关的信息。再次脚本中会分别调用hadoop-config.sh、start-dfs.sh、start-mapred.sh。如下图

    

  分别进入以上三个脚本中查看，会在hadoop-config.sh脚本中找到信息，出现此警告的原因是if条件语句同时满足条件而造成。如下图

    

三．解决方案:

一．将/etc/profile中的HADOOP_HOME注释掉。（不建议使用）


二．在/etc/profile中设置HADOOP_HOME_SUPPRESS=1.（如下图）


    三．修改/etc/profile后，使用source /etc/profile 使其立即生效

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/30172158/viewspace-2063522/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/30172158/viewspace-2063522/

congxia2002
关注
Warning: $HADOOP_HOME is deprecated. hadoop解决方法补充版
weixin_30652879的博客
01-24 124
下面的解决方案我亲自试了没有问题；可行，但是对于初学者来说肯定会有一个疑问；这个.bash_profile文件到底在哪呢；其实很简单： 当前用户的.bash_profile在/home/用户/下，系统的.bash_profile在/etc/skel目录下; 默认可能是隐藏的；有人会问了，隐藏的我怎么打开它，一个简单的办法，直接使用vi命令打开指定目录下的该文件就...
Hadoop启动时提示的：$HADOOP_HOME is deprecated.
royqiangyx的专栏
05-09 5482
Hadoop启动时提示的：$HADOOP_HOME is deprecated. 不影响功能但是你要是和我一样有洁癖就看着不舒服 解决办法:在安装目录下conf下找到hadoop-env.sh然后再里面添加 export HADOOP_HOME_WARN_SUPPRESS=”TRUE”从新启动就可以了 有时间为了不重复的安装虚拟机可以在装了一个虚拟机后复制粘贴，修改虚拟机名字， 在vm中
Warning: $HADOOP_HOME is deprecated. hadoop1.0.4解决方法
chenzhou123520的专栏
03-08 238
启动Hadoop时报了一个警告信息，我安装的Hadoop版本是hadoop1.0.4，具体警告信息如下： [root@localhost hadoop-1.0.4]# ./bin/start-all.sh Warning: $HADOOP_HOME is deprecated.  网上的说法是因为Hadoop本身对HADOOP_HOME做了判断，具体在bin/hadoop和bin/ha...
Warning: $HADOOP_HOME is deprecated. hadoop1.0.1解决方法
mal327的专栏
06-01 9884
hadoop 1.0.1版本执行hadoop命令的时候，经常出现 Warning: $HADOOP_HOME is deprecated. 经过查看hadoop-1.0.1的hadoop和hadoop-config.sh脚本，发现对于HADDP_HOME做了判断 解决方法如下： 1.在配置文件中找到if fi语句，注释掉。（不推荐） 2.在HOME的目录编辑.bash
Warning: $HADOOP_HOME is deprecated.的原因以及解决方法
weixin_34381666的博客
02-24 275
今天把hadoop从0.20.2版本升级到1.2.1版本之后，在很多时候都会报如下警告：Warning: $HADOOP_HOME is deprecated. 其实我刚看到这个警告的时候，第一反应并不是怎么屏蔽掉它，而是想知道Apache为什么准备废弃掉HADOOP_HOME这个环境变量，因为我们知道，后面好多地方都会用到这个环境...
[root@slave1 ~]# $HADOOP_HOME/sbin/hadoop-daemon.sh start datanode WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. ERROR: Cannot set priority of datanode process 17355
11-08
WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. ERROR: Cannot set priority of datanode process 17355 ``` ###...
WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. ERROR: Cannot set priority of datanode process 66134 WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.是什么情况
06-15
### Hadoop HDFS DataNode 警告和错误问题的解决...- SecondaryNameNode 日志：`$HADOOP_HOME/logs/hadoop-hdfs-secondarynamenode-<hostname>.log` 通过日志中的错误信息，可以进一步定位问题的根本原因[^4]。 ---
[root@slave1 ~]# cd $HADOOP_HOME [root@slave1 hadoop-3.1.4]# sbin/start-dfs.sh WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Starting namenodes on [master] 上一次登录：六 11月 8 01:49:01 CST 2025:0 上 WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: namenode is running as process 12174. Stop it first. Starting datanodes ERROR: Refusing to run as root: ROOT account is not found. Aborting. Starting secondary namenodes [master] 上一次登录：六 11月 8 01:51:22 CST 2025pts/0 上 WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: secondarynamenode is running as process 12365. Stop it first. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. [root@slave1 hadoop-3.1.4]# sbin/start-yarn.sh Starting resourcemanager 上一次登录：六 11月 8 01:51:26 CST 2025pts/0 上 Starting nodemanagers 上一次登录：六 11月 8 01:51:32 CST 2025pts/0 上 slave2: ssh: connect to host slave2 port 22: No route to host slave3: ssh: connect to host slave3 port 22: No route to host [root@slave1 hadoop-3.1.4]# sbin/mr-jobhistory-daemon.sh start historyserver WARNING: Use of this script to start the MR JobHistory daemon is deprecated. WARNING: Attempting to execute replacement "mapred --daemon start" instead. [root@slave1 hadoop-3.1.4]# jps 3425 NodeManager 3713 Jps 11486 -- process information unavailable [root@slave1 hadoop-3.1.4]# ^C [root@slave1 hadoop-3.1.4]# jps 3425 NodeManager 4164 Jps 11486 -- process information unavailable [root@slave1 hadoop-3.1.4]# # 从root用户切换到普通用户localhost [root@slave1 hadoop-3.1.4]# su - localhost 上一次登录：六 11月 8 01:29:03 CST 2025从 slave1pts/3 上 [localhost@slave1 ~]$ # 进入Hadoop目录 [localhost@slave1 ~]$ cd $HADOOP_HOME [localhost@slave1 hadoop-3.1.4]$ [localhost@slave1 hadoop-3.1.4]$ # 先停止所有服务（避免残留进程） [localhost@slave1 hadoop-3.1.4]$ sbin/stop-all.sh WARNING: Stopping all Apache Hadoop daemons as localhost in 10 seconds. WARNING: Use CTRL-C to abort. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Stopping namenodes on [master] WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Stopping datanodes WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. slave2: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). slave3: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). slave1: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. slave1: ERROR: User defined in HDFS_DATANODE_SECURE_USER (yarn) does not exist. Aborting. Stopping secondary namenodes [master] WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Stopping nodemanagers ERROR: nodemanager can only be executed by root. Stopping resourcemanager ERROR: resourcemanager can only be executed by root. [localhost@slave1 hadoop-3.1.4]$ [localhost@slave1 hadoop-3.1.4]$ # 重新启动HDFS（重点解决DataNode启动问题） [localhost@slave1 hadoop-3.1.4]$ sbin/start-dfs.sh WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Starting namenodes on [master] WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: ERROR: Unable to write in /usr/local/hadoop-3.1.4/logs. Aborting. Starting datanodes WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. slave3: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). slave2: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). slave1: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. slave1: ERROR: User defined in HDFS_DATANODE_SECURE_USER (yarn) does not exist. Aborting. Starting secondary namenodes [master] WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: ERROR: Unable to write in /usr/local/hadoop-3.1.4/logs. Aborting. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. [localhost@slave1 hadoop-3.1.4]$ [localhost@slave1 hadoop-3.1.4]$ # 查看slave1节点的进程（在slave1的localhost用户下） [localhost@slave1 hadoop-3.1.4]$ jps 5726 Jps [localhost@slave1 hadoop-3.1.4]$ # 在slave1的localhost用户下，查看DataNode日志 [localhost@slave1 hadoop-3.1.4]$ cat $HADOOP_HOME/logs/hadoop-localhost-datanode-slave1.log cat: /usr/local/hadoop-3.1.4/logs/hadoop-localhost-datanode-slave1.log: 没有那个文件或目录
最新发布
11-09
日志写入权限不足可能导致服务启动时无法正常记录日志。需要确保普通用户对日志目录有写入权限。例如，修改 Hadoop 日志目录的权限： ```bash chown -R hadoop:hadoop /home/hadoop/software/hadoop-3.1.4/logs ``` ...
解决Hadoop无法启动JobHistoryServer 用start-yarn.sh来运行，出现了什么替换了什么值，我看其他也是人打开也是这样，应该不是什么错，但就是无法运行，用jps查看始终没有，之后在网上找方法进入sbin目录下用./mr-jobhistory-daemon.sh start historyserver，但还是无法成功没用，也依旧访问不了8080端口 WARNING: YARN_CONF_DIR has been replaced by HADOOP_CONF_DIR. Using value of YARN_CONF_DIR. WARNING: YARN_LOG_DIR has been replaced by HADOOP_LOG_DIR. Using value of YARN_LOG_DIR. WARNING: Use of this script to start the MR JobHistory daemon is deprecated. WARNING: Attempting to execute replacement "mapred --daemon start" instead. WARNING: HADOOP_MAPRED_ROOT_LOGGER has been replaced by HADOOP_ROOT_LOGGER. Using value of HADOOP_MAPRED_ROOT_LOGGER.打开后出现的，我看其他人也是一样
02-06
在使用 `start-yarn.sh` 命令启动 Hadoop 的 JobHistoryServer 时，出现了若干警告消息，其中包括： - WARNING: YARN_CONF_DIR has been replaced by HADOOP_CONF_DIR. Using value of YARN_CONF_DIR. - WARNING: ...
WARNING: YARN_CONF_DIR has been replaced by HADOOP_CONF_DIR. Using value of YARN_CONF_DIR
07-29
- 在您的配置中（如引用[^1]所示），没有显式设置 `YARN_CONF_DIR` 或 `HADOOP_CONF_DIR`，这可能导致系统使用默认路径（如 `$HADOOP_HOME/etc/hadoop`），但警告提示需要显式标准化配置[^1]。 #### 2. **迁移指南...
Warning: $HADOOP_HOME is deprecated解决方法
weixin_30528371的博客
03-30 166
启动Hadoop时报了一个警告信息，我的系统是CentOS，安装的Hadoop版本是hadoop1.2.1，具体警告信息如下： [root@m1 hadoop-1.2.1]# bin/start-all.sh Warning: $HADOOP_HOME is deprecated. 网上的说法是因为Hadoop本身对HADOOP_HOME做了判断，具体在bin/hadoo...
Hadoop 1.2.1: Warning: $HADOOP_HOME is deprecated.
【昆山人在上海】
12-09 763
在使用Hadoop1.3.1时，遇到如下提示： Warning: $HADOOP_HOME is deprecated. 解决办法： 在.bashrc文件里，使用HADOOP_PREFIX来替代HADOOP_HOME。
Warning:$HADOOP_HOME is deprecated问题
lavimer
07-20 1177
我们在执行脚本start-all.sh启动Hadoop，或则操作HDFS时会x
Hadoop出现Warning: $HADOOP_HOME is deprecated.的解决方案
weixin_43076448的博客
11-15 233
在/etc/profile文件中添加exportHADOOP_HOME_WARN_SUPPRESS=1 步骤一：编辑文件 vim /etc/profile 步骤二：添加内容 exportHADOOP_HOME_WARN_SUPPRESS=1 步骤三：使其生效 source/etc/profile ...
hadoop1.2.1报Warning: $HADOOP_HOME is deprecated. 的解决方法
蝈蝈的博客
07-16 1084
启动/停止Hadoop时报了一个警告信息，安装的Hadoop版本是hadoop1.2.1，如下图：   原因是Hadoop本身对HADOOP_HOME做了判断，具体在bin/hadoop和bin/hadoop-config.sh里。在hadoop-config.sh里有如下的配置： if [ "$HADOOP_HOME_WARN_SUPPRESS" = "" ] && [ "$HADOO
hadoop启动dfs警告问题
collec的博客
03-30 341
Hadoop启动前，.bashrc添加hadoop配置很重要，特别是最后一行，不然会提示警告： WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable 添加如下内容： export HADOOP_HO...
Hadoop启动时出现Warning: $HADOOP_HOME is deprecated.警告
bear
03-25 2218
$HADOOP_HOME is deprecated警告在Hadoop启动时产生。
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值