hadoop常见问题——Warning: $HADOOP_HOME is deprecated.

最新推荐文章于 2022-03-25 16:49:47 发布
原创 最新推荐文章于 2022-03-25 16:49:47 发布 · 913 阅读 · 0 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。

本文介绍了解决Hadoop命令执行过程中出现的警告问题：$HADOOP_HOMEisdeprecated. 分析了警告产生的原因，并提供了通过修改.bash_profile来抑制此警告的具体步骤。

问题现象

执行hadoop命令的时候，经常出现Warning: $HADOOP_HOME is deprecated.

原因分析

Hadoop 在bin/hadoop和bin/hadoop-config.sh 中对HADOOP_HOME 进行了判断，

报出错误的地方： bin /hadoop文件

if [ "$HADOOP_HOME_WARN_SUPPRESS" == "" ] && [ "$HADOOP_HOME" != "" ]; then

  echo "Warning: \$HADOOP_HOME is deprecated."

解决办法

在HOME的目录编辑.bash_profile，添加一个环境变量。

export HADOOP_HOME_WARN_SUPPRESS=1

 

【FFmpeg】解决警告warning: xxx is deprecated [-Wdeprecated-declarations]的方法
郭老二
03-28 2万+
1、问题描述 编译FFmpeg程序时，经常报一些关于“deprecated”的警告信息，具体内容如下： decode.cpp:28:2: warning: ‘void av_register_all()’ is deprecated [-Wdeprecated-declarations] av_register_all(); decode.cpp:34:2: warning: ‘void av...
Warning: $HADOOP_HOME is deprecated.的原因以及解决方法
weixin_34381666的博客
02-24 274
今天把hadoop从0.20.2版本升级到1.2.1版本之后，在很多时候都会报如下警告：Warning: $HADOOP_HOME is deprecated. 其实我刚看到这个警告的时候，第一反应并不是怎么屏蔽掉它，而是想知道Apache为什么准备废弃掉HADOOP_HOME这个环境变量，因为我们知道，后面好多地方都会用到这个环境...
Warning: $HADOOP_HOME is deprecated. hadoop1.0.1解决方法
mal327的专栏
06-01 9883
hadoop 1.0.1版本执行hadoop命令的时候，经常出现 Warning: $HADOOP_HOME is deprecated. 经过查看hadoop-1.0.1的hadoop和hadoop-config.sh脚本，发现对于HADDP_HOME做了判断 解决方法如下： 1.在配置文件中找到if fi语句，注释掉。（不推荐） 2.在HOME的目录编辑.bash
Warning:$HADOOP_HOME is deprecated问题
lavimer
07-20 1176
我们在执行脚本start-all.sh启动Hadoop，或则操作HDFS时会x
1、Warning: $HADOOP_HOME is deprecated. hadoop的家目录是不推荐的
jiezhang_oa的专栏
06-28 732
[hadoop@master ~]$ hadoop namenode -format Warning: $HADOOP_HOME is deprecated. 14/06/28 06:01:12 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ S
[root@slave1 ~]# $HADOOP_HOME/sbin/hadoop-daemon.sh start datanode WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. ERROR: Cannot set priority of datanode process 17355
11-08
WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. ERROR: Cannot set priority of datanode process 17355 ``` ###...
WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. ERROR: Cannot set priority of datanode process 66134 WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.是什么情况
06-15
### Hadoop HDFS DataNode 警告和错误问题的解决...- SecondaryNameNode 日志：`$HADOOP_HOME/logs/hadoop-hdfs-secondarynamenode-<hostname>.log` 通过日志中的错误信息，可以进一步定位问题的根本原因[^4]。 ---
[root@slave1 ~]# cd $HADOOP_HOME [root@slave1 hadoop-3.1.4]# sbin/start-dfs.sh WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Starting namenodes on [master] 上一次登录：六 11月 8 01:49:01 CST 2025:0 上 WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: namenode is running as process 12174. Stop it first. Starting datanodes ERROR: Refusing to run as root: ROOT account is not found. Aborting. Starting secondary namenodes [master] 上一次登录：六 11月 8 01:51:22 CST 2025pts/0 上 WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: secondarynamenode is running as process 12365. Stop it first. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. [root@slave1 hadoop-3.1.4]# sbin/start-yarn.sh Starting resourcemanager 上一次登录：六 11月 8 01:51:26 CST 2025pts/0 上 Starting nodemanagers 上一次登录：六 11月 8 01:51:32 CST 2025pts/0 上 slave2: ssh: connect to host slave2 port 22: No route to host slave3: ssh: connect to host slave3 port 22: No route to host [root@slave1 hadoop-3.1.4]# sbin/mr-jobhistory-daemon.sh start historyserver WARNING: Use of this script to start the MR JobHistory daemon is deprecated. WARNING: Attempting to execute replacement "mapred --daemon start" instead. [root@slave1 hadoop-3.1.4]# jps 3425 NodeManager 3713 Jps 11486 -- process information unavailable [root@slave1 hadoop-3.1.4]# ^C [root@slave1 hadoop-3.1.4]# jps 3425 NodeManager 4164 Jps 11486 -- process information unavailable [root@slave1 hadoop-3.1.4]# # 从root用户切换到普通用户localhost [root@slave1 hadoop-3.1.4]# su - localhost 上一次登录：六 11月 8 01:29:03 CST 2025从 slave1pts/3 上 [localhost@slave1 ~]$ # 进入Hadoop目录 [localhost@slave1 ~]$ cd $HADOOP_HOME [localhost@slave1 hadoop-3.1.4]$ [localhost@slave1 hadoop-3.1.4]$ # 先停止所有服务（避免残留进程） [localhost@slave1 hadoop-3.1.4]$ sbin/stop-all.sh WARNING: Stopping all Apache Hadoop daemons as localhost in 10 seconds. WARNING: Use CTRL-C to abort. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Stopping namenodes on [master] WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Stopping datanodes WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. slave2: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). slave3: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). slave1: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. slave1: ERROR: User defined in HDFS_DATANODE_SECURE_USER (yarn) does not exist. Aborting. Stopping secondary namenodes [master] WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Stopping nodemanagers ERROR: nodemanager can only be executed by root. Stopping resourcemanager ERROR: resourcemanager can only be executed by root. [localhost@slave1 hadoop-3.1.4]$ [localhost@slave1 hadoop-3.1.4]$ # 重新启动HDFS（重点解决DataNode启动问题） [localhost@slave1 hadoop-3.1.4]$ sbin/start-dfs.sh WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. Starting namenodes on [master] WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: ERROR: Unable to write in /usr/local/hadoop-3.1.4/logs. Aborting. Starting datanodes WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. slave3: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). slave2: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). slave1: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. slave1: ERROR: User defined in HDFS_DATANODE_SECURE_USER (yarn) does not exist. Aborting. Starting secondary namenodes [master] WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. master: ERROR: Unable to write in /usr/local/hadoop-3.1.4/logs. Aborting. WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER. [localhost@slave1 hadoop-3.1.4]$ [localhost@slave1 hadoop-3.1.4]$ # 查看slave1节点的进程（在slave1的localhost用户下） [localhost@slave1 hadoop-3.1.4]$ jps 5726 Jps [localhost@slave1 hadoop-3.1.4]$ # 在slave1的localhost用户下，查看DataNode日志 [localhost@slave1 hadoop-3.1.4]$ cat $HADOOP_HOME/logs/hadoop-localhost-datanode-slave1.log cat: /usr/local/hadoop-3.1.4/logs/hadoop-localhost-datanode-slave1.log: 没有那个文件或目录
最新发布
11-09
DataNode 启动失败可能有多种原因，常见的是数据目录权限问题或数据目录不一致。首先检查数据目录的权限，确保普通用户有读写权限： ```bash chown -R hadoop:hadoop /home/hadoop/software/hadoop-3.1.4/data ``` ...
解决Hadoop无法启动JobHistoryServer 用start-yarn.sh来运行，出现了什么替换了什么值，我看其他也是人打开也是这样，应该不是什么错，但就是无法运行，用jps查看始终没有，之后在网上找方法进入sbin目录下用./mr-jobhistory-daemon.sh start historyserver，但还是无法成功没用，也依旧访问不了8080端口 WARNING: YARN_CONF_DIR has been replaced by HADOOP_CONF_DIR. Using value of YARN_CONF_DIR. WARNING: YARN_LOG_DIR has been replaced by HADOOP_LOG_DIR. Using value of YARN_LOG_DIR. WARNING: Use of this script to start the MR JobHistory daemon is deprecated. WARNING: Attempting to execute replacement "mapred --daemon start" instead. WARNING: HADOOP_MAPRED_ROOT_LOGGER has been replaced by HADOOP_ROOT_LOGGER. Using value of HADOOP_MAPRED_ROOT_LOGGER.打开后出现的，我看其他人也是一样
02-06
- WARNING: Use of this script to start the MR JobHistory daemon is deprecated. - WARNING: Attempting to execute replacement "mapred --daemon start" instead. - WARNING: HADOOP_MAPRED_ROOT_LOGGER has ...
[hadoop@hdp01 ~]$ hadoop dfs -mkdir /input WARNING: Use of this script to execute dfs is deprecated. WARNING: Attempting to execute replacement "hdfs dfs" instead. mkdir: `/input': File exists [hadoop@hdp01 ~]$ hadoop dfs -ls WARNING: Use of this script to execute dfs is deprecated. WARNING: Attempting to execute replacement "hdfs dfs" instead. ls: `.': No such file or directory
03-20
好的，我现在需要帮用户解决他们在使用Hadoop时遇到的错误信息。首先，用户提供了两段命令执行后的输出，分别是创建目录和列目录时出现的错误。 首先看第一个命令：`hadoop dfs -mkdir /input`。系统提示警告说这个...
Warning: $HADOOP_HOME is deprecated. hadoop解决方法补充版
君子不器
01-19 421
下面的解决方案我亲自试了没有问题；可行，但是对于初学者来说肯定会有一个疑问；这个.bash_profile文件到底在哪呢；其实很简单： 当前用户的.bash_profile在/home/用户/下，系统的.bash_profile在/etc/skel目录下; 默认可能是隐藏的；有人会问了，隐藏的我怎么打开它，一个简单的办法，直接使用vi命令打开指定目录下的该文件就可以了；比如：vi /root/.
hadoop报错，ERROR Invalid HADOOP_COMMON_HOME)
web15285868498的博客
03-25 3854
hadoop报错，ERROR: Invalid HADOOP_COMMON_HOME 在hadoop集群中，运行hadoop报错，ERROR: Invalid HADOOP_COMMON_HOME，的一个解决办法。 在hadoop集群中，运行hadoop报错，ERROR: Invalid HADOOP_COMMON_HOME，的一个解决办法。 首先确定hadoop的安装没有错误。 进入hadoop安装路径，cd （hadoop安装路径） cd /home/ys/opt/disk/hadoop
hadoop1.2.1报Warning: $HADOOP_HOME is deprecated. 的解决方法
蝈蝈的博客
07-16 1075
启动/停止Hadoop时报了一个警告信息，安装的Hadoop版本是hadoop1.2.1，如下图：   原因是Hadoop本身对HADOOP_HOME做了判断，具体在bin/hadoop和bin/hadoop-config.sh里。在hadoop-config.sh里有如下的配置： if [ "$HADOOP_HOME_WARN_SUPPRESS" = "" ] && [ "$HADOO
Hadoop1.2.1 出现Warning: $HADOOP_HOME is deprecated.的解决方案
weixin_30507481的博客
10-02 166
通过启动或停止hadoop我们会发现会出现 “Warning:$HADOOP_HOMEisdeprecated” 这样一个警告，下面给出解决方案： 不过我们一般推荐第二种，因为我们还是需要$HADOOP_HOME的，方便引用。 所以我们一般在/etc/profile文件最后加上exportHADOOP_HOME_WARN_SUPPRESS=1，然后输入命令【sour...
is deprecated
weixin_30662109的博客
09-26 158
运行时候遇到这样的错误： /usr/local/lib/python2.7/dist-packages/django/conf/urls/defaults.py:3: DeprecationWarning: django.conf.urls.defaults is deprecated; use django.conf.urls instead DeprecationWarning) ...
Hadoop启动时出现Warning: $HADOOP_HOME is deprecated.警告。
03-25 289
一．问题描述。 当启动Hadoop时出现Warning: $HADOOP_HOME is deprecated.警告。如下图 二．问题分析。 ...
Hadoop启动时出现Warning: $HADOOP_HOME is deprecated.警告
bear
03-25 2217
$HADOOP_HOME is deprecated警告在Hadoop启动时产生。
hadoop报错，ERROR: Invalid HADOOP_COMMON_HOME)
热门推荐
qq_37769075的博客
04-08 1万+
hadoop报错，ERROR: Invalid HADOOP_COMMON_HOME在hadoop集群中，运行hadoop报错，ERROR: Invalid HADOOP_COMMON_HOME，的一个解决办法。 在hadoop集群中，运行hadoop报错，ERROR: Invalid HADOOP_COMMON_HOME，的一个解决办法。 首先确定hadoop的安装没有错误。 进入hadoop安装路径，cd （hadoop安装路径） cd /home/ys/opt/disk/hadoop-3.1.2
hbase碰到ERROR: Invalid HADOOP_COMMON_HOME
微电子学与固体电子学-俞驰
05-20 4087
hbase shell ERROR: Invalid HADOOP_COMMON_HOME 2020-05-20 18:53:54,656 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable HBase Shell Use "help" to get list of supported .
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
表情包 代码片
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值