1、Warning: $HADOOP_HOME is deprecated. hadoop的家目录是不推荐的

最新推荐文章于 2019-05-06 15:46:34 发布
原创 最新推荐文章于 2019-05-06 15:46:34 发布 · 732 阅读 · 0 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。

本文记录了Hadoop NameNode格式化的操作过程及警告信息，详细展示了启动消息内容，包括主机名、参数、版本等关键信息，并提到了$HADOOP_HOME环境变量已过时。 
[hadoop@master ~]$ hadoop namenode -format
Warning: $HADOOP_HOME is deprecated.

14/06/28 06:01:12 INFO namenode.NameNode: STARTUP_MSG: <pre name="code" class="plain"><span style="font-family: Arial, Helvetica, sans-serif;">/************************************************************</span>
STARTUP_MSG: Starting NameNodeSTARTUP_MSG: host = master/127.0.0.1STARTUP_MSG: args = [-format]STARTUP_MSG: version = 1.2.1STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013STARTUP_MSG: java = 1.7.0_51************************************************************/







1、Warning: $HADOOP_HOME is deprecated. hadoop的家目录是不推荐的


http://chenzhou123520.iteye.com/blog/1826002












                

        

    


  



    

      

        

            

              
                
                  jiezhang_oa
                
              
            

            

                关注
              
            

        

        

          
      

      










                



	

		

			

				
					
Hadoop目录

				
			

			

				

					九师兄
				

				

					09-12
					
					1464
					
				

			

		

		

			
				


1. 普通使用
2. hdfs
3. yarn
3.1 yarn队列









1. 普通使用

2. hdfs



3. yarn

3.1 yarn队列

yarn队列的使用方法

			
		

	



                

            
              



	

		

			

				
					
Warning: $HADOOP_HOME is deprecated.的原因以及解决方法

				
			

			

				

					weixin_34381666的博客
				

				

					02-24
					
					271
					
				

			

		

		

			
				
今天把hadoop从0.20.2版本升级到1.2.1版本之后，在很多时候都会报如下警告：Warning: $HADOOP_HOME is deprecated.

 其实我刚看到这个警告的时候，第一反应并不是怎么屏蔽掉它，而是想知道Apache为什么准备废弃掉HADOOP_HOME这个环境变量，因为我们知道，后面好多地方都会用到这个环境...

			
		

	



              


  
              

                


	

		

			

				
					
Warning: $HADOOP_HOME is deprecated. hadoop1.0.1解决方法

				
			

			

				

					mal327的专栏
				

				

					06-01
					
					9882
					
				

			

		

		

			
				
hadoop 1.0.1版本执行hadoop命令的时候，经常出现

Warning: $HADOOP_HOME is deprecated.

经过查看hadoop-1.0.1的hadoop和hadoop-config.sh脚本，发现对于HADDP_HOME做了判断

解决方法如下：

1.在配置文件中找到if fi语句，注释掉。（不推荐）

2.在HOME的目录编辑.bash

			
		

	





	

		

			

				
					
hadoop常见问题——Warning: $HADOOP_HOME is deprecated.

				
			

			

				

					拾依H的专栏
				

				

					05-28
					
					913
					
				

			

		

		

			
				
问题现象
执行hadoop命令的时候，经常出现Warning: $HADOOP_HOME is deprecated.
原因分析
Hadoop 在bin/hadoop和bin/hadoop-config.sh 中对HADOOP_HOME 进行了判断，
报出错误的地方： bin /hadoop文件

if [ "$HADOOP_HOME_WARN_SUPPRESS" == "" ] &&

			
		

	



		

			
		



	

		

			

				
					
Warning:$HADOOP_HOME is deprecated问题

				
			

			

				

					lavimer
				

				

					07-20
					
					1171
					
				

			

		

		

			
				
我们在执行脚本start-all.sh启动Hadoop，或则操作HDFS时会x

			
		

	





	

		

			

				
					
Warning: $HADOOP_HOME is deprecated. hadoop解决方法补充版

				
			

			

				

					君子不器
				

				

					01-19
					
					418
					
				

			

		

		

			
				
下面的解决方案我亲自试了没有问题；可行，但是对于初学者来说肯定会有一个疑问；这个.bash_profile文件到底在哪呢；其实很简单：
当前用户的.bash_profile在/home/用户/下，系统的.bash_profile在/etc/skel目录下; 默认可能是隐藏的；有人会问了，隐藏的我怎么打开它，一个简单的办法，直接使用vi命令打开指定目录下的该文件就可以了；比如：vi /root/.

			
		

	





	

		

			

				
					
[root@slave1 ~]# $HADOOP_HOME/sbin/hadoop-daemon.sh start datanode
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
WARNING: Use of this script to start HDFS daemons is deprecated.
WARNING: Attempting to execute replacement "hdfs --daemon start" instead.
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
ERROR: Cannot set priority of datanode process 17355


				
			

			

				

					11-08
				

			

		

		

			
				
WARNING: Use of this script to start HDFS daemons is deprecated. WARNING: Attempting to execute replacement "hdfs --daemon start" instead. ERROR: Cannot set priority of datanode process 17355 ```  ###...

			
		

	





	

		

			

				
					
[root@slave1 ~]# cd $HADOOP_HOME
[root@slave1 hadoop-3.1.4]# sbin/start-dfs.sh
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
Starting namenodes on [master]
上一次登录：六 11月  8 01:49:01 CST 2025:0 上
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: namenode is running as process 12174.  Stop it first.
Starting datanodes
ERROR: Refusing to run as root: ROOT account is not found. Aborting.
Starting secondary namenodes [master]
上一次登录：六 11月  8 01:51:22 CST 2025pts/0 上
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: secondarynamenode is running as process 12365.  Stop it first.
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
[root@slave1 hadoop-3.1.4]# sbin/start-yarn.sh
Starting resourcemanager
上一次登录：六 11月  8 01:51:26 CST 2025pts/0 上
Starting nodemanagers
上一次登录：六 11月  8 01:51:32 CST 2025pts/0 上
slave2: ssh: connect to host slave2 port 22: No route to host
slave3: ssh: connect to host slave3 port 22: No route to host
[root@slave1 hadoop-3.1.4]# sbin/mr-jobhistory-daemon.sh start historyserver
WARNING: Use of this script to start the MR JobHistory daemon is deprecated.
WARNING: Attempting to execute replacement "mapred --daemon start" instead.
[root@slave1 hadoop-3.1.4]# jps
3425 NodeManager
3713 Jps
11486 -- process information unavailable
[root@slave1 hadoop-3.1.4]# ^C
[root@slave1 hadoop-3.1.4]# jps
3425 NodeManager
4164 Jps
11486 -- process information unavailable
[root@slave1 hadoop-3.1.4]# # 从root用户切换到普通用户localhost
[root@slave1 hadoop-3.1.4]# su - localhost
上一次登录：六 11月  8 01:29:03 CST 2025从 slave1pts/3 上
[localhost@slave1 ~]$ # 进入Hadoop目录
[localhost@slave1 ~]$ cd $HADOOP_HOME
[localhost@slave1 hadoop-3.1.4]$ 
[localhost@slave1 hadoop-3.1.4]$ # 先停止所有服务（避免残留进程）
[localhost@slave1 hadoop-3.1.4]$ sbin/stop-all.sh
WARNING: Stopping all Apache Hadoop daemons as localhost in 10 seconds.
WARNING: Use CTRL-C to abort.
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
Stopping namenodes on [master]
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
Stopping datanodes
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
slave2: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
slave3: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
slave1: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
slave1: ERROR: User defined in HDFS_DATANODE_SECURE_USER (yarn) does not exist. Aborting.
Stopping secondary namenodes [master]
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
Stopping nodemanagers
ERROR: nodemanager can only be executed by root.
Stopping resourcemanager
ERROR: resourcemanager can only be executed by root.
[localhost@slave1 hadoop-3.1.4]$ 
[localhost@slave1 hadoop-3.1.4]$ # 重新启动HDFS（重点解决DataNode启动问题）
[localhost@slave1 hadoop-3.1.4]$ sbin/start-dfs.sh
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
Starting namenodes on [master]
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: ERROR: Unable to write in /usr/local/hadoop-3.1.4/logs. Aborting.
Starting datanodes
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
slave3: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
slave2: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
slave1: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
slave1: ERROR: User defined in HDFS_DATANODE_SECURE_USER (yarn) does not exist. Aborting.
Starting secondary namenodes [master]
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
master: ERROR: Unable to write in /usr/local/hadoop-3.1.4/logs. Aborting.
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
[localhost@slave1 hadoop-3.1.4]$ 
[localhost@slave1 hadoop-3.1.4]$ # 查看slave1节点的进程（在slave1的localhost用户下）
[localhost@slave1 hadoop-3.1.4]$ jps
5726 Jps
[localhost@slave1 hadoop-3.1.4]$ # 在slave1的localhost用户下，查看DataNode日志
[localhost@slave1 hadoop-3.1.4]$ cat $HADOOP_HOME/logs/hadoop-localhost-datanode-slave1.log
cat: /usr/local/hadoop-3.1.4/logs/hadoop-localhost-datanode-slave1.log: 没有那个文件或目录

				
			

			

				

					11-09
				

			

		

		

			
				
此命令将 `/home/hadoop/app/hadoop-3.1.4` 目录及其子目录的所有权赋予 hadoop 用户和 hadoop 用户组。  ### ssh 连接失败 Hadoop 集群依赖 ssh 进行节点间的通信。确保各节点之间可以通过 ssh 无密码登录。首先在...

			
		

	





	

		

			

				
					
WARNING: Use of this script to start HDFS daemons is deprecated.
WARNING: Attempting to execute replacement "hdfs --daemon start" instead.
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
ERROR: Cannot set priority of datanode process 66134
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
WARNING: Use of this script to start HDFS daemons is deprecated.
WARNING: Attempting to execute replacement "hdfs --daemon start" instead.
WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.是什么情况


				
			

			

				

					06-15
				

			

		

		

			
				
日志路径通常位于 `$HADOOP_HOME/logs` 目录下[^3]。  #### 示例配置文件 以下是 `hadoop-env.sh` 文件的一个完整示例配置： ```bash export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64 export HADOOP_SECURE_DN...

			
		

	





	

		

			

				
					
dblab@ubuntu:~/hadoop$ $HADOOP_HOME/sbin/yarn-daemon.sh start resourcemanager
WARNING: Use of this script to start YARN daemons is deprecated.
WARNING: Attempting to execute replacement "yarn --daemon start" instead.
resourcemanager is running as process 9241.  Stop it first and ensure /tmp/hadoop-dblab-resourcemanager.pid file is empty before retry.
dblab@ubuntu:~/hadoop$ 


					
最新发布

				
			

			

				

					11-23
				

			

		

		

			
				
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin ``` 修改完成后，使用以下命令使环境变量生效： ```bash source ~/.bashrc ``` 或者 ```bash source /etc/profile ``` - **使用 Hadoop 自带脚本启动服务**：...

			
		

	





	

		

			

				
					
解决Hadoop无法启动JobHistoryServer 用start-yarn.sh来运行，出现了什么替换了什么值，我看其他也是人打开也是这样，应该不是什么错，但就是无法运行，用jps查看始终没有，之后在网上找方法进入sbin目录下用./mr-jobhistory-daemon.sh start historyserver，但还是无法成功没用，也依旧访问不了8080端口  WARNING: YARN_CONF_DIR has been replaced by HADOOP_CONF_DIR. Using value of YARN_CONF_DIR. WARNING: YARN_LOG_DIR has been replaced by HADOOP_LOG_DIR. Using value of YARN_LOG_DIR. WARNING: Use of this script to start the MR JobHistory daemon is deprecated. WARNING: Attempting to execute replacement "mapred --daemon start" instead. WARNING: HADOOP_MAPRED_ROOT_LOGGER has been replaced by HADOOP_ROOT_LOGGER. Using value of HADOOP_MAPRED_ROOT_LOGGER.打开后出现的，我看其他人也是一样

				
			

			

				

					02-06
				

			

		

		

			
				
- WARNING: Use of this script to start the MR JobHistory daemon is deprecated. - WARNING: Attempting to execute replacement "mapred --daemon start" instead. - WARNING: HADOOP_MAPRED_ROOT_LOGGER has ...

			
		

	





	

		

			

				
					
hadoop1.2.1报Warning: $HADOOP_HOME is deprecated. 的解决方法

				
			

			

				

					蝈蝈的博客
				

				

					07-16
					
					1059
					
				

			

		

		

			
				
启动/停止Hadoop时报了一个警告信息，安装的Hadoop版本是hadoop1.2.1，如下图：
 
原因是Hadoop本身对HADOOP_HOME做了判断，具体在bin/hadoop和bin/hadoop-config.sh里。在hadoop-config.sh里有如下的配置：

if [ "$HADOOP_HOME_WARN_SUPPRESS" = "" ] && [ "$HADOO

			
		

	





	

		

			

				
					
Hadoop1.2.1 出现Warning: $HADOOP_HOME is deprecated.的解决方案

				
			

			

				

					weixin_30507481的博客
				

				

					10-02
					
					165
					
				

			

		

		

			
				
通过启动或停止hadoop我们会发现会出现 “Warning:$HADOOP_HOMEisdeprecated” 这样一个警告，下面给出解决方案：


不过我们一般推荐第二种，因为我们还是需要$HADOOP_HOME的，方便引用。
所以我们一般在/etc/profile文件最后加上exportHADOOP_HOME_WARN_SUPPRESS=1，然后输入命令【sour...

			
		

	





	

		

			

				
					
hadoop-1.0.1根目录下的jar包

				
			

			

				

					weixin_30914981的博客
				

				

					03-29
					
					169
					
				

			

		

		

			
				
转载于:https://www.cnblogs.com/Sabre/p/10623573.html

			
		

	





	

		

			

				
					
Hadoop根目录出现hs_err*.log的解决办法

				
			

			

				

					cufu3352的博客
				

				

					11-06
					
					266
					
				

			

		

		

			
				
自己有一次在搭建hadoop环境时，发现有些进程就是起不来，而且hadoop、根目录还出现hs_err*.log、core*文件，
 文件很大，打开文件一看，里面都是一些虚拟机的错误信息。
 找了一些资料，确定是因为机器是6...

			
		

	





	

		

			

				
					
hadoop文件目录详解

				
			

			

				

					qq_43227570的博客
				

				

					05-06
					
					4998
					
				

			

		

		

			
				
Dfs:hdfs文件系统，data:datanode目录，name：namenode目录
Mapred：MapReduce目录

Name目录：

1.Current:里面包含edits、fsimage、seen_txid、VERSION

edits 日志：客户端执行写操作会先写入edits日志，并且在内存中保留
Fsimage :namenode的镜像文件，每次checkpoing（合并所...

			
		

	





	

		

			

				
					
【HDFS基础】HDFS文件目录详解

					
热门推荐

				
			

			

				

					白夜行
				

				

					07-28
					
					3万+
					
				

			

		

		

			
				
HDFS的文件目录图分析：从上图可以看出，HDFS的文件目录主要由NameNode、SecondaryNameNode和DataNode组成，而NameNode和DataNode之间由心跳机制通信。注：
HDFS(Hadoop Distributed File System)默认的存储单位是128M的数据块。 
可以执行命令vim /home/qingaolei/hadoop/hadoop-2.8.

			
		

	





	

		

			

				
					
Hadoop HDFS常用命令

				
			

			

				

					lockie的博客
				

				

					11-27
					
					820
					
				

			

		

		

			
				
hadoop fs -cat URI [URI …]
			查看文件内容
		hadoop fs -copyFromLocal &lt;localsrc&gt; URI
			本地文件上传到hdfs，和put命令相似
		hadoop fs -copyToLocal [-ignorecrc] [-crc] URI &lt;localdst&gt;
			hdfs文件下载到本地，和get命令类似
	...

			
		

	





	

		

			

				
					
Warning: $HADOOP_HOME is deprecated解决方法

				
			

			

				

					weixin_30528371的博客
				

				

					03-30
					
					166
					
				

			

		

		

			
				
启动Hadoop时报了一个警告信息，我的系统是CentOS，安装的Hadoop版本是hadoop1.2.1，具体警告信息如下：

[root@m1 hadoop-1.2.1]# bin/start-all.sh 
Warning: $HADOOP_HOME is deprecated.

网上的说法是因为Hadoop本身对HADOOP_HOME做了判断，具体在bin/hadoo...

			
		

	



              




          




        



    





    



      

      

        
      

      





	

		评论	
	

  
	




  

    

      添加红包
      
    

    

      

        
        

          
          
        

        
请填写红包祝福语或标题

      

      

        
        

          
          个
        

        
红包个数最小为10个

      

      

        
        

          
          元
        

        
红包金额最低5元

      

      

        
        

          当前余额3.43元
          前往充值 >
        

      

      

        

          需支付：10.00元
        

        
        
      

    

  





  

    
    
  

  

    
    
  








  

    

      

        

          

            
            
成就一亿技术人!

          

          

        

        

          

          

            领取后你会自动成为博主和红包主的粉丝
            规则
          

        

      

      

        

          

            
              
            
            

              
hope_wisdom
 发出的红包
            

          

        

        

          

          

          

        

      

    

    

  



      
      

      
实付元

      
使用余额支付

      

        

          

            
            点击重新获取
          

        

        
扫码支付

      

      

        
          
            
          
          
        
      

      

        
        钱包余额
          0
          

            
            

              

                
抵扣说明：

                
 1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
 2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

              

            

          

      

      余额充值