1、Warning: $HADOOP_HOME is deprecated. hadoop的家目录是不推荐的

最新推荐文章于 2019-03-29 19:53:00 发布
原创 最新推荐文章于 2019-03-29 19:53:00 发布 · 722 阅读 · 0 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。

本文记录了Hadoop NameNode格式化的操作过程及警告信息，详细展示了启动消息内容，包括主机名、参数、版本等关键信息，并提到了$HADOOP_HOME环境变量已过时。 
[hadoop@master ~]$ hadoop namenode -format
Warning: $HADOOP_HOME is deprecated.

14/06/28 06:01:12 INFO namenode.NameNode: STARTUP_MSG: <pre name="code" class="plain"><span style="font-family: Arial, Helvetica, sans-serif;">/************************************************************</span>
STARTUP_MSG: Starting NameNodeSTARTUP_MSG: host = master/127.0.0.1STARTUP_MSG: args = [-format]STARTUP_MSG: version = 1.2.1STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013STARTUP_MSG: java = 1.7.0_51************************************************************/







1、Warning: $HADOOP_HOME is deprecated. hadoop的家目录是不推荐的


http://chenzhou123520.iteye.com/blog/1826002












                

        

    

    
  



    

      

        

            

              
                
                  jiezhang_oa
                
              
            

            

                关注
              
            

        

        

          
      

      










                



	

		

			

				
					
Hadoop目录

				
			

			

				

					九师兄
				

				

					09-12
					
					1448
					
				

			

		

		

			
				


1. 普通使用
2. hdfs
3. yarn
3.1 yarn队列









1. 普通使用

2. hdfs



3. yarn

3.1 yarn队列

yarn队列的使用方法

			
		

	



                

            
              



	

		

			

				
					
Warning: $HADOOP_HOME is deprecated.的原因以及解决方法

				
			

			

				

					weixin_34381666的博客
				

				

					02-24
					
					242
					
				

			

		

		

			
				
今天把hadoop从0.20.2版本升级到1.2.1版本之后，在很多时候都会报如下警告：Warning: $HADOOP_HOME is deprecated.

 其实我刚看到这个警告的时候，第一反应并不是怎么屏蔽掉它，而是想知道Apache为什么准备废弃掉HADOOP_HOME这个环境变量，因为我们知道，后面好多地方都会用到这个环境...

			
		

	



              


  
              

                


	

		

			

				
					
Warning: $HADOOP_HOME is deprecated. hadoop1.0.1解决方法

				
			

			

				

					mal327的专栏
				

				

					06-01
					
					9875
					
				

			

		

		

			
				
hadoop 1.0.1版本执行hadoop命令的时候，经常出现

Warning: $HADOOP_HOME is deprecated.

经过查看hadoop-1.0.1的hadoop和hadoop-config.sh脚本，发现对于HADDP_HOME做了判断

解决方法如下：

1.在配置文件中找到if fi语句，注释掉。（不推荐）

2.在HOME的目录编辑.bash

			
		

	





	

		

			

				
					
hadoop常见问题——Warning: $HADOOP_HOME is deprecated.

				
			

			

				

					拾依H的专栏
				

				

					05-28
					
					899
					
				

			

		

		

			
				
问题现象
执行hadoop命令的时候，经常出现Warning: $HADOOP_HOME is deprecated.
原因分析
Hadoop 在bin/hadoop和bin/hadoop-config.sh 中对HADOOP_HOME 进行了判断，
报出错误的地方： bin /hadoop文件

if [ "$HADOOP_HOME_WARN_SUPPRESS" == "" ] &&

			
		

	



		

			
		



	

		

			

				
					
Warning:$HADOOP_HOME is deprecated问题

				
			

			

				

					lavimer
				

				

					07-20
					
					1165
					
				

			

		

		

			
				
我们在执行脚本start-all.sh启动Hadoop，或则操作HDFS时会x

			
		

	





	

		

			

				
					
Warning: $HADOOP_HOME is deprecated. hadoop解决方法补充版

				
			

			

				

					君子不器
				

				

					01-19
					
					412
					
				

			

		

		

			
				
下面的解决方案我亲自试了没有问题；可行，但是对于初学者来说肯定会有一个疑问；这个.bash_profile文件到底在哪呢；其实很简单：
当前用户的.bash_profile在/home/用户/下，系统的.bash_profile在/etc/skel目录下; 默认可能是隐藏的；有人会问了，隐藏的我怎么打开它，一个简单的办法，直接使用vi命令打开指定目录下的该文件就可以了；比如：vi /root/.

			
		

	





	

		

			

				
					
解决Hadoop无法启动JobHistoryServer 用start-yarn.sh来运行，出现了什么替换了什么值，我看其他也是人打开也是这样，应该不是什么错，但就是无法运行，用jps查看始终没有，之后在网上找方法进入sbin目录下用./mr-jobhistory-daemon.sh start historyserver，但还是无法成功没用，也依旧访问不了8080端口  WARNING: YARN_CONF_DIR has been replaced by HADOOP_CONF_DIR. Using value of YARN_CONF_DIR. WARNING: YARN_LOG_DIR has been replaced by HADOOP_LOG_DIR. Using value of YARN_LOG_DIR. WARNING: Use of this script to start the MR JobHistory daemon is deprecated. WARNING: Attempting to execute replacement "mapred --daemon start" instead. WARNING: HADOOP_MAPRED_ROOT_LOGGER has been replaced by HADOOP_ROOT_LOGGER. Using value of HADOOP_MAPRED_ROOT_LOGGER.打开后出现的，我看其他人也是一样

				
			

			

				

					02-06
				

			

		

		

			
				
- WARNING: Use of this script to start the MR JobHistory daemon is deprecated. - WARNING: Attempting to execute replacement "mapred --daemon start" instead. - WARNING: HADOOP_MAPRED_ROOT_LOGGER has ...

			
		

	





	

		

			

				
					
$HADOOP_HOME/bin/hadoop脚本文件分析

				
			

			

				

					行云流水的博客
				

				

					08-11
					
					7401
					
				

			

		

		

			
				
#!/usr/bin/env bash

# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information

			
		

	





	

		

			

				
					
WARNING: YARN_CONF_DIR has been replaced by HADOOP_CONF_DIR. Using value of YARN_CONF_DIR

				
			

			

				

					07-29
				

			

		

		

			
				
 export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$HADOOP_HOME/lib:$HIVE_HOME/lib:$HADOOP_CONF_DIR # 将 HADOOP_CONF_DIR 加入 CLASSPATH  ``` - 保存文件后，应用更改：  ```bash  source ~/.bashrc  ```  **步骤 3...

			
		

	





	

		

			

				
					
[root@localhost sqoop-1.4.7.bin__hadoop-2.6.0]# bin/sqoop export --connect jdbc:mysql://localhost:3306/dbtaobao --username root --password 123456 --table user_log --export-dir '/user/hive/warehouse/dbtaobao.db/inner_user_log' --fields-terminated-by ',';
Warning: /usr/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /usr/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /usr/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Warning: /usr/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/../zookeeper does not exist! Accumulo imports will fail.
Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
2025-06-06 00:44:19,902 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
2025-06-06 00:44:20,015 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
2025-06-06 00:44:20,281 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
2025-06-06 00:44:20,287 INFO tool.CodeGenTool: Beginning code generation
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
2025-06-06 00:44:22,137 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user_log` AS t LIMIT 1
2025-06-06 00:44:22,270 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user_log` AS t LIMIT 1
2025-06-06 00:44:22,293 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/hadoop/hadoop-3.1.3
注: /tmp/sqoop-root/compile/2647ebe9a3777fcaa95ca65a919294ec/user_log.java使用或覆盖了已过时的 API。
注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
2025-06-06 00:44:26,610 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/2647ebe9a3777fcaa95ca65a919294ec/user_log.jar
2025-06-06 00:44:26,629 INFO mapreduce.ExportJobBase: Beginning export of user_log
2025-06-06 00:44:26,629 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2025-06-06 00:44:27,018 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
2025-06-06 00:44:28,689 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2025-06-06 00:44:28,961 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2025-06-06 00:44:28,966 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2025-06-06 00:44:28,966 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2025-06-06 00:44:29,494 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2025-06-06 00:44:29,762 INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
2025-06-06 00:44:29,762 INFO impl.MetricsSystemImpl: JobTracker metrics system started
2025-06-06 00:44:30,031 INFO input.FileInputFormat: Total input files to process : 1
2025-06-06 00:44:30,053 INFO input.FileInputFormat: Total input files to process : 1
2025-06-06 00:44:30,136 INFO mapreduce.JobSubmitter: number of splits:4
2025-06-06 00:44:30,284 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2025-06-06 00:44:30,660 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local583218486_0001
2025-06-06 00:44:30,660 INFO mapreduce.JobSubmitter: Executing with tokens: []
2025-06-06 00:44:31,271 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-root/mapred/local/1749141870870/libjars <- /usr/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/libjars/*
2025-06-06 00:44:31,278 WARN fs.FileUtil: Command 'ln -s /tmp/hadoop-root/mapred/local/1749141870870/libjars /usr/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/libjars/*' failed 1 with: ln: 无法创建符号链接"/usr/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/libjars/*": 没有那个文件或目录

2025-06-06 00:44:31,278 WARN mapred.LocalDistributedCacheManager: Failed to create symlink: /tmp/hadoop-root/mapred/local/1749141870870/libjars <- /usr/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/libjars/*
2025-06-06 00:44:31,278 INFO mapred.LocalDistributedCacheManager: Localized file:/tmp/hadoop/mapred/staging/root583218486/.staging/job_local583218486_0001/libjars as file:/tmp/hadoop-root/mapred/local/1749141870870/libjars
2025-06-06 00:44:31,569 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
2025-06-06 00:44:31,571 INFO mapreduce.Job: Running job: job_local583218486_0001
2025-06-06 00:44:31,614 INFO mapred.LocalJobRunner: OutputCommitter set in config null
2025-06-06 00:44:31,631 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.sqoop.mapreduce.NullOutputCommitter
2025-06-06 00:44:31,798 INFO mapred.LocalJobRunner: Waiting for map tasks
2025-06-06 00:44:31,802 INFO mapred.LocalJobRunner: Starting task: attempt_local583218486_0001_m_000000_0
2025-06-06 00:44:32,000 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
2025-06-06 00:44:32,006 INFO mapred.MapTask: Processing split: Paths:/user/hive/warehouse/dbtaobao.db/inner_user_log/000000_0:355065+59179,/user/hive/warehouse/dbtaobao.db/inner_user_log/000000_0:414244+59179
2025-06-06 00:44:32,012 INFO Configuration.deprecation: map.input.file is deprecated. Instead, use mapreduce.map.input.file
2025-06-06 00:44:32,012 INFO Configuration.deprecation: map.input.start is deprecated. Instead, use mapreduce.map.input.start
2025-06-06 00:44:32,012 INFO Configuration.deprecation: map.input.length is deprecated. Instead, use mapreduce.map.input.length
2025-06-06 00:44:32,050 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2025-06-06 00:44:32,260 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2025-06-06 00:44:32,299 INFO mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
2025-06-06 00:44:32,328 INFO mapred.LocalJobRunner: Starting task: attempt_local583218486_0001_m_000001_0
2025-06-06 00:44:32,357 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
2025-06-06 00:44:32,359 INFO mapred.MapTask: Processing split: Paths:/user/hive/warehouse/dbtaobao.db/inner_user_log/000000_0:0+118355
2025-06-06 00:44:32,387 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2025-06-06 00:44:32,524 INFO mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
2025-06-06 00:44:32,553 INFO mapred.LocalJobRunner: Starting task: attempt_local583218486_0001_m_000002_0
2025-06-06 00:44:32,566 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
2025-06-06 00:44:32,567 INFO mapred.MapTask: Processing split: Paths:/user/hive/warehouse/dbtaobao.db/inner_user_log/000000_0:118355+118355
2025-06-06 00:44:32,585 INFO mapreduce.Job: Job job_local583218486_0001 running in uber mode : false
2025-06-06 00:44:32,587 INFO mapreduce.Job:  map 0% reduce 0%
2025-06-06 00:44:32,616 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2025-06-06 00:44:32,745 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2025-06-06 00:44:32,799 INFO mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
2025-06-06 00:44:32,866 INFO mapred.LocalJobRunner: Starting task: attempt_local583218486_0001_m_000003_0
2025-06-06 00:44:32,901 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
2025-06-06 00:44:32,903 INFO mapred.MapTask: Processing split: Paths:/user/hive/warehouse/dbtaobao.db/inner_user_log/000000_0:236710+118355
2025-06-06 00:44:32,930 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2025-06-06 00:44:33,004 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2025-06-06 00:44:33,034 INFO mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false
2025-06-06 00:44:33,049 INFO mapred.LocalJobRunner: map task executor complete.
2025-06-06 00:44:33,050 WARN mapred.LocalJobRunner: job_local583218486_0001
java.lang.Exception: java.io.IOException: java.lang.ClassNotFoundException: user_log
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:492)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:552)
Caused by: java.io.IOException: java.lang.ClassNotFoundException: user_log
	at org.apache.sqoop.mapreduce.TextExportMapper.setup(TextExportMapper.java:74)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
	at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: user_log
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:348)
	at org.apache.sqoop.mapreduce.TextExportMapper.setup(TextExportMapper.java:70)
	... 10 more
2025-06-06 00:44:33,590 INFO mapreduce.Job: Job job_local583218486_0001 failed with state FAILED due to: NA
2025-06-06 00:44:33,599 INFO mapreduce.Job: Counters: 0
2025-06-06 00:44:33,623 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
2025-06-06 00:44:33,625 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 4.6274 seconds (0 bytes/sec)
2025-06-06 00:44:33,626 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2025-06-06 00:44:33,626 INFO mapreduce.ExportJobBase: Exported 0 records.
2025-06-06 00:44:33,626 ERROR mapreduce.ExportJobBase: Export job failed!
2025-06-06 00:44:33,626 ERROR tool.ExportTool: Error during export: 
Export job failed!
	at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:445)
	at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
	at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:80)
	at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99)
	at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
	at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
[root@localhost sqoop-1.4.7.bin__hadoop-2.6.0]# 给我解决方案


				
			

			

				

					06-07
				

			

		

		

			
				
 export HADOOP_COMMON_HOME=/path/to/hadoop # 确保Hadoop路径正确  source ~/.bashrc  ```  2. 检查Sqoop与Hadoop版本兼容性：  - Sqoop 1.4.7（如引用[^2][^4][^5]）通常兼容Hadoop 2.x（如2.6.0）。如果使用...

			
		

	





	

		

			

				
					
Warning: /home/sqoop-1.4.5-cdh5.3.6/../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /home/sqoop-1.4.5-cdh5.3.6/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/sqoop-1.4.5-cdh5.3.6/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Warning: /home/sqoop-1.4.5-cdh5.3.6/../zookeeper does not exist! Accumulo imports will fail.
Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
25/09/04 23:24:05 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5-cdh5.3.6
25/09/04 23:24:05 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
25/09/04 23:24:05 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.
25/09/04 23:24:05 INFO manager.SqlManager: Using default fetchSize of 1000
25/09/04 23:24:05 INFO tool.CodeGenTool: Beginning code generation
25/09/04 23:24:05 INFO manager.OracleManager: Time zone has been set to GMT
25/09/04 23:24:05 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM APPEND_TEST t WHERE 1=0
25/09/04 23:24:05 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/hadoop-2.8.2
Note: /tmp/sqoop-root/compile/6a88a05f1ea3fd8256509275ffd22b72/APPEND_TEST.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
25/09/04 23:24:06 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/6a88a05f1ea3fd8256509275ffd22b72/APPEND_TEST.jar
25/09/04 23:24:06 INFO manager.OracleManager: Time zone has been set to GMT
25/09/04 23:24:06 INFO manager.OracleManager: Time zone has been set to GMT
25/09/04 23:24:06 INFO mapreduce.ImportJobBase: Beginning import of APPEND_TEST
25/09/04 23:24:06 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
25/09/04 23:24:06 INFO manager.OracleManager: Time zone has been set to GMT
25/09/04 23:24:06 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
25/09/04 23:24:06 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032


					
最新发布

				
			

			

				

					09-06
				

			

		

		

			
				
export HADOOP_COMMON_HOME=/path/to/hadoop export HADOOP_MAPRED_HOME=/path/to/hadoop  # set the path to where bin/hbase is available export HBASE_HOME=/path/to/hbase  # Set the path to where bin/hive ...

			
		

	





	

		

			

				
					
hadoop1.2.1报Warning: $HADOOP_HOME is deprecated. 的解决方法

				
			

			

				

					蝈蝈的博客
				

				

					07-16
					
					968
					
				

			

		

		

			
				
启动/停止Hadoop时报了一个警告信息，安装的Hadoop版本是hadoop1.2.1，如下图：
 
原因是Hadoop本身对HADOOP_HOME做了判断，具体在bin/hadoop和bin/hadoop-config.sh里。在hadoop-config.sh里有如下的配置：

if [ "$HADOOP_HOME_WARN_SUPPRESS" = "" ] && [ "$HADOO

			
		

	





	

		

			

				
					
Hadoop1.2.1 出现Warning: $HADOOP_HOME is deprecated.的解决方案

				
			

			

				

					weixin_30507481的博客
				

				

					10-02
					
					159
					
				

			

		

		

			
				
通过启动或停止hadoop我们会发现会出现 “Warning:$HADOOP_HOMEisdeprecated” 这样一个警告，下面给出解决方案：


不过我们一般推荐第二种，因为我们还是需要$HADOOP_HOME的，方便引用。
所以我们一般在/etc/profile文件最后加上exportHADOOP_HOME_WARN_SUPPRESS=1，然后输入命令【sour...

			
		

	





	

		

			

				
					
hadoop-1.0.1根目录下的jar包

				
			

			

				

					weixin_30914981的博客
				

				

					03-29
					
					161
					
				

			

		

		

			
				
转载于:https://www.cnblogs.com/Sabre/p/10623573.html

			
		

	





	

		

			

				
					
Hadoop根目录出现hs_err*.log的解决办法

				
			

			

				

					cufu3352的博客
				

				

					11-06
					
					261
					
				

			

		

		

			
				
自己有一次在搭建hadoop环境时，发现有些进程就是起不来，而且hadoop、根目录还出现hs_err*.log、core*文件，
 文件很大，打开文件一看，里面都是一些虚拟机的错误信息。
 找了一些资料，确定是因为机器是6...

			
		

	





	

		

			

				
					
Warning: $HADOOP_HOME is deprecated解决方法

				
			

			

				

					weixin_30528371的博客
				

				

					03-30
					
					159
					
				

			

		

		

			
				
启动Hadoop时报了一个警告信息，我的系统是CentOS，安装的Hadoop版本是hadoop1.2.1，具体警告信息如下：

[root@m1 hadoop-1.2.1]# bin/start-all.sh 
Warning: $HADOOP_HOME is deprecated.

网上的说法是因为Hadoop本身对HADOOP_HOME做了判断，具体在bin/hadoo...

			
		

	





	

		

			

				
					
hadoop 临时目录

				
			

			

				

					mthinking
				

				

					02-18
					
					1473
					
				

			

		

		

			
				
1.配置[core-site.xml]文件


&lt;configuration&gt;
			&lt;property&gt;
					&lt;name&gt;fs.defaultFS&lt;/name&gt;
					&lt;value&gt;hdfs://s201/&lt;/value&gt;
			&lt;/property&gt;
			&lt;!--- 配置新的本地目录 

			
		

	





	

		

			

				
					
linux  Hadoop环境变量安装及应用

					
热门推荐

				
			

			

				

					baidu_41365524的博客
				

				

					04-04
					
					2万+
					
				

			

		

		

			
				
1．上传hadoop（切记在hadoop用户下）1．解压缩 tar -xzfhadoop-2.7.5.tar.gz 1．配置环境变量（1）首先进入hadoop的根目录（2）配置HADOOP_HOME查看 bashrc文件（3）配置HADOOP_CONF_DIR（4）配置PATH vi ~/.bashrc （删除上面的PATH，重新写入一个新的）exportPATH=$PATH:$JAVA_HOME...

			
		

	





	

		

			

				
					
Hadoop 详细配置文档

				
			

			

				

					DongHappyyy
				

				

					12-01
					
					1193
					
				

			

		

		

			
				
准备配置：

1、用sudo gedit /etc/hostname ,在打开的文件里更改主机名

2、为了虚拟机之间能够ping通，需要修改主机名

   sudo gedit /etc/hosts 命令，把对应的主机名进行更改，同时更改前面对应的ip地址

3、关闭防火墙：用sudo ufw version 来查看是否有防火墙

    开启/关闭防火墙：sudo ufw enable/dis...

			
		

	



              




          




        



    





    



      

      

        
      

      





	

		评论	
	

  
	




  

    

      添加红包
      
    

    

      

        
        

          
          
        

        
请填写红包祝福语或标题

      

      

        
        

          
          个
        

        
红包个数最小为10个

      

      

        
        

          
          元
        

        
红包金额最低5元

      

      

        
        

          当前余额3.43元
          前往充值 >
        

      

      

        

          需支付：10.00元
        

        
        
      

    

  





  

    
    
  

  

    
    
  








  

    

      

        

          

            
            
成就一亿技术人!

          

          

        

        

          

          

            领取后你会自动成为博主和红包主的粉丝
            规则
          

        

      

      

        

          

            
              
            
            

              
hope_wisdom
 发出的红包
            

          

        

        

          

          

          

        

      

    

    

  



      
      

      
实付元

      
使用余额支付

      

        

          

            
            点击重新获取
          

        

        
扫码支付

      

      

        
          
            
          
          
        
      

      

        
        钱包余额
          0
          

            
            

              

                
抵扣说明：

                
 1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
 2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

              

            

          

      

      余额充值