本文是一篇关于Hadoop大数据环境下的DataNode和SecondaryNameNode入门教程。介绍了在hadoop1.x和2.x版本中，包括NameNode、DataNode、SecondaryNameNode等守护进程的角色及启动关闭的三种方式。详细阐述了启动和关闭脚本的执行过程，以及如何通过jps命令检查进程状态。建议采用独立启动并检查日志的方式确保服务正常运行。
一、五大守护进程
hadoop1.x
NameNode
DataNode
SecondaryNameNode
TaskTracker
JobTracker
hadoop2.x
SecondaryNameNode
ResourceManager
NodeManager
NameNode
DataNode
二、三种启动与关闭方式
1、sbin/start-all.sh
sbin/stop-all.sh
zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ jps
31355 Jps
zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ sbin/start-all.sh
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
17/05/29 09:14:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
Starting namenodes on [localhost]
localhost: starting namenode, logging to /myFile/04.BigData/hadoop-2.7.0/logs/hadoop-zhaojunyan-namenode-zhaojunyandeMacBook-Pro.local.out
localhost: starting datanode, logging to /myFile/04.BigData/hadoop-2.7.0/logs/hadoop-zhaojunyan-datanode-zhaojunyandeMacBook-Pro.local.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /myFile/04.BigData/hadoop-2.7.0/logs/hadoop-zhaojunyan-secondarynamenode-zhaojunyandeMacBook-Pro.local.out
17/05/29 09:14:32 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /myFile/04.BigData/hadoop-2.7.0/logs/yarn-zhaojunyan-resourcemanager-zhaojunyandeMacBook-Pro.local.out
localhost: starting nodemanager, logging to /myFile/04.BigData/hadoop-2.7.0/logs/yarn-zhaojunyan-nodemanager-zhaojunyandeMacBook-Pro.local.out
zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ jps
31888 Jps
31650 SecondaryNameNode
31762 ResourceManager
31847 NodeManager
31466 NameNode
31547 DataNode
zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ sbin/stop-all.sh
This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh
17/05/29 09:15:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
Stopping namenodes on [localhost]
localhost: stopping namenode
localhost: stopping datanode
Stopping secondary namenodes [0.0.0.0]
0.0.0.0: stopping secondarynamenode
17/05/29 09:15:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
stopping yarn daemons
stopping resourcemanager
localhost: stopping nodemanager
no proxyserver to stop
zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$
2、sbin/start-dfs.sh
sbin/start-yarn.sh(hadoop2.x) sbin/start-mapred.sh(hadoop1.x)
sbin/stop-yarn.sh(hadoop2.x) sbin/stop-mapred.sh(hadoop1.x)
sbin/stop-dfs.sh
dfs: DataNode SecondaryNameNode NameNode
yarn: ResourceManager NodeManager
zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ jps
33595 Jps
zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ sbin/start-dfs.sh
17/05/29 09:27:3
最低0.47元/天 解锁文章
扫一扫
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
