启动hadoop 2.7.3 datanode启动后又宕机, 遇到的datanode启动不了

启动hadoop 2.7.3 datanode启动后又宕机, 遇到的datanode启动不了  

启动hadoop 2.7.3 datanode启动后又宕机, 遇到的datanode启动不了

 

官方安装手册:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_support-matrices/content/ch_matrices-ambari.html#ambari_stack

 

安装版本如下：

centos7.2 生产系统

ambari-2.5.0.3

HDP-2.6.0.3

HDP-UTILS-1.1.0.21

 

这是ambari页面，datanode失败节点的监控页面：

转存失败重新上传取消

 [root@bdp02dn06 ~]# jps

4848 Jps

2116 LivyServer

1621 NodeManager

2936 SparkSubmit

 

分析日志如下

===========================================================================================================

第一份日志   cat  /var/log/ambari-agent/ambari-agent.log

 

134 - [Alert][datanode_storage] Unable to execute alert. [Alert][datanode_storage] Unable to extract JSON from JMX response

      Mount point for directory /data04/hadoop/hdfs/data is /data04

      Mount point for directory /data04/hadoop/hdfs/data is /data04

      Mount point for directory /data05/hadoop/hdfs/data is /data05

      Mount point for directory /data05/hadoop/hdfs/data is /data05

      Mount point for directory /data06/hadoop/hdfs/data is /data06

      Mount point for directory /data06/hadoop/hdfs/data is /data06

      Mount point for directory /data07/hadoop/hdfs/data is /data07

      Mount point for directory /data07/hadoop/hdfs/data is /data07

      Mount point for directory /data08/hadoop/hdfs/data is /data08

      Mount point for directory /data08/hadoop/hdfs/data is /data08

 - Heartbeat (response id = 7108) with server is running...

 - Building heartbeat message

 Adding host info/state to heartbeat message.