hadoop datanode 启动失败,没有任何报错的解决

博客主要讲述了在Hadoop环境下,Datanode启动时日志中未显示任何错误,但进程未能正常启动的情况。通过分析Datanode的outlog和errlog,作者推测问题可能出在本地动态库,并提出了重新编译或替换合适动态库作为解决方案。

datanode的log日志仅有如下信息,没有报错,但是进程没有起来:

2013-11-25 09:57:01,466 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = tdw-10-136-149-102/10.136.149.102
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.4
STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r 1393290; compiled by 'hortonfo' on Wed Oct  3
 05:13:58 UTC 2012
************************************************************/
2013-11-25 09:57:02,013 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2013-11-25 09:57:02,028 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
2013-11-25 09:57:02,029 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2013-11-25 09:57:02,029 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system started
2013-11-25 09:57:02,216 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered.

Datanode的outlog:

WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
log4j:ERROR Could not find value for key log4j.appender.NullAppender
log4j:ERROR Could not instantiate appender named "NullAppender".
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGFPE (0x8) at pc=0x00002b3f7a5a765f, pid=6202, tid=1076017472
#
# JRE version: 6.0_17-b04
# Java VM: Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode linux-amd64 )
# Problematic frame:
# C  [ld-linux-x86-64.so.2+0x865f]
#
# An error report file with more information is saved as:
# /data/tdwadmin/tdwenv/hadoop-1.0.4/hs_err_pid6202.log
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.

如上的pid的errlog(截取):

2aaaaabc4000-2aaaaabd1000 r-xp 00000000 08:04 96256038                   /data/tdwadmin/tdwenv/jdk1.6.0_17/jre/lib/amd64/libverify.so
2aaaaabd1000-2aaaaacd0000 ---p 0000d000 08:04 96256038                   /data/tdwadmin/tdwenv/jdk1.6.0_17/jre/lib/amd64/libverify.so
2aaaaacd0000-2aaaaacd3000 rwxp 0000c000 08:04 96256038                   /data/tdwadmin/tdwenv/jdk1.6.0_17/jre/lib/amd64/libverify.so
2aaaaacd3000-2aaaaacfc000 r-xp 00000000 08:04 96256017                   /data/tdwadmin/tdwenv/jdk1.6.0_17/jre/lib/amd64/libjava.so
2aaaaacfc000-2aaaaadfb000 ---p 00029000 08:04 96256017                   /data/tdwadmin/tdwenv/jdk1.6.0_17/jre/lib/amd64/libjava.so
2aaaaadfb000-2aaaaae02000 rwxp 00028000 08:04 96256017                   /data/tdwadmin/tdwenv/jdk1.6.0_17/jre/lib/amd64/libjava.so

推断是本地动态库有问题,重新编译动态库或拷贝合适的动态库,问题解决。

评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值