服务器异常关机，启动yarn nodemanager 报错 CURRENT file does not end with newline 处理方法

最新推荐文章于 2024-07-25 11:28:54 发布

原创最新推荐文章于 2024-07-25 11:28:54 发布 · 2k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#yarn #hadoop #nodemanager

hadoop 专栏收录该内容

2 篇文章

订阅专栏

本文记录了一次服务器宕机后，NodeManager启动失败的问题排查与解决过程。通过日志发现CURRENT文件异常，定位到yarn-nm-state目录，删除问题文件后成功重启服务。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

偶遇服务器宕机，服务器中很多文件损坏，启动nodemanager时，一直报错，日志如下，感觉是某个文件损坏造成的

2019-05-16 15:50:41,379 INFO  service.AbstractService (AbstractService.java:noteFailure(272)) - Service NodeManager failed in state INITE
D; cause: org.apache.hadoop.service.ServiceStateException: org.fusesource.leveldbjni.internal.NativeDB$DBException: Corruption: CURRENT file does not end with newlineorg.apache.hadoop.service.ServiceStateException: org.fusesource.leveldbjni.internal.NativeDB$DBException: Corruption: CURRENT file does n
ot end with newline    at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartRecoveryStore(NodeManager.java:178)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:220)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:546)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:594)
Caused by: org.fusesource.leveldbjni.internal.NativeDB$DBException: Corruption: CURRENT file does not end with newline
    at org.fusesource.leveldbjni.internal.NativeDB.checkStatus(NativeDB.java:200)
    at org.fusesource.leveldbjni.internal.NativeDB.open(NativeDB.java:218)
    at org.fusesource.leveldbjni.JniDBFactory.open(JniDBFactory.java:168)
    at org.apache.hadoop.yarn.server.nodemanager.recovery.NMLeveldbStateStoreService.openDatabase(NMLeveldbStateStoreService.java:966
)    at org.apache.hadoop.yarn.server.nodemanager.recovery.NMLeveldbStateStoreService.initStorage(NMLeveldbStateStoreService.java:953)
    at org.apache.hadoop.yarn.server.nodemanager.recovery.NMStateStoreService.serviceInit(NMStateStoreService.java:200)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    ... 5 more

从日志中可知，CURRENT文件内容异常，但不知道具体路径，查资料获知，文件上层目录应该是yarn-nm-state，使用下面命令找到具体路径，删除文件，重启nodemanager，问题解决