hadoop集群有一个profile的mr任务总是failed
报错如下:
Error: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException): No lease on /amos/warehouse/amos/profile/merging/incremental_output/20161104/part-r-00086 (inode 2840478): File does not exist. [Lease. Holder: DFSClient_attempt_1476688405189_12279_r_000086_0_-30984655_1, pendingcreates: 1]
打开history的时候,总是提示:history not founded
根据错误提示,网上搜索了解决办法:修改hadoop配置文件hdfs-site.xml
将原来配置4096修改为8192,增加一倍,解决问题。
<property>
<name>dfs.datanode.max.xcievers</name>
<value>8192</value>
</property>
转载于:https://blog.51cto.com/daixuan/1870043