hadoop集群有一个profile的mr任务总是failed


报错如下:

Error: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException): No lease on /amos/warehouse/amos/profile/merging/incremental_output/20161104/part-r-00086 (inode 2840478): File does not exist. [Lease.  Holder: DFSClient_attempt_1476688405189_12279_r_000086_0_-30984655_1, pendingcreates: 1]


打开history的时候,总是提示:history  not founded



根据错误提示,网上搜索了解决办法:修改hadoop配置文件hdfs-site.xml

将原来配置4096修改为8192,增加一倍,解决问题。


<property>  

<name>dfs.datanode.max.xcievers</name>  

<value>8192</value>  

</property>