Hadoop exception(Could not obtain block)

最新推荐文章于 2023-03-08 11:55:00 发布

原创最新推荐文章于 2023-03-08 11:55:00 发布 · 950 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#大数据 #java

本文记录了一次在使用Hadoop MapReduce过程中遇到的IOException错误：无法获取块blk_3994194388687994288_1253的具体解决过程。该问题出现在/tmp/hadoop-jack/mapred/staging/jack/.staging/job_201207131721_0004/job.split文件的读取过程中。

java.io.IOException: Could not obtain block: blk_3994194388687994288_1253 file=/tmp/hadoop-jack/mapred/staging/jack/.staging/job_201207131721_0004/job.split
	at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.chooseDataNode(DFSClient.java:2215)
	at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:2024)
	at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.read(DFSClient.java:2170)
	at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.read(DFSClient.java:2098)
	at java.io.DataInputStream.readByte(DataInputStream.java:248)
	at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:299)
	at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:320)
	at org.apache.hadoop.io.Text.readString(Text.java:400)
	at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:335)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:365)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
	at java.security.A