spark报错ERROR history.FsHistoryProvider

最新推荐文章于 2022-11-16 14:51:38 发布

Furys

最新推荐文章于 2022-11-16 14:51:38 发布

阅读量1k

点赞数

文章标签： spark hive hadoop 大数据 hdfs

本文链接：https://blog.youkuaiyun.com/new_Xxx/article/details/104462283

版权

错误内容:
spark的logs日志
20/02/23 15:28:14 ERROR history.FsHistoryProvider: Exception encountered when attempting to load application log hdfs://node01:9000/sparklog/local-1577264935490
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1795867413-192.168.100.201-1573709411052:blk_1073745968_5179 file=/sparklog/local-1577264935490
at org.apache.hadoop.hdfs.DFSInputStream.refetchLocations(DFSInputStream.java:1040)
at org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:1023)
at org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:1002)
at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:642)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:895)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:954)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:284)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
at java.io.InputStreamReader.read(InputStreamReader.java:184)
at java.io.BufferedReader.fill(BufferedReader.java:161)
at java.io.BufferedReader.readLine(BufferedReader.java:324)
at java.io.BufferedReader.readLine(BufferedReader.java:389)
at scala.io.BufferedSource $B u f f e r e d L i n e I t e r a t o r . h a s N e x t (B u f f e r e d S o u r c e . s c a l a : 72) a t s c a l a . c o l l e c t i o n . I t e r a t o r$ $anon $21 . h a s N e x t (I t e r a t o r . s c a l a :$

最低0.47元/天解锁文章