hadoop checknative -a 出错

本文介绍了Hadoop原生库的检查与配置过程,重点解决了Snappy压缩库加载失败的问题,并通过安装正确的Snappy包实现了所有原生库的正确加载。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

[root@master native]# hadoop checknative -a

19/07/16 14:27:19 INFO bzip2.Bzip2Factory: Successfully loaded & initialized native-bzip2 library system-native

19/07/16 14:27:19 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library

19/07/16 14:27:19 ERROR snappy.SnappyCompressor: failed to load SnappyCompressor

java.lang.UnsatisfiedLinkError: Cannot load libsnappy.so.1 (libsnappy.so.1: 无法打开共享对象文件: 没有那个文件或目录)!

at org.apache.hadoop.io.compress.snappy.SnappyCompressor.initIDs(Native Method)

at org.apache.hadoop.io.compress.snappy.SnappyCompressor.<clinit>(SnappyCompressor.java:61)

at org.apache.hadoop.io.compress.SnappyCodec.isNativeCodeLoaded(SnappyCodec.java:80)

at org.apache.hadoop.util.NativeLibraryChecker.main(NativeLibraryChecker.java:82)

Native library checking:

hadoop: true /opt/software/hadoop-2.7.7/lib/native/libhadoop.so.1.0.0

zlib: true /lib64/libz.so.1

snappy: false

lz4: true revision:99

bzip2: true /lib64/libbz2.so.1

openssl: true /opt/software/hadoop-2.7.7/lib/native/libcrypto.so

19/07/16 14:27:19 INFO util.ExitUtil: Exiting with status 1

 

下载https://centos.pkgs.org/6/centos-x86_64/snappy-1.1.0-1.el6.x86_64.rpm.html

 

 

安装rpm -ivh snappy-1.1.0-1.el6.x86_64.rpm

 

[root@master software]# rpm -ivh snappy-1.1.0-1.el6.x86_64.rpm

Preparing... ########################################### [100%]

1:snappy ########################################### [100%]

[root@master software]# hadoop checknative -a

19/07/16 14:40:36 INFO bzip2.Bzip2Factory: Successfully loaded & initialized native-bzip2 library system-native

19/07/16 14:40:36 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library

Native library checking:

hadoop: true /opt/software/hadoop-2.7.7/lib/native/libhadoop.so.1.0.0

zlib: true /lib64/libz.so.1

snappy: true /usr/lib64/libsnappy.so.1

lz4: true revision:99

bzip2: true /lib64/libbz2.so.1

openssl: true /opt/software/hadoop-2.7.7/lib/native/libcrypto.so

[root@master software]#

 

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值