参考博文:
http://blog.cheyo.net/197.html
https://blog.youkuaiyun.com/bbaiggey/article/details/53583923
https://github.com/google/snappy/releases
一,环境准备
前提条件:hadoop-3.1.2, hbase-2.0.5, maven-3, jdk1.8
1,安装maven3,并配置环境变量
2,使用mvn -v 查看是否安装成功
root@xiaoma:~# javac -version
javac 1.8.0_141
xiaoma@xiaoma:~$ mvn -v
Apache Maven 3.6.2
root@xiaoma:~# hadoop version
Hadoop 3.1.2
root@xiaoma:~# hbase version
HBase 2.0.5
2,测试机环境变量:
export JAVA_HOME=/usr/lib/jdk1.8.0_141
export JRE_HOME=${JAVA_HOME}/jre
export CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib
export PATH=${JAVA_HOME}/bin:${JRE_HOME}/lib:$PATH
export MAVEN_HOME=/home/xiaoma/apache-maven-3.6.2
export PATH=$PATH:$MAVEN_HOME/bin
export HADOOP_HOME=/home/xiaoma/hadoop-3.1.2
export HBASE_HOME=/home/xiaoma/hbase-2.0.5
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$HBASE_HOME/bin
二,安装gcc,autoconf,automake,libtool
可尝试先使用命令
root@xiaoma:/ apt-get update
安装gcc,centos使用 yum install gcc
root@xiaoma:/ apt-get install build-essential
安装autoconf,automake,libtool,
分别执行以下命令
root@xiaoma:/# apt-get install autoconf
root@xiaoma:/# apt-get install automake
root@xiaoma:/# apt-get install libtool
三, 安装Snappy库
hadoop本身是并不支持snappy格式的压缩的(可以通过hadoop checknative指令查看),默认为false,(后续也可以用来检测是否安装成功)
下载地址(1.1.1)
https://src.fedoraproject.org/repo/pkgs/snappy/snappy-1.1.1.tar.gz/8887e3b7253b22a31f5486bca3cbc1c2/snappy-1.1.1.tar.gz
1,下载解压
root@xiaoma:/home/xiaoma tar -zxvf /home/xiaoma/snappy-1.1.1.tar.gz
2,进入解压后的文件夹,进行编译,链接到本地库
分别执行命令
root@xiaoma:/home/xiaoma/snappy-1.1.1# ./configure
root@xiaoma:/home/xiaoma/snappy-1.1.1# make
root@xiaoma:/home/xiaoma/snappy-1.1.1# make install
默认安装到了/usr/local/lib, 这时在此目录下查看会生成:
root@xiaoma:/home/xiaom