HIVE 安装
主备工作
1. 安装hadoop
2.安装mysql
3.安装hive
3.1 下载hive安装包
现在url: http://archive.apache.org/dist/hive/ 选择相应的版本
本次安装选择2.3.3
3.2 解压hive包
terry@terry-VirtualBox:/opt/bigdata_platform$ tar -xvf ../source/apache-hive-2.3.3-bin.tar.gz -C .
3.3 修改 配置文件
修改hive-env.sh, hive-site.xml文件
修改hive环境变量,在hive-env.sh修改即可
#hadoop的根目录
HADOOP_HOME=/opt/bigdata_platform/hadoop-2.7.6
# Hive Configuration Directory can be controlled by:
# export HIVE_CONF_DIR=
#hive配置文件目录
export HIVE_CONF_DIR=/opt/bigdata_platform/apache-hive-2.3.3-bin/conf
# Folder containing extra libraries required for hive compilation/execution can be controlled by:
# export HIVE_AUX_JARS_PATH=
#hive使用的jar包目录
export HIVE_AUX_JARS_PATH=/opt/bigdata_platform/apache-hive-2.3.3-bin/lib/*
修改hive metastore的连接器, 这里使用mysql, 直接修改hive-site.xml,如果无hive-site.xml文件, 直接
cp hive-default.xml hive-site.xml
在hive-site.xml文件中修改如下内容:
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>123456</value>
</property>
<property>
<name>javax.jdo.option.ConnectionURL</name>
<!--mysql 的访问地址-->
<value>jdbc:mysql://192.168.249.134:3306/hive?createDatabaseIfNotExist=true</value>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
需要换成绝对路径的部分
<property>
<name>hive.exec.local.scratchdir</name>
<!--需要换成hive安装的绝对路径-->
<value>/opt/bigdata_platform/apache-hive-2.3.3-bin/temp/terry</value>
<description>Local scratch space for Hive jobs</description>
</property>
<property>
<name>hive.downloaded.resources.dir</name>
<value>/opt/bigdata_platform/apache-hive-2.3.3-bin/temp/resources</value>
<description>Temporary local directory for added resources in the remote file system. </description>
</property>
<property>
<name>hive.querylog.location</name>
<value>/opt/bigdata_platform/apache-hive-2.3.3-bin/terry</value>
<description>Location of Hive run time structured log file</description>
</property>
<property>
<name>hive.server2.logging.operation.log.location</name>
<value>/opt/bigdata_platform/apache-hive-2.3.3-bin/terry/operation_logs</value>
<description>Top level directory where operation logs are stored if logging functionality is enabled</description>
</property>
复制mysql-connector-java-5.1.27-bin.jar文件到$HIVE_HOME/lib目录下面, 否则连接不上mysql
3.4 初始化Schema, 并启动hive
初始化Schema
schematool -initSchema -dbType mysql
启动hive
terry@terry-VirtualBox:/opt/bigdata_platform/apache-hive-2.3.3-bin$ bin/hive
hive> show databases;
OK
default
Time taken: 8.333 seconds, Fetched: 1 row(s)
hive>
表示已安装成功