Hive部署

Hive安装与配置指南

最新推荐文章于 2022-12-04 16:54:00 发布

原创最新推荐文章于 2022-12-04 16:54:00 发布 · 230 阅读

0 ·

CC 4.0 BY-SA版权

Hive 专栏收录该内容

11 篇文章

订阅专栏

1.获取安装包

wget https://archive.cloudera.com/cdh5/cdh/5/hive-1.1.0-cdh5.16.2.tar.gz

[wzj@hadoop001 software]$ ll
total 549960
-rw-r–r--. 1 wzj wzj 434354462 Dec 2 11:06 hadoop-2.6.0-cdh5.16.2.tar.gz
-rw-r–r--. 1 wzj wzj 128800223 Dec 15 10:55 hive-1.1.0-cdh5.16.2.tar.gz

2.环境准备

官网介绍如下：
Requirements
Java 1.7
Note: Hive versions 1.2 onward require Java 1.7 or newer. Hive versions 0.14 to 1.1 work with Java 1.6 as well. Users are strongly advised to start moving to Java 1.8 (see HIVE-8607).
Hadoop 2.x (preferred), 1.x (not supported by Hive 2.0.0 onward).
Hive versions up to 0.13 also supported Hadoop 0.20.x, 0.23.x.
Hive is commonly used in production Linux
hadoop部署https://blog.youkuaiyun.com/wzj_wp/article/details/103348359

mysql部署
mysql部署https://blog.youkuaiyun.com/wzj_wp/article/details/103251071

*我已经提前装好了jdk1.8和hadoop2.6.0
[wzj@hadoop001 software]$ ll
total 549960
-rw-r–r--. 1 wzj wzj 434354462 Dec 2 11:06 hadoop-2.6.0-cdh5.16.2.tar.gz
[wzj@hadoop001 software]$ which java
/usr/java/jdk1.8.0_45/bin/java
*

3.解压 tar包

tar -xzvf hive-1.1.0-cdh5.16.2.tar.gz -C …/app/
我是放置在我自己app的目录下，你可以根据你的需要放置

4.软连接（好处多多，自行体会）

ln -s hive-1.1.0-cdh5.16.2.tar.gz hive
[wzj@hadoop001 app]$ ll
total 0
lrwxrwxrwx. 1 wzj wzj 21 Dec 15 10:58 hive -> hive-1.1.0-cdh5.16.2/
drwxr-xr-x. 11 wzj wzj 197 Jun 3 2019 hive-1.1.0-cdh5.16.2

[wzj@hadoop001 app]$ cd hive
[wzj@hadoop001 hive]$ ll
total 416
drwxr-xr-x. 2 wzj wzj     48 Jun  3  2019 auxlib
drwxr-xr-x. 3 wzj wzj    119 Jun  3  2019 bin ##脚本
drwxr-xr-x. 2 wzj wzj    200 Dec 15 11:17 conf ##配置文件
drwxr-xr-x. 3 wzj wzj     21 Jun  3  2019 data
drwxr-xr-x. 6 wzj wzj    110 Jun  3  2019 docs
drwxr-xr-x. 4 wzj wzj     34 Jun  3  2019 examples
drwxr-xr-x. 7 wzj wzj     68 Jun  3  2019 hcatalog
drwxr-xr-x. 4 wzj wzj   8192 Dec 15 11:00 lib ##jar包
-rw-r--r--. 1 wzj wzj  24754 Jun  3  2019 LICENSE
-rw-r--r--. 1 wzj wzj    397 Jun  3  2019 NOTICE
-rw-r--r--. 1 wzj wzj   4048 Jun  3  2019 README.txt
-rw-r--r--. 1 wzj wzj 376416 Jun  3  2019 RELEASE_NOTES.txt
drwxr-xr-x. 3 wzj wzj     23 Jun  3  2019 scripts

5.配置环境变量

[wzj@hadoop001 ~]$ vi .bashrc
配置以下环境变量

export HIVE_HOME=/home/wzj/app/hive
export PATH=$HIVE_HOME/bin:$PATH

[wzj@hadoop001 ~]$ source .bashrc

6.配置文件

${HIVE_HOME}/conf

[wzj@hadoop001 ~] $c d / h o m e / w z j / a p p / h i v e / c o n f [w z j @ h a d o o p 001 c o n f]$ ll
total 24
-rw-r–r--. 1 wzj wzj 1196 Jun 3 2019 beeline-log4j.properties.template
-rw-r–r--. 1 wzj wzj 2378 Jun 3 2019 hive-env.sh.template
-rw-r–r--. 1 wzj wzj 2662 Jun 3 2019 hive-exec-log4j.properties.template
-rw-r–r--. 1 wzj wzj 3505 Jun 3 2019 hive-log4j.properties.template
-rw-r–r--. 1 wzj wzj 2060 Jun 3 2019 ivysettings.xml
[wzj@hadoop001 conf]$ vi hive-site.xml

粘贴以下内容

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<configuration>
	<property>
	  <name>javax.jdo.option.ConnectionURL</name>
	  <value>jdbc:mysql://hadoop001:3306/data_hive?createDatabaseIfNotExist=true</value>
	</property>
	
	<property>
	  <name>javax.jdo.option.ConnectionDriverName</name>
	  <value>com.mysql.jdbc.Driver</value>
	</property>

	<property>
	  <name>javax.jdo.option.ConnectionUserName</name>
	  <value>root</value>
	</property>

	<property>
	  <name>javax.jdo.option.ConnectionPassword</name>
	  <value>passwd</value>
	</property>
	
	<property>
		<name>hive.cli.print.current.db</name>
		<value>true</value>
	</property>
##此参数代表启动hive命令行是否显示当前仓库	
	<property>
		<name>hive.cli.print.header</name>
		<value>true</value>
	</property>
##此参数代表输出数据时是否打印头部信息
</configuration>

7.上传依赖包

mysql-connector-java-5.1.27-bin.jar
${HIVE_HOME}/lib

8.启动

[wzj@hadoop001 ~]$ hive
which: no hbase in (/home/wzj/app/hive/bin:/home/wzj/app/hadoop/bin:/home/wzj/app/hadoop/sbin:/usr/java/jdk1.8.0_45/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/wzj/.local/bin:/home/wzj/bin)
19/12/16 13:38:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Logging initialized using configuration in jar:file:/home/wzj/app/hive-1.1.0-cdh5.16.2/lib/hive-common-1.1.0-cdh5.16.2.jar!/hive-log4j.properties
WARNING: Hive CLI is deprecated and migration to Beeline is recommended.
hive (default)> show databases;
OK
database_name
default
Time taken: 7.303 seconds, Fetched: 1 row(s)
hive (default)>