大数据集群搭建(4)——Hive的安装

本文详细介绍了Hive的安装步骤,包括环境变量设置、Mysql安装、HDFS目录创建及权限修改、hive-site.xml配置及metastore初始化。通过本指南,读者可以了解Hive的完整安装流程。

Hive安装

1.在/usr目录下新建tools目录,上传并解压文件

cd /usr

mkdir tools

cd tools

rz(选中上传准备好的hive安装包)

tar –zxvf apache-hive-2.0.0-bin.tar.gz

2.添加环境变量:

vi /etc/profile

#Hive

export HIVE_HOME=/usr/tools/apache-hive-2.3.3-bin

export PATH=$PATH:$HIVE_HOME/bin

保存后使其生效:

source /etc/profile

3.安装Mysql

详见mysql安装文档

https://blog.youkuaiyun.com/Copper01/article/details/84068953

4.配置hive

4.1.在hdfs中新建目录/user/hive/warehouse

hdfs dfs –mkdir /tmp

hdfs dfs –mkdir /user

hdfs dfs –mkdir /user/hive

hdfs dfs –mkdir /user/hive/warehouse

 4.2.更改目录的权限

hadoop fs -chmod g+w /tmp

hadoop fs -chmod g+w /user/hive/warehouse

4.3.将mysql的驱动jar包拷入hive的lib目录下面

4.4.进入conf目录,复制hive-default.xml.template并命名为:hive-site.xml

cp hive-default.xml.template hive-site.xml

更改配置文件:(只需要更改标红的部分,其余为文件中本身拥有的)

<property>

    <name>javax.jdo.option.ConnectionURL</name>

    <value>jdbc:mysql://127.0.0.1:3306/hive?createDatabaseIfNotExist=true&amp;SSL=false</value>

    <description>JDBC connect string for a JDBC metastore</description>

  </property>

  <property>

    <name>javax.jdo.option.ConnectionDriverName</name>

    <value>com.mysql.jdbc.Driver</value>

    <description>Driver class name for a JDBC metastore</description>

  </property>

  <property>

    <name>javax.jdo.option.ConnectionUserName</name>

    <value>root</value>

    <description>Username to use against metastore database</description>

  </property>

  <property>

    <name>javax.jdo.option.ConnectionPassword</name>

    <value>123456</value>

    <description>password to use against metastore database</description>

  </property>

  <property>

    <name>hive.exec.local.scratchdir</name>

    <value>/usr/tools/apache-hive-2.0.0-bin/tmp</value>

    <description>Local scratch space for Hive jobs</description>

  </property>

  <property>

    <name>hive.downloaded.resources.dir</name>

    <value>/usr/tools/apache-hive-2.0.0-bin/tmp/resources</value>

    <description>Temporary local directory for added resources in the remote file system.</description>

  </property>

  <property>

    <name>hive.querylog.location</name>

    <value>/usr/tools/apache-hive-2.0.0-bin/tmp</value>

    <description>Location of Hive run time structured log file</description>

  </property>

  <property>

    <name>hive.server2.logging.operation.log.location</name>

    <value>/usr/tools/apache-hive-2.0.0-bin/tmp/operation_logs</value>

    <description>Top level directory where operation logs are stored if logging functionality is enabled</description>

  </property>

4.5.使用schematool 初始化metastore的schema:

schematool -initSchema -dbType mysql

5.运行hive

hive

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值