Windows笔记本上做大数据开发3: 配置环境3: Windows7下配置windows本地配置Hive

最新推荐文章于 2023-10-21 22:32:44 发布

原创最新推荐文章于 2023-10-21 22:32:44 发布 · 823 阅读

0 ·

CC 4.0 BY-SA版权

本文详细介绍Hive的安装步骤及配置过程，包括环境变量设置、MySQL连接配置、HDFS目录创建、初始化数据导入等关键环节。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

1.下载hive http://archive.apache.org/dist/hive/
我使用的是hadoop2.7.7，所以选择对应的版本hive2.3
2.设置环境变量HIVE_HOME和Path
3.下载mysql-connector-java-5.1.47
https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.47.zip
4.将解压出来的jar放入hive 的lib中
5.创建hive目录下\conf\hive-default.xml.template为hive-site.xml

<name>javax.jdo.option.ConnectionURL</name>

修改其value

<value>jdbc:mysql://localhost:3306/hive?characterEncoding=UTF8&amp;useSSL=false&amp;createDatabaseIfNotExist=true</value>
<property>
    <name>javax.jdo.option.ConnectionUserName</name>
    <value>root</value>
</property>
<property>
    <name>javax.jdo.option.ConnectionPassword</name>
    <value>123456</value>
</property>

6..新建文件夹 ${HIVE_HOME}/hive/logs,将含有"system:java.io.tmpdir"的配置项的值修改为$ {HIVE_HOME}/hive/logs

<property>
<name>hive.exec.local.scratchdir</name>
<value>${HIVE_HOME}/logs/HiveJobsLog</value>
<description>Local scratch space for Hive jobs</description>
</property>
<property>
<name>hive.downloaded.resources.dir</name>
<value>${HIVE_HOME}/logs/ResourcesLog</value>
<description>Temporary local directory for added resources in the remote file system.</description>
</property>
<property>
<name>hive.querylog.location</name>
<value>${HIVE_HOME}/logs/HiveRunLog</value>
<description>Location of Hive run time structured log file</description>
</property>
<property>
<name>hive.server2.logging.operation.log.location</name>
<value>${HIVE_HOME}/logs/OpertitionLog</value>
<description>Top level directory where operation logs are stored if logging functionality is enabled</description>
</property>

7.在hadoop上创建hdfs目录

hadoop fs -mkdir hdfs://localhost:9000/tmp
hadoop fs -mkdir hdfs://localhost:9000/user/hive/warehouse
hadoop fs -chmod g+w hdfs://localhost:9000/tmp
hadoop fs -chmod g+w hdfs://localhost:9000/user/hive/warehouse

hadoop fs -mkdir hdfs://localhost:9000/

8.mysql中创建hive数据库
create database hive;

9.命令行导入hive初始化数据

E:\home\hive\scripts\metastore\upgrade\mysql下的
hive-txn-schema-2.3.0.mysql.sql
hive-schema-2.3.0.mysql.sql

10.运行hive客户端输入hive命令。
（1）启动hadoop：start-all.cmd
（2）启动metastore服务：hive –service metastore
（3）启动Hive：hive
若Hive成功启动，Hive本地模式安装完成。

11、查看mysql数据库
use hive; show tables;

12.在hive下建一张表：CREATE TABLE xp(id INT,name string) ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘\t’;

13.在MySQL中查看：select * from table_name

安装MySQL的过程就不说了