在上一篇hbase搭建的基础上搭建hive集群
(https://editor.youkuaiyun.com/md/?articleId=106999922)
安装mysql数据库
请查看博主前面的mysql搭建过程:(https://editor.youkuaiyun.com/md/?articleId=106991232)
配置hive.env.sh(若名字不对应则mv改名)
切换到/opt/hive/conf目录下
vi hive.env.sh
HADOOP_HOME=/opt/hadoop //hadoop路径
export HIVE_CONF_DIR=/opt/hive/conf //hive的conf路径
export HIVE_AUX_JARS_PATH=/opt/hive/lib //hive的jar包路径
export JAVA_HOME=/opt/java8 //jdk安装路径
配置hive-site.xml(若不存在直接新建)
vi hive-site.xml
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/opt/hive/warehouse</value>
</property>
<property>
<name>hive.metastore.local</name>
<value>true</value>
</property>
<!-- 如果是远程mysql数据库的话需要在这里写入远程的IP或hosts -->
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://192.168.109.110:3306/hive_matadata?createDatabaseIfNotExist=true</value> //数据库所在主机的IP
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>ok</value>
</property>
</configuration>
将java连接数据库的jar包移入hive的lib目录下
mv /software/mysql-connector-java-5.1.0-bin.jar /opt/hive/lib/
按照hive-site.xml配置的warehouse目录创建warehouse文件夹
hadoop fs -mkdir -p /opt/hive/warehouse
给warehouse目录和hive目录赋权
hadoop fs -chmod 777 /opt/hive/warehouse
hadoop fs -chmod -R 777 /opt/hive/
初始化hive
schematool -dbType mysql -initSchema
启动hive
hive
Hadoop环境启动顺序
//hadoop
start-all.sh
//zookeeper
//bin目录下
./zkServer.sh start
//hbase
//bin目录下
./start-hbase.sh
//hive
hive
Hadoop环境关闭顺序
//hive
jps命令找到Runjar进程kill掉
//hbase
//bin目录下
./stop-hbase.sh
//zookeeper
//bin目录下
./zkServer.sh stop
//hadoop
stop-all.sh
至此,整个Hadoop环境就搭建完成了!