7、hive安装
|
1、hive环境变量配置 2、MySQL驱动包放入到lib中 3、hadoop用户 .bash_profile配置环境变量,如果配置/etc/profile,hadoop用户将不能使用 Hive-site.xml文件
注意MySQL远程登录的权限
<property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://monitor:3306/hive?createDatabaseIfNotExist=true&characterEncoding=UTF-8</value> <description>JDBC connect string for a JDBC metastore</description> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> <description>Driver class name for a JDBC metastore</description> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>root</value> <description>username to use against metastore database</description> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>hadoop</value> <description>password to use against metastore database</description> </property>
开启hive客户端 开启hive server setsid ./hive --service hiveserver 50031 & (后台启动) netstat -anp|grep 50031(监听是否启动)
|
|
关联hbase:
<property> <name>hbase.zookeeper.quorum</name> <value>zookeeper1,zookeeper2,zookeeper3</value> <description></description>
hbase-client-0.96.1.1-cdh5.0.1.jar hbase-common-0.96.1.1-cdh5.0.1.jar hbase-hadoop-compat-0.96.1.1-cdh5.0.1.jar hbase-protocol-0.96.1.1-cdh5.0.1.jar hbase-server-0.96.1.1-cdh5.0.1.jar htrace-core-2.01.jar
CREATE EXTERNAL TABLE member(key string,name string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,address:province") TBLPROPERTIES("hbase.table.name" = "member");
|
|
Error:
1、error com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes
ALTER TABLE COLUMNS_V2 MODIFY COLUMN COMMENT VARCHAR(256) CHARACTER SET utf8; ALTER TABLE DATABASE_PARAMS MODIFY COLUMN PARAM_VALUE VARCHAR(4000) CHARACTER SET utf8; ALTER DATABASE hive CHARACTER SET latin1;
|
本文详细介绍Hive的安装步骤及环境配置,包括环境变量设置、MySQL驱动包配置、.bash_profile配置等,并介绍了如何配置Hive-site.xml文件实现与MySQL的连接。此外,还涉及了Hive客户端和服务的启动方式以及Hive与HBase的关联配置。

被折叠的 条评论
为什么被折叠?



