[LintCode] First Position Unique Character

本文介绍了一种算法问题——寻找字符串中第一个不重复的字符及其索引,并提供了三种不同的解决方案。第一种使用哈希映射存储字符出现的所有位置;第二种优化内存使用,仅记录每个字符的出现次数;第三种针对ASCII字符集进一步减少内存使用。

Given a string, find the first non-repeating character in it and return it's index. If it doesn't exist, return -1.

Example

Given s = "lintcode", return 0.

Given s = "lovelintcode", return 2.

 

Solution 1. Two steps' iteration 

1. first time iterate through s and create a hash map that maps each unique character to the set of its appearance indices in s.

2. second time iterate through s and return the index of the first character whose apperance set size is 1. return -1 if no such character is found.

 1 public class Solution {
 2     public int firstUniqChar(String s) {
 3         if(s == null || s.length() == 0){
 4             return -1;
 5         }
 6         HashMap<Character, HashSet<Integer>> map = new HashMap<Character, HashSet<Integer>>();
 7         for(int i = 0; i < s.length(); i++){
 8             if(map.containsKey(s.charAt(i))){
 9                 map.get(s.charAt(i)).add(i);
10             }
11             else{
12                 HashSet<Integer> set = new HashSet<Integer>();
13                 set.add(i);
14                 map.put(s.charAt(i),set);
15             }
16         }
17         for(int i = 0; i < s.length(); i++){
18             if(map.get(s.charAt(i)).size() == 1){
19                 return i;
20             }
21         }
22         return -1;
23     }
24 }

 

Optimization on solution 1

Solution 1 already achieves the BCR since we have to iterate through s at least once. 

But we can still optimize on memory usage. In solution 1,  no matter what kind of input 

we get, we always use O(n) space because the hash map stores all characters' indices.

Instead of keeping an appearance index set for each unique character, we can simply keep

an integer that counts the appearance time of each unique character. Doing this saves 

memory usage on average cases. In the worst case that each character is unique, we still will

use O(n) memory.

 1 public class Solution {
 2     public int firstUniqChar(String s) {
 3         if(s == null || s.length() == 0){
 4             return -1;
 5         }
 6         HashMap<Character, Integer> map = new HashMap<Character, Integer>();
 7         for(int i = 0; i < s.length(); i++){
 8             if(map.containsKey(s.charAt(i))){
 9                 map.put(s.charAt(i), map.get(s.charAt(i)) + 1);
10             }
11             else{
12                 map.put(s.charAt(i),1);
13             }
14         }
15         for(int i = 0; i < s.length(); i++){
16             if(map.get(s.charAt(i)) == 1){
17                 return i;
18             }
19         }
20         return -1;
21     }
22 }

 

If we can make an assumption about the input string's character set is the ASCII set, then we can reduce 

memory usage to O(1).

 1 public class Solution {
 2     public int firstUniqChar(String s) {
 3         int[] alp = new int[256];
 4         char[] arr =s.toCharArray();
 5         for(char c : arr ){
 6             alp[c]++;
 7         }
 8         for(int i = 0; i < arr.length; i++){
 9             if (alp[arr[i]]==1) return i;
10         }
11         return -1;
12     }
13 }

 

 

转载于:https://www.cnblogs.com/lz87/p/7068006.html

源码地址: https://pan.quark.cn/s/d1f41682e390 miyoubiAuto 米游社每日米游币自动化Python脚本(务必使用Python3) 8更新:更换cookie的获取地址 注意:禁止在B站、贴吧、或各大论坛大肆传播! 作者已退游,项目不维护了。 如果有能力的可以pr修复。 小引一波 推荐关注几个非常可爱有趣的女孩! 欢迎B站搜索: @嘉然今天吃什么 @向晚大魔王 @乃琳Queen @贝拉kira 第三方库 食用方法 下载源码 在Global.py中设置米游社Cookie 运行myb.py 本地第一次运行时会自动生产一个文件储存cookie,请勿删除 当前仅支持单个账号! 获取Cookie方法 浏览器无痕模式打开 http://user.mihoyo.com/ ,登录账号 按,打开,找到并点击 按刷新页面,按下图复制 Cookie: How to get mys cookie 当触发时,可尝试按关闭,然后再次刷新页面,最后复制 Cookie。 也可以使用另一种方法: 复制代码 浏览器无痕模式打开 http://user.mihoyo.com/ ,登录账号 按,打开,找到并点击 控制台粘贴代码并运行,获得类似的输出信息 部分即为所需复制的 Cookie,点击确定复制 部署方法--腾讯云函数版(推荐! ) 下载项目源码和压缩包 进入项目文件夹打开命令行执行以下命令 xxxxxxx为通过上面方式或取得米游社cookie 一定要用双引号包裹!! 例如: png 复制返回内容(包括括号) 例如: QQ截图20210505031552.png 登录腾讯云函数官网 选择函数服务-新建-自定义创建 函数名称随意-地区随意-运行环境Python3....
root@hadoop01 ~]# cd /export/servers/apache-hive-3.1.3-bin [root@hadoop01 apache-hive-3.1.3-bin]# bin/schematool -initSchema -dbType mysql -verbose 2025-06-16 19:07:53,311 INFO conf.HiveConf: Found configuration file file:/export/servers/apache-hive-3.1.3-bin/conf/hive-site.xml 2025-06-16 19:07:54,059 INFO tools.HiveSchemaHelper: Metastore connection URL: jdbc:mysql://hadoop01:3306/hive?createDatabaseIfNotExist=true&useSSL=false Metastore connection URL: jdbc:mysql://hadoop01:3306/hive?createDatabaseIfNotExist=true&useSSL=false 2025-06-16 19:07:54,059 INFO tools.HiveSchemaHelper: Metastore Connection Driver : com.mysql.jdbc.Driver Metastore Connection Driver : com.mysql.jdbc.Driver 2025-06-16 19:07:54,059 INFO tools.HiveSchemaHelper: Metastore connection User: root Metastore connection User: root Starting metastore schema initialization to 3.1.0 Initialization script hive-schema-3.1.0.mysql.sql Connecting to jdbc:mysql://hadoop01:3306/hive?createDatabaseIfNotExist=true&useSSL=false Connected to: MySQL (version 5.7.44) Driver: MySQL Connector Java (version mysql-connector-java-5.1.32 ( Revision: jess.balint@oracle.com-20140716155848-mlwabor66widht1n )) Transaction isolation: TRANSACTION_READ_COMMITTED 0: jdbc:mysql://hadoop01:3306/hive> !autocommit on Autocommit status: true 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */ No rows affected (0.016 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @OLD_CHARACTER_SET_RESULTS=@@CHARACTER_SET_RESULTS */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @OLD_COLLATION_CONNECTION=@@COLLATION_CONNECTION */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET NAMES utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40103 SET @OLD_TIME_ZONE=@@TIME_ZONE */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40103 SET TIME_ZONE='+00:00' */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40014 SET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0 */ No rows affected (0.008 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40014 SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @OLD_SQL_MODE=@@SQL_MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40111 SET @OLD_SQL_NOTES=@@SQL_NOTES, SQL_NOTES=0 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `BUCKETING_COLS` ( `SD_ID` bigint(20) NOT NULL, `BUCKET_COL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `BUCKETING_COLS_N49` (`SD_ID`), CONSTRAINT `BUCKETING_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `CDS` ( `CD_ID` bigint(20) NOT NULL, PRIMARY KEY (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `COLUMNS_V2` ( `CD_ID` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TYPE_NAME` MEDIUMTEXT DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`CD_ID`,`COLUMN_NAME`), KEY `COLUMNS_V2_N49` (`CD_ID`), CONSTRAINT `COLUMNS_V2_FK1` FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `DATABASE_PARAMS` ( `DB_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(180) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_ID`,`PARAM_KEY`), KEY `DATABASE_PARAMS_N49` (`DB_ID`), CONSTRAINT `DATABASE_PARAMS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE `CTLGS` ( `CTLG_ID` BIGINT PRIMARY KEY, `NAME` VARCHAR(256), `DESC` VARCHAR(4000), `LOCATION_URI` VARCHAR(4000) NOT NULL, UNIQUE KEY `UNIQUE_CATALOG` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.014 seconds) 0: jdbc:mysql://hadoop01:3306/hive> INSERT INTO `CTLGS` VALUES (1, 'hive', 'Default catalog for Hive', 'TBD') 1 row affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `DBS` ( `DB_ID` bigint(20) NOT NULL, `DESC` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_LOCATION_URI` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CTLG_NAME` varchar(256) NOT NULL DEFAULT 'hive', PRIMARY KEY (`DB_ID`), UNIQUE KEY `UNIQUE_DATABASE` (`NAME`, `CTLG_NAME`), CONSTRAINT `CTLG_FK1` FOREIGN KEY (`CTLG_NAME`) REFERENCES `CTLGS` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.009 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `DB_PRIVS` ( `DB_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(20) DEFAULT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_GRANT_ID`), UNIQUE KEY `DBPRIVILEGEINDEX` (`AUTHORIZER`,`DB_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`DB_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `DB_PRIVS_N49` (`DB_ID`), CONSTRAINT `DB_PRIVS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.03 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `GLOBAL_PRIVS` ( `USER_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `USER_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`USER_GRANT_ID`), UNIQUE KEY `GLOBALPRIVILEGEINDEX` (`AUTHORIZER`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`USER_PRIV`,`GRANTOR`,`GRANTOR_TYPE`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `IDXS` ( `INDEX_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DEFERRED_REBUILD` bit(1) NOT NULL, `INDEX_HANDLER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INDEX_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INDEX_TBL_ID` bigint(20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `ORIG_TBL_ID` bigint(20) DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`INDEX_ID`), UNIQUE KEY `UNIQUEINDEX` (`INDEX_NAME`,`ORIG_TBL_ID`), KEY `IDXS_N51` (`SD_ID`), KEY `IDXS_N50` (`INDEX_TBL_ID`), KEY `IDXS_N49` (`ORIG_TBL_ID`), CONSTRAINT `IDXS_FK1` FOREIGN KEY (`ORIG_TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `IDXS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `IDXS_FK3` FOREIGN KEY (`INDEX_TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.026 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `INDEX_PARAMS` ( `INDEX_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`INDEX_ID`,`PARAM_KEY`), KEY `INDEX_PARAMS_N49` (`INDEX_ID`), CONSTRAINT `INDEX_PARAMS_FK1` FOREIGN KEY (`INDEX_ID`) REFERENCES `IDXS` (`INDEX_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.021 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `NUCLEUS_TABLES` ( `CLASS_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TYPE` varchar(4) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `OWNER` varchar(2) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `VERSION` varchar(20) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTERFACE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`CLASS_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.023 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITIONS` ( `PART_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `PART_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`PART_ID`), UNIQUE KEY `UNIQUEPARTITION` (`PART_NAME`,`TBL_ID`), KEY `PARTITIONS_N49` (`TBL_ID`), KEY `PARTITIONS_N50` (`SD_ID`), CONSTRAINT `PARTITIONS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `PARTITIONS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.022 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITION_EVENTS` ( `PART_NAME_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `EVENT_TIME` bigint(20) NOT NULL, `EVENT_TYPE` int(11) NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_NAME_ID`), KEY `PARTITIONEVENTINDEX` (`PARTITION_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.015 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITION_KEYS` ( `TBL_ID` bigint(20) NOT NULL, `PKEY_COMMENT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PKEY_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PKEY_TYPE` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`TBL_ID`,`PKEY_NAME`), KEY `PARTITION_KEYS_N49` (`TBL_ID`), CONSTRAINT `PARTITION_KEYS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITION_KEY_VALS` ( `PART_ID` bigint(20) NOT NULL, `PART_KEY_VAL` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`PART_ID`,`INTEGER_IDX`), KEY `PARTITION_KEY_VALS_N49` (`PART_ID`), CONSTRAINT `PARTITION_KEY_VALS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.014 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITION_PARAMS` ( `PART_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_ID`,`PARAM_KEY`), KEY `PARTITION_PARAMS_N49` (`PART_ID`), CONSTRAINT `PARTITION_PARAMS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.016 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.009 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `PART_COL_PRIVS` ( `PART_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_COLUMN_GRANT_ID`), KEY `PART_COL_PRIVS_N49` (`PART_ID`), KEY `PARTITIONCOLUMNPRIVILEGEINDEX` (`AUTHORIZER`,`PART_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`PART_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `PART_COL_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.024 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `PART_PRIVS` ( `PART_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_GRANT_ID`), KEY `PARTPRIVILEGEINDEX` (`AUTHORIZER`,`PART_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`PART_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `PART_PRIVS_N49` (`PART_ID`), CONSTRAINT `PART_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.019 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `ROLES` ( `ROLE_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`ROLE_ID`), UNIQUE KEY `ROLEENTITYINDEX` (`ROLE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `ROLE_MAP` ( `ROLE_GRANT_ID` bigint(20) NOT NULL, `ADD_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`ROLE_GRANT_ID`), UNIQUE KEY `USERROLEMAPINDEX` (`PRINCIPAL_NAME`,`ROLE_ID`,`GRANTOR`,`GRANTOR_TYPE`), KEY `ROLE_MAP_N49` (`ROLE_ID`), CONSTRAINT `ROLE_MAP_FK1` FOREIGN KEY (`ROLE_ID`) REFERENCES `ROLES` (`ROLE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SDS` ( `SD_ID` bigint(20) NOT NULL, `CD_ID` bigint(20) DEFAULT NULL, `INPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `IS_COMPRESSED` bit(1) NOT NULL, `IS_STOREDASSUBDIRECTORIES` bit(1) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `NUM_BUCKETS` int(11) NOT NULL, `OUTPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERDE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`SD_ID`), KEY `SDS_N49` (`SERDE_ID`), KEY `SDS_N50` (`CD_ID`), CONSTRAINT `SDS_FK1` FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), CONSTRAINT `SDS_FK2` FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.006 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.008 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SD_PARAMS` ( `SD_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`PARAM_KEY`), KEY `SD_PARAMS_N49` (`SD_ID`), CONSTRAINT `SD_PARAMS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.006 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.009 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.006 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SEQUENCE_TABLE` ( `SEQUENCE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `NEXT_VAL` bigint(20) NOT NULL, PRIMARY KEY (`SEQUENCE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> INSERT INTO `SEQUENCE_TABLE` (`SEQUENCE_NAME`, `NEXT_VAL`) VALUES ('org.apache.hadoop.hive.metastore.model.MNotificationLog', 1) 1 row affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SERDES` ( `SERDE_ID` bigint(20) NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SLIB` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DESCRIPTION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERIALIZER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DESERIALIZER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERDE_TYPE` integer, PRIMARY KEY (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SERDE_PARAMS` ( `SERDE_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SERDE_ID`,`PARAM_KEY`), KEY `SERDE_PARAMS_N49` (`SERDE_ID`), CONSTRAINT `SERDE_PARAMS_FK1` FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_COL_NAMES` ( `SD_ID` bigint(20) NOT NULL, `SKEWED_COL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SKEWED_COL_NAMES_N49` (`SD_ID`), CONSTRAINT `SKEWED_COL_NAMES_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.008 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_COL_VALUE_LOC_MAP` ( `SD_ID` bigint(20) NOT NULL, `STRING_LIST_ID_KID` bigint(20) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N49` (`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N50` (`SD_ID`), CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK2` FOREIGN KEY (`STRING_LIST_ID_KID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_STRING_LIST` ( `STRING_LIST_ID` bigint(20) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_STRING_LIST_VALUES` ( `STRING_LIST_ID` bigint(20) NOT NULL, `STRING_LIST_VALUE` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`,`INTEGER_IDX`), KEY `SKEWED_STRING_LIST_VALUES_N49` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_STRING_LIST_VALUES_FK1` FOREIGN KEY (`STRING_LIST_ID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_VALUES` ( `SD_ID_OID` bigint(20) NOT NULL, `STRING_LIST_ID_EID` bigint(20) NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID_OID`,`INTEGER_IDX`), KEY `SKEWED_VALUES_N50` (`SD_ID_OID`), KEY `SKEWED_VALUES_N49` (`STRING_LIST_ID_EID`), CONSTRAINT `SKEWED_VALUES_FK2` FOREIGN KEY (`STRING_LIST_ID_EID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_VALUES_FK1` FOREIGN KEY (`SD_ID_OID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `SORT_COLS` ( `SD_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ORDER` int(11) NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SORT_COLS_N49` (`SD_ID`), CONSTRAINT `SORT_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `TABLE_PARAMS` ( `TBL_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_ID`,`PARAM_KEY`), KEY `TABLE_PARAMS_N49` (`TBL_ID`), CONSTRAINT `TABLE_PARAMS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `MV_CREATION_METADATA` ( `MV_CREATION_METADATA_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TXN_LIST` TEXT DEFAULT NULL, `MATERIALIZATION_TIME` bigint(20) NOT NULL, PRIMARY KEY (`MV_CREATION_METADATA_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.015 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX MV_UNIQUE_TABLE ON MV_CREATION_METADATA (TBL_NAME, DB_NAME) USING BTREE No rows affected (0.014 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `TBLS` ( `TBL_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `OWNER` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `RETENTION` int(11) NOT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `VIEW_EXPANDED_TEXT` mediumtext, `VIEW_ORIGINAL_TEXT` mediumtext, `IS_REWRITE_ENABLED` bit(1) NOT NULL DEFAULT 0, PRIMARY KEY (`TBL_ID`), UNIQUE KEY `UNIQUETABLE` (`TBL_NAME`,`DB_ID`), KEY `TBLS_N50` (`SD_ID`), KEY `TBLS_N49` (`DB_ID`), CONSTRAINT `TBLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `TBLS_FK2` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.004 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `MV_TABLES_USED` ( `MV_CREATION_METADATA_ID` bigint(20) NOT NULL, `TBL_ID` bigint(20) NOT NULL, CONSTRAINT `MV_TABLES_USED_FK1` FOREIGN KEY (`MV_CREATION_METADATA_ID`) REFERENCES `MV_CREATION_METADATA` (`MV_CREATION_METADATA_ID`), CONSTRAINT `MV_TABLES_USED_FK2` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.027 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.021 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `TBL_COL_PRIVS` ( `TBL_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_COLUMN_GRANT_ID`), KEY `TABLECOLUMNPRIVILEGEINDEX` (`AUTHORIZER`,`TBL_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `TBL_COL_PRIVS_N49` (`TBL_ID`), CONSTRAINT `TBL_COL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.031 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `TBL_PRIVS` ( `TBL_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_GRANT_ID`), KEY `TBL_PRIVS_N49` (`TBL_ID`), KEY `TABLEPRIVILEGEINDEX` (`AUTHORIZER`,`TBL_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `TBL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `TAB_COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TBL_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20), `BIT_VECTOR` blob, `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID`), CONSTRAINT `TAB_COL_STATS_FK` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX TAB_COL_STATS_IDX ON TAB_COL_STATS (CAT_NAME, DB_NAME, TABLE_NAME, COLUMN_NAME) USING BTREE No rows affected (0.018 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `PART_COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PART_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20), `BIT_VECTOR` blob, `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID`), CONSTRAINT `PART_COL_STATS_FK` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.015 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX PCS_STATS_IDX ON PART_COL_STATS (CAT_NAME, DB_NAME,TABLE_NAME,COLUMN_NAME,PARTITION_NAME) USING BTREE No rows affected (0.02 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.007 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `TYPES` ( `TYPES_ID` bigint(20) NOT NULL, `TYPE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TYPE1` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TYPE2` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TYPES_ID`), UNIQUE KEY `UNIQUE_TYPE` (`TYPE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.013 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET @saved_cs_client = @@character_set_client */ No rows affected (0.001 seconds) 0: jdbc:mysql://hadoop01:3306/hive> /*!40101 SET character_set_client = utf8 */ No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `TYPE_FIELDS` ( `TYPE_NAME` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `FIELD_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `FIELD_TYPE` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`TYPE_NAME`,`FIELD_NAME`), KEY `TYPE_FIELDS_N49` (`TYPE_NAME`), CONSTRAINT `TYPE_FIELDS_FK1` FOREIGN KEY (`TYPE_NAME`) REFERENCES `TYPES` (`TYPES_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.025 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `MASTER_KEYS` ( `KEY_ID` INTEGER NOT NULL AUTO_INCREMENT, `MASTER_KEY` VARCHAR(767) BINARY NULL, PRIMARY KEY (`KEY_ID`) ) ENGINE=INNODB DEFAULT CHARSET=latin1 No rows affected (0.02 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `DELEGATION_TOKENS` ( `TOKEN_IDENT` VARCHAR(767) BINARY NOT NULL, `TOKEN` VARCHAR(767) BINARY NULL, PRIMARY KEY (`TOKEN_IDENT`) ) ENGINE=INNODB DEFAULT CHARSET=latin1 No rows affected (0.016 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `VERSION` ( `VER_ID` BIGINT NOT NULL, `SCHEMA_VERSION` VARCHAR(127) NOT NULL, `VERSION_COMMENT` VARCHAR(255), PRIMARY KEY (`VER_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.017 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `FUNCS` ( `FUNC_ID` BIGINT(20) NOT NULL, `CLASS_NAME` VARCHAR(4000) CHARACTER SET latin1 COLLATE latin1_bin, `CREATE_TIME` INT(11) NOT NULL, `DB_ID` BIGINT(20), `FUNC_NAME` VARCHAR(128) CHARACTER SET latin1 COLLATE latin1_bin, `FUNC_TYPE` INT(11) NOT NULL, `OWNER_NAME` VARCHAR(128) CHARACTER SET latin1 COLLATE latin1_bin, `OWNER_TYPE` VARCHAR(10) CHARACTER SET latin1 COLLATE latin1_bin, PRIMARY KEY (`FUNC_ID`), UNIQUE KEY `UNIQUEFUNCTION` (`FUNC_NAME`, `DB_ID`), KEY `FUNCS_N49` (`DB_ID`), CONSTRAINT `FUNCS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `FUNC_RU` ( `FUNC_ID` BIGINT(20) NOT NULL, `RESOURCE_TYPE` INT(11) NOT NULL, `RESOURCE_URI` VARCHAR(4000) CHARACTER SET latin1 COLLATE latin1_bin, `INTEGER_IDX` INT(11) NOT NULL, PRIMARY KEY (`FUNC_ID`, `INTEGER_IDX`), CONSTRAINT `FUNC_RU_FK1` FOREIGN KEY (`FUNC_ID`) REFERENCES `FUNCS` (`FUNC_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.01 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `NOTIFICATION_LOG` ( `NL_ID` BIGINT(20) NOT NULL, `EVENT_ID` BIGINT(20) NOT NULL, `EVENT_TIME` INT(11) NOT NULL, `EVENT_TYPE` varchar(32) NOT NULL, `CAT_NAME` varchar(256), `DB_NAME` varchar(128), `TBL_NAME` varchar(256), `MESSAGE` longtext, `MESSAGE_FORMAT` varchar(16), PRIMARY KEY (`NL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `NOTIFICATION_SEQUENCE` ( `NNI_ID` BIGINT(20) NOT NULL, `NEXT_EVENT_ID` BIGINT(20) NOT NULL, PRIMARY KEY (`NNI_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.003 seconds) 0: jdbc:mysql://hadoop01:3306/hive> INSERT INTO `NOTIFICATION_SEQUENCE` (`NNI_ID`, `NEXT_EVENT_ID`) SELECT * from (select 1 as `NNI_ID`, 1 as `NOTIFICATION_SEQUENCE`) a WHERE (SELECT COUNT(*) FROM `NOTIFICATION_SEQUENCE`) = 0 1 row affected (0.011 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `KEY_CONSTRAINTS` ( `CHILD_CD_ID` BIGINT, `CHILD_INTEGER_IDX` INT(11), `CHILD_TBL_ID` BIGINT, `PARENT_CD_ID` BIGINT, `PARENT_INTEGER_IDX` INT(11) NOT NULL, `PARENT_TBL_ID` BIGINT NOT NULL, `POSITION` BIGINT NOT NULL, `CONSTRAINT_NAME` VARCHAR(400) NOT NULL, `CONSTRAINT_TYPE` SMALLINT(6) NOT NULL, `UPDATE_RULE` SMALLINT(6), `DELETE_RULE` SMALLINT(6), `ENABLE_VALIDATE_RELY` SMALLINT(6) NOT NULL, `DEFAULT_VALUE` VARCHAR(400), PRIMARY KEY (`CONSTRAINT_NAME`, `POSITION`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.002 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX `CONSTRAINTS_PARENT_TABLE_ID_INDEX` ON KEY_CONSTRAINTS (`PARENT_TBL_ID`) USING BTREE No rows affected (0.021 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX `CONSTRAINTS_CONSTRAINT_TYPE_INDEX` ON KEY_CONSTRAINTS (`CONSTRAINT_TYPE`) USING BTREE No rows affected (0.021 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS `METASTORE_DB_PROPERTIES` ( `PROPERTY_KEY` varchar(255) NOT NULL, `PROPERTY_VALUE` varchar(1000) NOT NULL, `DESCRIPTION` varchar(1000), PRIMARY KEY(`PROPERTY_KEY`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.02 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS WM_RESOURCEPLAN ( `RP_ID` bigint(20) NOT NULL, `NAME` varchar(128) NOT NULL, `QUERY_PARALLELISM` int(11), `STATUS` varchar(20) NOT NULL, `DEFAULT_POOL_ID` bigint(20), PRIMARY KEY (`RP_ID`), UNIQUE KEY `UNIQUE_WM_RESOURCEPLAN` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.033 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS WM_POOL ( `POOL_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `PATH` varchar(767) NOT NULL, `ALLOC_FRACTION` DOUBLE, `QUERY_PARALLELISM` int(11), `SCHEDULING_POLICY` varchar(767), PRIMARY KEY (`POOL_ID`), UNIQUE KEY `UNIQUE_WM_POOL` (`RP_ID`, `PATH`), CONSTRAINT `WM_POOL_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.021 seconds) 0: jdbc:mysql://hadoop01:3306/hive> ALTER TABLE `WM_RESOURCEPLAN` ADD CONSTRAINT `WM_RESOURCEPLAN_FK1` FOREIGN KEY (`DEFAULT_POOL_ID`) REFERENCES `WM_POOL`(`POOL_ID`) No rows affected (0.017 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS WM_TRIGGER ( `TRIGGER_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `NAME` varchar(128) NOT NULL, `TRIGGER_EXPRESSION` varchar(1024), `ACTION_EXPRESSION` varchar(1024), `IS_IN_UNMANAGED` bit(1) NOT NULL DEFAULT 0, PRIMARY KEY (`TRIGGER_ID`), UNIQUE KEY `UNIQUE_WM_TRIGGER` (`RP_ID`, `NAME`), CONSTRAINT `WM_TRIGGER_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.016 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS WM_POOL_TO_TRIGGER ( `POOL_ID` bigint(20) NOT NULL, `TRIGGER_ID` bigint(20) NOT NULL, PRIMARY KEY (`POOL_ID`, `TRIGGER_ID`), CONSTRAINT `WM_POOL_TO_TRIGGER_FK1` FOREIGN KEY (`POOL_ID`) REFERENCES `WM_POOL` (`POOL_ID`), CONSTRAINT `WM_POOL_TO_TRIGGER_FK2` FOREIGN KEY (`TRIGGER_ID`) REFERENCES `WM_TRIGGER` (`TRIGGER_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.025 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE IF NOT EXISTS WM_MAPPING ( `MAPPING_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `ENTITY_TYPE` varchar(128) NOT NULL, `ENTITY_NAME` varchar(128) NOT NULL, `POOL_ID` bigint(20), `ORDERING` int, PRIMARY KEY (`MAPPING_ID`), UNIQUE KEY `UNIQUE_WM_MAPPING` (`RP_ID`, `ENTITY_TYPE`, `ENTITY_NAME`), CONSTRAINT `WM_MAPPING_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`), CONSTRAINT `WM_MAPPING_FK2` FOREIGN KEY (`POOL_ID`) REFERENCES `WM_POOL` (`POOL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.026 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE TXNS ( TXN_ID bigint PRIMARY KEY, TXN_STATE char(1) NOT NULL, TXN_STARTED bigint NOT NULL, TXN_LAST_HEARTBEAT bigint NOT NULL, TXN_USER varchar(128) NOT NULL, TXN_HOST varchar(128) NOT NULL, TXN_AGENT_INFO varchar(128), TXN_META_INFO varchar(128), TXN_HEARTBEAT_COUNT int, TXN_TYPE int ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.015 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE TXN_COMPONENTS ( TC_TXNID bigint NOT NULL, TC_DATABASE varchar(128) NOT NULL, TC_TABLE varchar(128), TC_PARTITION varchar(767), TC_OPERATION_TYPE char(1) NOT NULL, TC_WRITEID bigint, FOREIGN KEY (TC_TXNID) REFERENCES TXNS (TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.032 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX TC_TXNID_INDEX ON TXN_COMPONENTS (TC_TXNID) No rows affected (0.023 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE COMPLETED_TXN_COMPONENTS ( CTC_TXNID bigint NOT NULL, CTC_DATABASE varchar(128) NOT NULL, CTC_TABLE varchar(256), CTC_PARTITION varchar(767), CTC_TIMESTAMP timestamp DEFAULT CURRENT_TIMESTAMP NOT NULL, CTC_WRITEID bigint, CTC_UPDATE_DELETE char(1) NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.021 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX COMPLETED_TXN_COMPONENTS_IDX ON COMPLETED_TXN_COMPONENTS (CTC_DATABASE, CTC_TABLE, CTC_PARTITION) USING BTREE No rows affected (0.019 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE NEXT_TXN_ID ( NTXN_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.026 seconds) 0: jdbc:mysql://hadoop01:3306/hive> INSERT INTO NEXT_TXN_ID VALUES(1) 1 row affected (0.009 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE HIVE_LOCKS ( HL_LOCK_EXT_ID bigint NOT NULL, HL_LOCK_INT_ID bigint NOT NULL, HL_TXNID bigint NOT NULL, HL_DB varchar(128) NOT NULL, HL_TABLE varchar(128), HL_PARTITION varchar(767), HL_LOCK_STATE char(1) not null, HL_LOCK_TYPE char(1) not null, HL_LAST_HEARTBEAT bigint NOT NULL, HL_ACQUIRED_AT bigint, HL_USER varchar(128) NOT NULL, HL_HOST varchar(128) NOT NULL, HL_HEARTBEAT_COUNT int, HL_AGENT_INFO varchar(128), HL_BLOCKEDBY_EXT_ID bigint, HL_BLOCKEDBY_INT_ID bigint, PRIMARY KEY(HL_LOCK_EXT_ID, HL_LOCK_INT_ID), KEY HIVE_LOCK_TXNID_INDEX (HL_TXNID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.028 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX HL_TXNID_IDX ON HIVE_LOCKS (HL_TXNID) No rows affected (0.016 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE NEXT_LOCK_ID ( NL_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.017 seconds) 0: jdbc:mysql://hadoop01:3306/hive> INSERT INTO NEXT_LOCK_ID VALUES(1) 1 row affected (0.006 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE COMPACTION_QUEUE ( CQ_ID bigint PRIMARY KEY, CQ_DATABASE varchar(128) NOT NULL, CQ_TABLE varchar(128) NOT NULL, CQ_PARTITION varchar(767), CQ_STATE char(1) NOT NULL, CQ_TYPE char(1) NOT NULL, CQ_TBLPROPERTIES varchar(2048), CQ_WORKER_ID varchar(128), CQ_START bigint, CQ_RUN_AS varchar(128), CQ_HIGHEST_WRITE_ID bigint, CQ_META_INFO varbinary(2048), CQ_HADOOP_JOB_ID varchar(32) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.013 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE COMPLETED_COMPACTIONS ( CC_ID bigint PRIMARY KEY, CC_DATABASE varchar(128) NOT NULL, CC_TABLE varchar(128) NOT NULL, CC_PARTITION varchar(767), CC_STATE char(1) NOT NULL, CC_TYPE char(1) NOT NULL, CC_TBLPROPERTIES varchar(2048), CC_WORKER_ID varchar(128), CC_START bigint, CC_END bigint, CC_RUN_AS varchar(128), CC_HIGHEST_WRITE_ID bigint, CC_META_INFO varbinary(2048), CC_HADOOP_JOB_ID varchar(32) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.01 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE NEXT_COMPACTION_QUEUE_ID ( NCQ_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.007 seconds) 0: jdbc:mysql://hadoop01:3306/hive> INSERT INTO NEXT_COMPACTION_QUEUE_ID VALUES(1) 1 row affected (0.005 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE AUX_TABLE ( MT_KEY1 varchar(128) NOT NULL, MT_KEY2 bigint NOT NULL, MT_COMMENT varchar(255), PRIMARY KEY(MT_KEY1, MT_KEY2) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.011 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE WRITE_SET ( WS_DATABASE varchar(128) NOT NULL, WS_TABLE varchar(128) NOT NULL, WS_PARTITION varchar(767), WS_TXNID bigint NOT NULL, WS_COMMIT_ID bigint NOT NULL, WS_OPERATION_TYPE char(1) NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.01 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE TXN_TO_WRITE_ID ( T2W_TXNID bigint NOT NULL, T2W_DATABASE varchar(128) NOT NULL, T2W_TABLE varchar(256) NOT NULL, T2W_WRITEID bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.019 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE UNIQUE INDEX TBL_TO_TXN_ID_IDX ON TXN_TO_WRITE_ID (T2W_DATABASE, T2W_TABLE, T2W_TXNID) No rows affected (0.046 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE UNIQUE INDEX TBL_TO_WRITE_ID_IDX ON TXN_TO_WRITE_ID (T2W_DATABASE, T2W_TABLE, T2W_WRITEID) No rows affected (0.022 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE NEXT_WRITE_ID ( NWI_DATABASE varchar(128) NOT NULL, NWI_TABLE varchar(256) NOT NULL, NWI_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.022 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE UNIQUE INDEX NEXT_WRITE_ID_IDX ON NEXT_WRITE_ID (NWI_DATABASE, NWI_TABLE) No rows affected (0.033 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE MIN_HISTORY_LEVEL ( MHL_TXNID bigint NOT NULL, MHL_MIN_OPEN_TXNID bigint NOT NULL, PRIMARY KEY(MHL_TXNID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.014 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE INDEX MIN_HISTORY_LEVEL_IDX ON MIN_HISTORY_LEVEL (MHL_MIN_OPEN_TXNID) No rows affected (0.013 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE MATERIALIZATION_REBUILD_LOCKS ( MRL_TXN_ID bigint NOT NULL, MRL_DB_NAME VARCHAR(128) NOT NULL, MRL_TBL_NAME VARCHAR(256) NOT NULL, MRL_LAST_HEARTBEAT bigint NOT NULL, PRIMARY KEY(MRL_TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.012 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE `I_SCHEMA` ( `SCHEMA_ID` BIGINT PRIMARY KEY, `SCHEMA_TYPE` INTEGER NOT NULL, `NAME` VARCHAR(256), `DB_ID` BIGINT, `COMPATIBILITY` INTEGER NOT NULL, `VALIDATION_LEVEL` INTEGER NOT NULL, `CAN_EVOLVE` bit(1) NOT NULL, `SCHEMA_GROUP` VARCHAR(256), `DESCRIPTION` VARCHAR(4000), FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`), KEY `UNIQUE_NAME` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.018 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE `SCHEMA_VERSION` ( `SCHEMA_VERSION_ID` bigint primary key, `SCHEMA_ID` BIGINT, `VERSION` INTEGER NOT NULL, `CREATED_AT` BIGINT NOT NULL, `CD_ID` BIGINT, `STATE` INTEGER NOT NULL, `DESCRIPTION` VARCHAR(4000), `SCHEMA_TEXT` mediumtext, `FINGERPRINT` VARCHAR(256), `SCHEMA_VERSION_NAME` VARCHAR(256), `SERDE_ID` bigint, FOREIGN KEY (`SCHEMA_ID`) REFERENCES `I_SCHEMA` (`SCHEMA_ID`), FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`), FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), KEY `UNIQUE_VERSION` (`SCHEMA_ID`, `VERSION`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.024 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE REPL_TXN_MAP ( RTM_REPL_POLICY varchar(256) NOT NULL, RTM_SRC_TXN_ID bigint NOT NULL, RTM_TARGET_TXN_ID bigint NOT NULL, PRIMARY KEY (RTM_REPL_POLICY, RTM_SRC_TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 No rows affected (0.023 seconds) 0: jdbc:mysql://hadoop01:3306/hive> CREATE TABLE RUNTIME_STATS ( RS_ID bigint primary key, CREATE_TIME bigint NOT NULL, WEIGHT bigint NOT NULL, PAYLOAD blob ) ENGINE=InnoDB DEFAULT CHARSET=latin1 Error: Table 'RUNTIME_STATS' already exists (state=42S01,code=1050) Closing: 0: jdbc:mysql://hadoop01:3306/hive?createDatabaseIfNotExist=true&useSSL=false org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !! Underlying cause: java.io.IOException : Schema script failed, errorcode 2 org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !! at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:594) at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:567) at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1517) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:328) at org.apache.hadoop.util.RunJar.main(RunJar.java:241) Caused by: java.io.IOException: Schema script failed, errorcode 2 at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:1226) at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:1204) at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:590) ... 8 more *** schemaTool failed ***
06-18
<think>我们正在解决Hivemetastore初始化失败的问题,特别是由于RUNTIME_STATS表已经存在导致的错误。根据用户的问题,之前已经尝试删除CTLGS和VERSION表,现在出现RUNTIME_STATS表已存在的错误。解决方案思路:1.确认问题:在初始化Hive元数据时,因为RUNTIME_STATS表已经存在而导致初始化失败。2.解决方法:手动删除冲突的表(这里指RUNTIME_STATS表)以及其他可能冲突的表(如果有必要),然后重新初始化。但是,我们需要注意的是,直接删除表可能会带来风险,特别是如果这些表中已经存储了重要的元数据信息(例如,在已经运行过的环境中)。然而,在初始化阶段,我们通常是在搭建新环境或者重建元数据,所以删除这些表是安全的。具体步骤:步骤1:登录到MySQLmetastore数据库```bashmysql-uroot-p```步骤2:切换到metastore数据库(通常为hive)```sqlUSEhive;```步骤3:删除已存在的RUNTIME_STATS表(以及可能冲突的其他表,但根据问题,主要是RUNTIME_STATS)```sqlDROPTABLEIFEXISTSRUNTIME_STATS;```步骤4:为了确保没有其他冲突,我们可以考虑删除所有Hive元数据表,然后重新初始化。但通常我们只需要删除冲突的表。如果问题仍然存在,可能需要删除所有表或者重建数据库。步骤5:重新运行初始化命令```bashschematool-initSchema-dbTypemysql-verbose```然而,根据Hive的版本,可能还有其他表需要处理。在Hive3.1.0中,RUNTIME_STATS表是用于存储运行时统计信息的。在初始化之前,如果这个表已经存在,那么可能是因为之前初始化失败或者重复初始化导致的。另外,引用[3]中提到Metastore是Hive的元数据存储服务,存储表结构等信息。因此,我们在操作metastore数据库时需要非常小心。注意事项:-确保Hive服务已经停止,避免在操作过程中有新的元数据写入。-备份:在删除任何表之前,建议备份整个metastore数据库,以防万一。可以使用mysqldump命令:```bashmysqldump-uroot-phive>hive_metastore_backup.sql```如果问题仍然存在,可能需要检查Hive的版本与元数据库结构的兼容性。引用[3]中提到,Hive的元数据表结构会随着版本升级而变化。因此,确保我们使用的schematool版本与要安装的Hive版本一致。另外,引用[5]中提到了HiveonSpark的配置,虽然与当前问题不直接相关,但提醒我们Hive的配置和调优可能会影响元数据的使用。因此,我们还可以考虑另一种方法:完全重建metastore数据库(如果这是一个新环境或者可以完全清除元数据的话):```sqlDROPDATABASEIFEXISTShive;CREATEDATABASEhiveCHARACTERSETlatin1COLLATElatin1_bin;```然后重新初始化。总结步骤:方法一:仅删除冲突表1.停止Hive服务2.备份metastore数据库3.登录MySQL,删除RUNTIME_STATS表4.重新运行schematool初始化方法二:重建整个metastore数据库(更彻底)1.停止Hive服务2.备份metastore数据库(可选,但强烈建议)3.删除整个hive数据库4.重新创建hive数据库(注意字符集和排序规则)5.重新初始化根据用户的问题,我们主要采用方法一,因为问题明确是RUNTIME_STATS表已存在。但是,为了确保彻底解决问题,我们也可以考虑删除所有Hive元数据表,但要注意:如果metastore中还有其他表存在,说明之前初始化过,那么删除所有表可能会导致需要重新创建所有元数据(即相当于全新的初始化)。因此,在删除之前必须确保没有重要的元数据,或者已经备份。然而,在初始化阶段,我们通常希望创建一个全新的元数据存储,所以删除所有表是可以接受的。但是,Hive的schematool在初始化时会创建一整套表,所以如果我们只删除冲突的表(RUNTIME_STATS),那么初始化程序会创建缺失的表,而已经存在的表则不会重新创建。这样可能导致表结构不一致(如果之前初始化失败,表结构可能不完整)。因此,更安全的方式是删除整个数据库然后重新创建。鉴于用户之前已经删除了CTLGS和VERSION表,现在又出现RUNTIME_STATS表的问题,可能还有其他表存在。因此,建议采用方法二(重建数据库)来彻底解决。具体操作:1.停止所有Hive服务(包括HiveServer2、Metastore服务等)。2.备份现有的metastore数据库(以防万一):```bashmysqldump-uroot-p--databaseshive>hive_metastore_backup_$(date+%Y%m%d).sql```3.登录MySQL,删除metastore数据库并重新创建:```sqlDROPDATABASEIFEXISTShive;CREATEDATABASEhiveCHARACTERSETlatin1COLLATElatin1_bin;```4.使用schematool重新初始化元数据库:```bashschematool-initSchema-dbTypemysql-verbose```5.启动Hive服务。这样,所有表都会重新创建,不会存在表冲突的问题。注意:如果用户使用的是多用户环境或者生产环境,请确保在维护窗口操作,并且确保没有正在运行的Hive作业。如果用户不想重建整个数据库,而只想删除冲突的表,那么可以按照以下步骤:1.停止Hive服务。2.备份数据库。3.登录MySQL,删除以下表(这些表在初始化时创建,如果存在则可能导致冲突):```sql--删除可能冲突的表(包括RUNTIME_STATS)DROPTABLEIFEXISTSRUNTIME_STATS;--同时,因为之前删除过CTLGS和VERSION,我们也要确保它们不存在(如果之前删除过,这里再删一次也无妨)DROPTABLEIFEXISTSCTLGS;DROPTABLEIFEXISTSVERSION;--此外,还可以考虑删除其他可能冲突的表,但通常不需要。如果初始化仍然失败,再根据错误信息删除相应的表。```4.重新运行schematool。但是,由于我们无法预知是否还有其他表存在冲突,所以重建数据库是最稳妥的方法。因此,我建议采用重建数据库的方法。最后,生成相关问题。</think>### 解决Hive Metastore初始化失败:表'RUNTIME_STATS'已存在(错误码1050) #### 问题分析 当初始化Hive Metastore时遇到"表RUNTIME_STATS已存在"错误,表明: 1. MySQL metastore数据库中残留了历史元数据表 2. **RUNTIME_STATS表**是Hive用于存储查询运行时统计信息的核心表[^3] 3. 根本原因:重复执行`schematoo -initSchema`或未完全清理旧环境 #### 解决方案:安全删除冲突表 ##### 步骤1:停止Hive服务 ```bash # 停止所有Hive相关服务 pkill -f HiveMetaStore pkill -f HiveServer2 ``` ##### 步骤2:登录MySQL Metastore数据库 ```bash mysql -u hiveuser -p # 使用hive-site.xml中配置的用户 ``` ```sql USE metastore; -- 切换到metastore数据库 ``` ##### 步骤3:删除冲突表并验证 ```sql -- 删除核心冲突表 DROP TABLE IF EXISTS RUNTIME_STATS; DROP TABLE IF EXISTS CTLGS; -- 可能同时存在 DROP TABLE IF EXISTS VERSION; -- 可能同时存在 -- 验证删除结果 SHOW TABLES LIKE 'RUNTIME_STATS'; -- 应返回空 SHOW TABLES LIKE 'CTLGS'; -- 应返回空 SHOW TABLES LIKE 'VERSION'; -- 应返回空 ``` ##### 步骤4:重建Metastore(可选) 如果问题仍然存在,完全重建数据库: ```sql CREATE DATABASE metastore_new CHARACTER SET latin1 COLLATE latin1_bin; USE metastore_new; ``` ##### 步骤5:重新初始化Schema ```bash # 使用更新后的数据库配置 schematool -initSchema \ -dbType mysql \ -dbUserName hiveuser \ -dbPassword yourpassword \ -dbUrl "jdbc:mysql://localhost/metastore_new?createDatabaseIfNotExist=true" ``` ##### 步骤6:验证初始化结果 ```sql -- 检查关键表状态 SELECT * FROM VERSION; -- 应显示当前Hive版本 DESCRIBE RUNTIME_STATS; -- 应显示完整表结构 ``` #### 关键注意事项 1. **权限要求**: ```sql GRANT DROP, CREATE ON metastore.* TO 'hiveuser'@'%'; -- 确保用户有权限 ``` 2. **字符集验证**: ```sql SHOW CREATE DATABASE metastore; -- 必须为CHARACTER SET latin1 COLLATE latin1_bin[^3] ``` 3. **驱动兼容性**: ```bash # 检查Hive lib目录 ls $HIVE_HOME/lib | grep mysql-connector # 不兼容会导致初始化失败 ``` 4. **备份策略**: ```bash mysqldump -u root -p metastore > metastore_backup_$(date +%F).sql ``` #### 预防措施 1. 在`hive-site.xml`中启用自动清理: ```xml <property> <name>hive.metastore.schema.verification</name> <value>true</value> <!-- 阻止元数据不一致 --> </property> ``` 2. 使用版本控制脚本: ```bash # 初始化前检查表是否存在 if mysql -e "USE metastore; SHOW TABLES LIKE 'RUNTIME_STATS'" | grep -q . then echo "WARNING: Existing tables detected! Run cleanup script first." exit 1 fi ``` > **重要提示**:生产环境操作前务必备份数据库!执行`mysqldump -u root -p metastore > metastore_backup.sql`
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值