利用sqoop将oracle 11g中的表迁移至hive表

最新推荐文章于 2021-11-10 10:09:23 发布

原创最新推荐文章于 2021-11-10 10:09:23 发布 · 4.9k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#hive #HIVE #Hive #oracle #Oracle #ORACLE #sqoop #Sqoop

本文详细介绍如何将Oracle 11g中的数据迁移到Hive表中，包括Oracle的安装配置、监听服务设置及使用Sqoop进行数据导入的过程。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

[Prerequisite]

hadoop, hive, sqoop installed

ojdbc6.jar was in directory /usr/lib/sqoop/lib (ojdbc6.jar is for JDK 1.6)

[Steps]

1. Install oracle 11g for 32bit on a windows 32bit vm (windows server 2003)

see <在Windows Server 2003 32bit 中安装Oracle 11g 32bit>: http://blog.youkuaiyun.com/mozart_cai/article/details/8596352

2. Configure local listener(本地监听服务) in oracle Net Manager, add a listener

see <通过Net Manager 配置Oracle 11g本地监听服务(listener service)>: http://blog.youkuaiyun.com/mozart_cai/article/details/8596504

3. Load Oracle table to Hive table via Sqoop

In Oracle SQL Plus, check all tables owned by current user

SQL> select unique tname from col;

We choose table "DEPT" to migrate.

In cluster node

$ hive

$ show tables;

$ quit;

$ sqoop import --connect jdbc:oracle:thin:@IPAddressOfNodeInstallOracle:1521:orcl --username SCOTT --password 123456 --table DEPT -m 1 --hive-import --hive-table "HIVETEST"

NOTICE: IPAddressOfNodeInstallOracle is for windows run oracle(ex: 172.16.3.4); username and password are configured in oracle;tablename and username should be upper case

$ show tables;

$ select * from hivetest;