sqoop查询oracle数据是什么权限,sqoop导入Oracle数据到HIVE总结

本文介绍如何利用Sqoop工具从Oracle数据库中导入数据到Hive表的过程及遇到的问题。具体步骤包括设置连接参数、执行导入命令、解决类型转换警告等,并最终完成数据迁移。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

[hadoop@domain bin]$ sqoop import -connect jdbc:oracle:thin:@192.168.1.2:1521:YONYOU -username SCOTT -password tiger --table EMP --hive-import -m 1

13/03/30 00:40:23 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.

13/03/30 00:40:23 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override

13/03/30 00:40:23 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.

13/03/30 00:40:23 INFO manager.SqlManager: Using default fetchSize of 1000

13/03/30 00:40:24 INFO tool.CodeGenTool: Beginning code generation

13/03/30 00:40:25 INFO manager.OracleManager: Time zone has been set to GMT

13/03/30 00:40:25 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM EMP t WHERE 1=0

13/03/30 00:40:25 INFO orm.CompilationManager: HADOOP_HOME is /home/hadoop/hadoop-0.20.2

13/03/30 00:40:28 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/57b0c91f97a25b025cfcf0729f316f39/EMP.jar

13/03/30 00:40:28 INFO manager.OracleManager: Time zone has been set to GMT

13/03/30 00:40:28 INFO manager.OracleManager: Time zone has been set to GMT

13/03/30 00:40:28 INFO mapreduce.ImportJobBase: Beginning import of EMP

13/03/30 00:40:28 INFO manager.OracleManager: Time zone has been set to GMT

13/03/30 00:40:32 INFO mapred.JobClient: Running job: job_201303292217_0004

13/03/30 00:40:33 INFO mapred.JobClient: map 0% reduce 0%

13/03/30 00:40:59 INFO mapred.JobClient: map 100% reduce 0%

13/03/30 00:41:02 INFO mapred.JobClient: Job complete: job_201303292217_0004

13/03/30 00:41:02 INFO mapred.JobClient: Counters: 16

13/03/30 00:41:02 INFO mapred.JobClient: Job Counters

13/03/30 00:41:02 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=27161

13/03/30 00:41:02 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0

13/03/30 00:41:02 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0

13/03/30 00:41:02 INFO mapred.JobClient: Launched map tasks=1

13/03/30 00:41:02 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0

13/03/30 00:41:02 INFO mapred.JobClient: FileSystemCounters

13/03/30 00:41:02 INFO mapred.JobClient: HDFS_BYTES_READ=87

13/03/30 00:41:02 INFO mapred.JobClient: FILE_BYTES_WRITTEN=65258

13/03/30 00:41:02 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=701

13/03/30 00:41:02 INFO mapred.JobClient: Map-Reduce Framework

13/03/30 00:41:02 INFO mapred.JobClient: Map input records=12

13/03/30 00:41:02 INFO mapred.JobClient: Physical memory (bytes) snapshot=80519168

13/03/30 00:41:02 INFO mapred.JobClient: Spilled Records=0

13/03/30 00:41:02 INFO mapred.JobClient: CPU time spent (ms)=2070

13/03/30 00:41:02 INFO mapred.JobClient: Total committed heap usage (bytes)=15794176

13/03/30 00:41:02 INFO mapred.JobClient: Virtual memory (bytes) snapshot=712142848

13/03/30 00:41:02 INFO mapred.JobClient: Map output records=12

13/03/30 00:41:02 INFO mapred.JobClient: SPLIT_RAW_BYTES=87

13/03/30 00:41:02 INFO mapreduce.ImportJobBase: Transferred 701 bytes in 33.7146 seconds (20.7922 bytes/sec)

13/03/30 00:41:02 INFO mapreduce.ImportJobBase: Retrieved 12 records.

13/03/30 00:41:02 INFO manager.OracleManager: Time zone has been set to GMT

13/03/30 00:41:02 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM EMP t WHERE 1=0

13/03/30 00:41:02 WARN hive.TableDefWriter: Column EMPNO had to be cast to a less precise type in Hive

13/03/30 00:41:02 WARN hive.TableDefWriter: Column MGR had to be cast to a less precise type in Hive

13/03/30 00:41:02 WARN hive.TableDefWriter: Column HIREDATE had to be cast to a less precise type in Hive

13/03/30 00:41:02 WARN hive.TableDefWriter: Column SAL had to be cast to a less precise type in Hive

13/03/30 00:41:02 WARN hive.TableDefWriter: Column COMM had to be cast to a less precise type in Hive

13/03/30 00:41:02 WARN hive.TableDefWriter: Column DEPTNO had to be cast to a less precise type in Hive

13/03/30 00:41:02 INFO hive.HiveImport: Removing temporary files from import process: hdfs://localhost:9000/user/hadoop/EMP/_logs

13/03/30 00:41:02 INFO hive.HiveImport: Loading uploaded data into Hive

13/03/30 00:41:08 INFO hive.HiveImport: Hive history file=/tmp/hadoop/hive_job_log_hadoop_201303300041_854717120.txt

13/03/30 00:41:19 INFO hive.HiveImport: OK

13/03/30 00:41:19 INFO hive.HiveImport: Time taken: 10.866 seconds

13/03/30 00:41:19 INFO hive.HiveImport: Loading data to table default.emp

13/03/30 00:41:20 INFO hive.HiveImport: OK

13/03/30 00:41:20 INFO hive.HiveImport: Time taken: 0.507 seconds

13/03/30 00:41:20 INFO hive.HiveImport: Hive import complete.

13/03/30 00:41:20 INFO hive.HiveImport: Export directory is empty, removing it.

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值