Sqoop2: import and export data By Hue

最新推荐文章于 2025-12-29 09:40:14 发布

原创最新推荐文章于 2025-12-29 09:40:14 发布 · 149 阅读

CC 4.0 BY-SA版权

文章标签：

10 篇文章

订阅专栏

本文详细对比了sqoop1与sqoop2在数据导入导出、安全性、数据库连接、数据转移等方面的功能差异。

Import data from mysql to hdfs

----------------------------------------

Export data from hdfs to mysql

--------------------------------------

----------------------------------------------------

The difference between sqoop1 and sqoop2

Feature	Sqoop	Sqoop2
Connectors for all major RDBMS	Supported.	Not supported. Workaround: Use the generic JDBC Connector which has been tested on the following databases: Microsoft SQL Server, PostgreSQL, MySQL and Oracle. This connector should work on any other JDBC compliant database. However, performance might not be comparable to that of specialized connectors in Sqoop.
Kerberos Security Integration	Supported.	Not supported.
Encryption of Stored Passwords	Not supported. No workaround.	Supported using Derby's on-disk encryption. Disclaimer: Although expected to work in the current version of Sqoop2, this configuration has not been verified.
Data transfer from RDBMS to Hive or HBase	Supported.	Not supported. Workaround: Follow this two-step approach. Import data from RDBMS into HDFS (either as a text or sequence file) Export to Hive or HBase using Sqoop2
Data transfer from Hive or HBase to RDBMS	Not supported. Workaround: Follow this two-step approach. Import data from Hive or HBase into HDFS (either as a text or sequence file) Export to RDBMS using Sqoop2	Not supported. Follow the same workaround as for Sqoop.