sqoop：File does not exist:

最新推荐文章于 2022-04-02 10:57:41 发布

原创

最新推荐文章于 2022-04-02 10:57:41 发布 · 1.6k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#sqoop #hive

当使用sqoop从mysql拉取数据遇到'File does not exist'错误，通常是由于首次拉取时使用了SnappyCodec压缩，而后续未使用相同压缩方式进行拉取导致。解决方法是删除已存在的表，使用相同的sqoop命令（包括压缩选项）重新导入数据。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

sqoop从mysql中拉表报错：

02-08-2019 10:47:28 CST bi_cal_resume_achieve_sqoop_import INFO - 19/08/02 10:47:28 INFO hive.metastore: Trying to connect to metastore with URI thrift://pf-bigdata1:9083
02-08-2019 10:47:28 CST bi_cal_resume_achieve_sqoop_import INFO - 19/08/02 10:47:28 INFO hive.metastore: Opened a connection to metastore, current connections: 1
02-08-2019 10:47:28 CST bi_cal_resume_achieve_sqoop_import INFO - 19/08/02 10:47:28 INFO hive.metastore: Connected to metastore.
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 19/08/02 10:47:29 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetIOException: Could not read schema
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - org.kitesdk.data.DatasetIOException: Could not read schema
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.kitesdk.data.spi.hive.HiveUtils.descriptorForTable(HiveUtils.java:152)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.kitesdk.data.spi.hive.HiveAbstractMetadataProvider.load(HiveAbstractMetadataProvider.java:104)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.kitesdk.data.spi.filesystem.FileSystemDatasetRepository.load(FileSystemDatasetRepository.java:197)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.kitesdk.data.Datasets.load(Datasets.java:108)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.kitesdk.data.Datasets.load(Datasets.java:165)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.kitesdk.data.Datasets.load(Datasets.java:187)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:123)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:130)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:267)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:513)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:621)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
02-08-2019 10:47:29 CST bi_cal_resume_achieve_sqoop_import INFO - 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
02-08-2019 10:47:29 CST bi_cal