Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path

最新推荐文章于 2022-06-01 14:41:11 发布

原创最新推荐文章于 2022-06-01 14:41:11 发布 · 6.3k 阅读

0 ·

CC 4.0 BY-SA版权

Hadoop 专栏收录该内容

85 篇文章

订阅专栏

本文记录了一次使用Hadoop进行MapReduce任务时遇到的问题及错误信息。主要问题为输入路径不存在导致任务失败，并包含了Hadoop运行过程中出现的各种警告信息，如无法加载原生Hadoop库、使用过时的配置项、未设置作业jar文件等。

WARN - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO - session.id is deprecated. Instead, use dfs.metrics.session-id
INFO - Initializing JVM Metrics with processName=JobTracker, sessionId=
WARN - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
WARN - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
INFO - Cleaning up the staging area file:/tmp/hadoop-Lenovo/mapred/staging/Lenovo1398828528/.staging/job_local1398828528_0001
Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/hadooptest/input 本地文件不存在
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:321)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:264)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:385)
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:302)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:319)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:197)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1297)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1294)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1294)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1315)
at hadoopWord.mapreduce.WordCountDriver.main(WordCountDriver.java:81)