运行Hadoop mapreduce 实例:
bin/hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar wordcount /input /output
报出ERROR security.UserGroupInformation: PriviledgedActionException 这个异常。原因是input HDFS未创建
解决方法:
上传一个指定文件,比如hbase中的readme.txt文件。
hadoop dfs -put /opt/README.txt /input运行结果:
13/12/30 04:01:17 INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted /output
[app@hadoop-master hadoop]$ bin/hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar wordcount /input /output
13/12/30 04:01:28 INFO client.RMProxy: Connecting to ResourceManager at hadoop-master/192.168.177.172:8040
13/12/30 04:01:30 INFO input.FileInputFormat: Total input paths to process : 1
13/12/30 04:01:31 INFO mapreduce.JobSubmitter: number of splits:1
13/12/30 04:01:31 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
13/12/30 04:01:31 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
13/12/30 04:01:31 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
13/12/30 04:01:31 INFO Configuration.deprecation: mapreduce.combine.class is deprecated. Instead, use mapreduce.job.combine.class
13/12/30 04:01:31 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
13/12/30 04:01:31 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
13/12/30 04:01:31 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
13/12/30 04:01:31 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
13/12/30 04:01:31 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
13/12/30 04:01:31 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
13/12/30 04:01:31 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
13/12/30 04:01:31 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
13/12/30 04:01:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1388393094589_0001
13/12/30 04:01:32 INFO impl.YarnClientImpl: Submitted application application_1388393094589_0001 to ResourceManager at hadoop-master/192.168.177.172:8040
13/12/30 04:01:32 INFO mapreduce.Job: The url to track the job: http://hadoop-master:8088/proxy/application_1388393094589_0001/
本文详细介绍了在运行Hadoop MapReduce实例时遇到的ERRORsecurity.UserGroupInformation:PriviledgedActionException异常,并提供了上传指定文件至HDFS的解决方法。通过此教程,您将了解如何成功运行MapReduce任务并解决常见错误。
6163

被折叠的 条评论
为什么被折叠?



