Java交互Scala因传参报错暂时没有解决的问题
一:代码截图

二:控制台日志
15:00:28.228 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction as:κÕñ (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.getCounters(Job.java:765)
15:00:28.237 [main] INFO org.apache.hadoop.mapreduce.Job - Counters: 33
File System Counters
FILE: Number of bytes read=59408
FILE: Number of bytes written=526952
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Map input records=1
Map output records=10
Map output bytes=3832
Map output materialized bytes=3878
Input split bytes=131
Combine input records=0
Combine output records=0
Reduce input groups=10
Reduce shuffle bytes=3878
Reduce input records=10
Reduce output records=10
Spilled Records=20
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=7
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
Total committed heap usage (bytes)=476053504
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=25623
File Output Format Counters
Bytes Written=3852
15:00:28.237 [main] DEBUG org.apache.hadoop.security.UserGroupInformation - PrivilegedAction as:κÕñ (auth:SIMPLE) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:323)
三:问题排查
问题原因:hadoop访问权限问题
解决方法:暂无

博客内容涉及Java与Scala交互时遇到的参数传递错误,以及在使用Hadoop过程中碰到的访问权限问题。日志显示了MapReduce作业的详细计数信息,但问题尚未解决。目前问题排查阶段,尚未找到解决权限问题的方法。
649

被折叠的 条评论
为什么被折叠?



