X的博客

使用sparkStreaming消费kafka消息scala消费端<dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.12</artifactId> <version>2.4.5</version> </dependency> <dependency>

mapreudce操作统计文件中单词出现次数将mapreduce程序打jar包，放到hadoop机器上执行hadoop jar xsf.jar mapreduce.Dirverx /123 /usr/local/server/hadoop-2.10.0/outmapreduce.Dirverx为driver类全限定类名/123： 为输入文件路径默认从hdfs上读取/usr/local/server/hadoop-2.10.0/out：为结果输出路径查看输出结果mapreduce流程ma