Java
关注
分享
扫一扫
默默倾听全世界
这个作者很懒，什么都没留下…
展开
-
Java Spark算子：take 与 takeOrdered
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import java.util.Arrays;import java.util.List;/** * take（num）算子： ...原创 2020-02-26 14:09:15 · 576 阅读 · 0 评论 -
Java Spark算子：reduce
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.Function2;import java.util.A...原创 2020-02-26 13:56:49 · 802 阅读 · 0 评论 -
Java Spark算子：count 与 countByKey
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaSparkContext;import scala.Tuple2;import java.util.Arrays;import java.util.List...原创 2020-02-26 13:47:10 · 342 阅读 · 0 评论 -
Java Spark算子：coalesce
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import java.util.ArrayList;import java.util.Arrays;import java.util.L...原创 2020-02-26 13:33:35 · 309 阅读 · 0 评论 -
Java Spark算子：cartesian
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import java.util.Arrays;...原创 2020-02-26 11:27:28 · 227 阅读 · 0 评论 -
Java Spark算子：cogroup
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaSparkContext;import scala.Tuple2;import java.util.Arrays;import java.util.List...原创 2020-02-26 11:15:52 · 231 阅读 · 0 评论 -
Java Spark算子：join
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaSparkContext;import scala.Tuple2;import java.util.Arrays;import java.util.List...原创 2020-02-26 11:05:05 · 406 阅读 · 0 评论 -
Java Spark算子：sortByKey
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaSparkContext;import scala.Tuple2;import java.util.Arrays;import java.util.List...原创 2020-02-26 10:54:03 · 584 阅读 · 0 评论 -
Java Spark算子：reduceByKey
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.Function2;import scala.Tu...原创 2020-02-26 10:31:19 · 843 阅读 · 0 评论 -
Java Spark算子：groupByKey
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaSparkContext;import scala.Tuple2;import java.util.Arrays;import java.util.List...原创 2020-02-19 17:36:29 · 415 阅读 · 0 评论 -
Java Spark算子：distinct
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import java.util.Arrays;import java.util.List;/** * distinct（）算子 *...原创 2020-02-19 17:07:42 · 274 阅读 · 0 评论 -
Java Spark算子：intersection
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import java.util.Arrays;import java.util.List;/** * intersection算子：...原创 2020-02-19 15:13:34 · 175 阅读 · 0 评论 -
Java Spark算子：union
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import java.util.Arrays;import java.util.List;/** * union() 算子： * 取...原创 2020-02-19 14:47:30 · 401 阅读 · 0 评论 -
Java Spark算子：sample
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import java.util.Arrays;import java.util.List;/** * sample(withRepl...原创 2020-02-19 14:37:27 · 218 阅读 · 0 评论 -
Java Spark算子：mapPartitionsWithIndex
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.Function2;import java.util.A...原创 2020-02-19 14:09:14 · 664 阅读 · 0 评论 -
Jave Spark算子：mapPartitions
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.FlatMapFunction;import org.ap...原创 2020-02-19 11:45:51 · 591 阅读 · 0 评论 -
Java Spark算子： flatMap
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.FlatMapFunction;import java....原创 2020-02-19 10:34:56 · 1875 阅读 · 0 评论 -
Java Spark算子：filter
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.Function;import java.util.Ar...原创 2020-02-18 15:25:51 · 1407 阅读 · 0 评论 -
Java Spark算子：map
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.Function;import java.util.Ar...原创 2020-02-18 15:10:05 · 452 阅读 · 0 评论 -
Java Spark算子：union
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.VoidFunction;import java.util...原创 2020-02-18 14:34:10 · 303 阅读 · 0 评论 -
Java Spark算子：forEach
import org.apache.spark.SparkConf;import org.apache.spark.api.java.JavaRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.java.function.VoidFunction;import java.uti...原创 2020-02-18 14:24:04 · 883 阅读 · 0 评论 -
在window和linux下部署jar包
一. java执行jar的语句1. 最简单的执行语句语句：java -jar jar包名.jar例如：我要运行的jar包名是 love.jar，那么执行语句如下。java -jar like.jar2. 常用的参数-Xms：设置jar包启动时所占用的内存-Xmx：设置jar包运行时所占用的最大内存例如：我需要的启动内存为512m，最大运行内存为1024m，那么执行语句就变成了下面...原创 2020-01-22 09:41:00 · 1060 阅读 · 0 评论 -
POI-解析Excel
一. POI介绍1. 简介POI为“Poor Obfuscation Implementation”的首字母缩写。Apache POI是Apache软件基金会的开放源码函式库，POI提供API给Java程序对Microsoft Office格式档案读和写的功能。2. 结构HSSF － 提供读写Microsoft Excel XLS 格式档案的功能。XSSF － 提供读写Microsoft...原创 2020-01-20 16:05:31 · 351 阅读 · 0 评论