cc278463952的博客

1.在IDEA->Preference->plugins中搜索scala， 没有安装过的下载即可，下载后重新启动IDEA2.新建工程，选择scala-SBT，下一步，这里构建SBT会特别慢（有条件可以用VPN或者阿里镜像）JDK版本选择1.8，SBT版本选择0.13.8，Scala版本选择2.10.5，finish即可3.在新建工程页面，

1.打开终端，输入ssh-keygen -t rsa2.公钥和私钥就生成在.ssh目录下(显示隐藏文件)3.创建authorized_keys，输入touch authorized_keys4.把id_rsa.pub放到authorized_keys中，终端输入：cat id_rsa.pub > authorized_keys

JavaRDD rdd1 = jsc.parallelize(Arrays.asList("coffee", "coffee", "panda", "monkey", "tea"));JavaRDD rdd2 = jsc.parallelize(Arrays.asList("coffee", "monkey", "kitty"));//distinct 去重操作JavaRDD rdd_di

SparkConf conf = new SparkConf();JavaSparkContext jsc = new JavaSparkContext("local", "keyValueRDDTest", conf);List, Integer>> list = Arrays.asList( new Tuple2, Integer>(1, 2), new