点点滴滴

First lets see how parallelize splits your data between partitions:val x = sc.parallelize(List("12","23","345","4567"), 2)x.glom.collect// Array[Array[String]] = Array(Array(12, 23), Array(34...

https://github.com/mpeltonen/sbt-ideaaddSbtPlugin("com.typesafe.sbteclipse" % "sbteclipse-plugin" % "5.0.1")addSbtPlugin("com.github.mpeltonen" % "sbt-idea" % "1.6.0") 

参看附件 下载地址 http://scala-ide.org/download/current.html 

16/11/15 09:02:55 ERROR Shell: Failed to locate the winutils binary in the hadoop binary pathjava.io.IOException: Could not locate executable D:\hadoop-2.7.3\bin\winutils.exe in the Hadoop bina...

关联规则中相关定义在附件中有定义 

https://sparktutorials.github.io/2015/04/02/setting-up-a-spark-project-with-maven.html 

https://www.iteblog.com/archives/1508 

https://sparktutorials.github.io/2015/04/03/setting-up-spark-with-gradle.html 

https://sparktutorials.github.io/2015/04/02/setting-up-a-spark-project-with-maven.html 

http://blog.youkuaiyun.com/javastart/article/details/43372977http://www.tuicool.com/articles/JFfiiqf单机 调试 spark 如果不用sbt，需要下载1.6版本才有 spark-assembly-1.6.0-hadoop2.6.0.jar 相关类似的jar ...