何瑞龙的专栏

1.f 1.sbt package [error] import org.apache.spark.SparkContext_ [error]        ^ [error] one error found [error] (compile:compile) Compilation failed

1.Initial job has not accepted any resources； check your cluster UI to ensure that workers are registered and have sufficient memory

hdfs: Total time: 674 s, completed 2014-6-18 12:44:48 local file system: 1067s

1.0 MLlib 分类与回归分析 线性支持向量机 2.

1.数据序列化 2.内存调优 3.其它因素

SparkStreaming 提供一个处理Flume流的事件，

设置spark application 属性     val environmentV = Map[String, String]()     environmentV += ("spark.cores.max"->"1")     environmentV += ("spark.executor.memory"-> "2g")     val conf = new SparkConf

单机版下测试，对于小文档来说可以运行，一j

import org.apache.spark.SparkContext import org.apache.spark.SparkContext._ import org.apache.spark.SparkConf import org.apache.spark.rdd._ import scala.io.Source import scala.collection.mutable.

下载了50篇文章 cb

import org.apache.spark.SparkContext import org.apache.spark.SparkContext._ import org.apache.spark.rdd._ import scala.util.parsing.json._ import java.util.StringTokenizer import scala.collection.mut

根据TDA里面的情感分析实现的基于spark的朴素贝叶斯分类器 import org.apache.spark.SparkContext import org.apache.spark.SparkContext._ import org.apache.spark.rdd._ import scala.util.parsing.json._ import java.util.StringT

今天想了一下自己构想的项目