何瑞龙的专栏

1.f1.sbt package[error] import org.apache.spark.SparkContext_[error]        ^[error] one error found[error] (compile:compile) Compilation failed

1.Initial job has not accepted any resources； check your cluster UI to ensure that workers are registered and have sufficient memory

hdfs: Total time: 674 s, completed 2014-6-18 12:44:48local file system: 1067s

1.0 MLlib分类与回归分析线性支持向量机2.

1.数据序列化2.内存调优3.其它因素

SparkStreaming 提供一个处理Flume流的事件，

设置spark application 属性    val environmentV = Map[String, String]()     environmentV += ("spark.cores.max"->"1")     environmentV += ("spark.executor.memory"-> "2g")    val conf = new SparkConf

单机版下测试，对于小文档来说可以运行，一j

import org.apache.spark.SparkContextimport org.apache.spark.SparkContext._import org.apache.spark.SparkConfimport org.apache.spark.rdd._import scala.io.Sourceimport scala.collection.mutable.

下载了50篇文章cb

import org.apache.spark.SparkContextimport org.apache.spark.SparkContext._import org.apache.spark.rdd._import scala.util.parsing.json._import java.util.StringTokenizerimport scala.collection.mut

根据TDA里面的情感分析实现的基于spark的朴素贝叶斯分类器import org.apache.spark.SparkContextimport org.apache.spark.SparkContext._import org.apache.spark.rdd._import scala.util.parsing.json._import java.util.StringT

今天想了一下自己构想的项目