spark
mr_维
这个作者很懒,什么都没留下…
展开
专栏收录文章
- 默认排序
- 最新发布
- 最早发布
- 最多阅读
- 最少阅读
-
spark Parallel Computation log
1. build a method to simulate a algorithm run (Do not use the thread te)原创 2014-04-22 14:54:59 · 610 阅读 · 0 评论 -
spark scala code demo for def class etc.
a demo for code reference: import org.apache.spark.SparkContext import java.util.HashMap import org.apache.spark.rdd.RDD class NF(hv: ClassA) extends Serializable { var powerMap: HashMap[Stri原创 2014-05-09 17:16:27 · 469 阅读 · 0 评论 -
spark running script setting
1. build a sh(sparkrun.sh) scripts as follows; #!/usr/bin/env bash export SPARK_MEM=3g CP=$CLASSPATH:/opt/spark-0.9.0-incubating-bin-hadoop2/conf:/opt/spark-0.9.0-incubating-bin-hadoop2/assembly/targ原创 2014-04-25 16:17:25 · 716 阅读 · 0 评论 -
spark技术分析—sparkUI
1. SparkUI中Jetty服务开发(基本接口) public class ServletContextServer { public static void main(String[] args) throws Exception { //创建服务 Server server = new Server(8080);原创 2015-08-18 13:04:07 · 651 阅读 · 0 评论
分享