huangle63的专栏

import java.sql.DriverManager /** * Created by root on 16-11-2. */ object OnlineWordcount { def main(args: Array[String]): Unit = { val conn = DriverManager.getConnection( "jdbc:mysq

import org.apache.spark.{SparkConf, SparkContext} /** * Created by huangle63 on 2016/9/22. */ object WrodCount { def main(args: Array[String]): Unit = { val conf = new SparkConf() conf.setAp

Spark 三次排序

1. VMware搭建Ubuntu16.04 spark集群 VMware 安装Ubuntu16.04 Ubuntu 启用root用户登陆 安装 VMware tools 安装jdk1.8,配置环境变量 安装ssh 虚拟机设置固定ip 设置/etc/hostname 本系统的名字（如：Master，Worker1）；设置/etc/hosts 主从机的ip对应 ssh无密码验证配置