案例计算店铺的月销售额和累加到当前月的销售和--spark程序编写

最新推荐文章于 2023-10-14 21:33:19 发布

z小丑八怪r

最新推荐文章于 2023-10-14 21:33:19 发布

阅读量556

点赞数

本文链接：https://blog.youkuaiyun.com/weixin_46959672/article/details/112067843

版权

/**
 * 数据：
 * shop1,2019-01-18,500
 * shop1,2019-02-10,500
 * shop1,2019-02-10,200
 * shop1,2019-02-11,600
 * shop1,2019-02-12,400
 * shop1,2019-02-13,200
 * shop1,2019-02-15,100
 * shop2,2019-02-10,100
 * shop2,2019-02-11,100
 * shop2,2019-02-13,100
 * shop2,2019-03-15,100
 * shop2,2019-04-15,100
 *
 * 思路：先根据sid，月份聚合销售额
 *      再根据sid分组,日期排序，累加月销售额
 */
object RollUpMonthIncome {
   
  def main(args: Array[String]): Unit = {
   
    val sc = SparkUtils.createContext(true)
    val lines = sc.textFile("data/shop.txt")

    //根据sid，月份聚合
    val reduced: RDD[((String, String), Int