MR_comentropy的博客

/* * Licensed to the Apache Software Foundation (ASF) under one or more * contributor license agreements. See the NOTICE file distributed with * this work for additional information regarding copyright ownership. * The ASF licenses this file to You un

java + scala + maven + idea + spark 配置 1.java 安装 + JAVA_HOME + path里 %SCALA_HOME%\bin; 2.Scala 解压（无需安装）+ SCALA_HOME + path里 %SCALA_HOME%\bin 3.apache-maven-3.6.1 解压（无需安装）+ MAVEN_HOME + path里 %MAVEN_HOME%\bin 4.进入apache-maven-3.6.1\conf 下可以找到settings，查找<

pom.xml <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org

***# hdfs*** package geektime.connecter import org.apache.spark.sql.{SaveMode,SparkSession} object SparkHDFS { def main(args: Array[String]): Unit = { val spark = SparkSession.builder().master(master = "local").appName(name = "SparkDataFormat").getOr