Spark读写Hive

最新推荐文章于 2025-06-27 17:48:45 发布

原创

最新推荐文章于 2025-06-27 17:48:45 发布 · 1.2k 阅读

5 ·

CC 4.0 BY-SA版权

文章标签：

#Spark #Hive

1. maven依赖添加spark-hive、mysql-connector-java

    <properties>
        <spark.version>2.3.3</spark.version>
        <mysql.version>8.0.15</mysql.version>
    </properties>

    <dependencies>
        <dependency>
            <groupId>org.apache.spark</groupId>
            <artifactId>spark-hive_2.11</artifactId>
            <version>${spark.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>mysql</groupId>
            <artifactId>mysql-connector-java</artifactId>
            <version>${mysql.version}</version>
        </dependency>
    </dependencies>

2. 将hive-site.xml文件放到resources文件夹下