spark streaming导入的依赖为:
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-streaming-kafka-0-10_2.11</artifactId>
<version>${spark.version}</version>
</dependency>
而structed streaming导入的依赖不同:
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-sql-kafka-0-10_2.11</artifactId>
<version>${spark.version}</version>
</dependency>
导致的报错:
java.lang.ClassNotFoundException: Failed to find data source: kafka. Please find packages at http://spark.apache.org/third-party-projects.html
本文介绍了Spark Streaming与Structured Streaming在使用Kafka作为数据源时的不同依赖配置方法,并解释了因依赖配置错误而导致的ClassNotFoundException异常。
695

被折叠的 条评论
为什么被折叠?



