sparkstreaming消费kafka报错：Invalid url in bootstrap.servers

最新推荐文章于 2024-10-16 17:27:38 发布

xiaoge～

最新推荐文章于 2024-10-16 17:27:38 发布

阅读量8.6k

点赞数

分类专栏： spark 文章标签： spark 大数据 kafka

本文链接：https://blog.youkuaiyun.com/weixin_42535020/article/details/104904557

版权

在使用SparkStreaming消费Kafka数据时遇到'Invalid url in bootstrap.servers'错误，解决方案是在hosts文件中添加IP与主机名的映射，例如将172.24.110.110映射到Kafka服务器主机名。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

20/03/06 16:46:10 ERROR streaming.StreamingContext: Error starting the context, marking it as stopped
org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
        at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:702)
        at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:557)
        at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:540)
        at org.apache.spark.streaming.kafka010.Subscribe.onStart(ConsumerStrategy.scala:83)
        at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.consumer(DirectKafkaInputDStream.scala:75)
        at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.start(DirectKafkaInputDStream.scala:245)
        at org.apache.spark.streaming.DStreamGraph$$anonfun$start$5.apply(DStreamGraph.scala:49)
        at org.apache.spark.streaming.DStreamGraph$$anonfun$start$5.apply(DStreamGraph.scala:49)
        at s

最低0.47元/天解锁文章