storm-kafka spout获取数据的异常解决办法

最新推荐文章于 2019-12-17 20:31:26 发布

原创最新推荐文章于 2019-12-17 20:31:26 发布 · 6.8k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#spout

storm 同时被 2 个专栏收录

11 篇文章

订阅专栏

kafka

6 篇文章

订阅专栏

本博客详细解释了在使用Apache Storm时遇到的Kafka Spout配置错误，即多个主题不能共用一个Zookeeper根目录，并提供了解决方法。通过实例分析了错误日志并提出了修正建议。

20391 [Thread-8-kfkaSpout] WARN  storm.kafka.KafkaUtils - Got fetch request with offset out of range: [140885176]; retrying with default start offset time from configuration. configured start offset time: [-2] offset: [5532601]
21680 [Thread-8-kfkaSpout] WARN  storm.kafka.KafkaUtils - Got fetch request with offset out of range: [140889217]; retrying with default start offset time from configuration. configured start offset time: [-2] offset: [5532613]
22749 [Thread-8-kfkaSpout] WARN  storm.kafka.KafkaUtils - Got fetch request with offset out of range: [140890119]; retrying with default start offset time from configuration. configured start offset time: [-2] offset: [5532311]
23771 [Thread-8-kfkaSpout] WARN  storm.kafka.KafkaUtils - Got fetch request with offset out of range: [140884842]; retrying with default start offset time from configuration. configured start offset time: [-2] offset: [5532819]
24681 [Thread-8-kfkaSpout] WARN  storm.kafka.KafkaUtils - Got fetch request with offset out of range: [140772081]; retrying with default start offset time from configuration. configured start offset time: [-2] offset: [5532980]
25611 [Thread-8-kfkaSpout] WARN  storm.kafka.KafkaUtils - Got fetch request with offset out of range: [140885176]; retrying with default start offset

多个topic不能共用一个zookeeper根目录data

SpoutConfig spoutConfig = new SpoutConfig(zkHosts, topic, "/data","logProcess");