[user@kafka.apache.org]Errors after reboot on single node setup

最新推荐文章于 2025-02-21 10:00:00 发布

翻译最新推荐文章于 2025-02-21 10:00:00 发布 · 934 阅读

文章标签：

#Kafka

翻译同时被 2 个专栏收录

37 篇文章

订阅专栏

Kafka

24 篇文章

订阅专栏

本文描述了一个Kafka用户在单节点设置中遇到的问题：重启后出现冲突错误。通过一系列步骤重现了该问题，并在Apache Jira上进行了报告。

这个是产生：

http://blog.youkuaiyun.com/wang_zhenwei/article/details/49681859 （[KAFKA-1724]Errors after reboot in single node setup）

的过程，

一个Kafka的使用者在使用过程中遇到问题：

原文地址：

http://comments.gmane.org/gmane.comp.apache.kafka.user/3902 （Errors after reboot on single node setup）

问：

Hi,

First of all, I am new to Kafka and more of a user than a developer. I will
try to clarify things as much as possible though.

我是一个Kafka的使用者，水平还打不到开发者的地步。我想尽量多弄明白一些事情。

We are using Kafka as a message system for our apps and works nicely in our
SaaS cluster.
I am trying to make the apps also work on a single node for demo purposes.
I set up Zookeeper, Kafka and our apps on a node and things were ok until
rebooting the node. After that I see the following messages in Kafka log:

我们使用Kafka作为一个消息系统，为我们SaaS集群中的应用和工作服务。刚开始，一切运行正常，直到我重启节点，发现Kafka中报了一下错误：

[2014-10-22 16:37:22,206] INFO [Controller 0]: Controller starting up
(kafka.controller.KafkaController)
[2014-10-22 16:37:22,419] INFO [Controller 0]: Controller startup complete
(kafka.controller.KafkaController)
[2014-10-22 16:37:22,554] INFO conflict in /brokers/ids/0 data:
{"jmx_port":-1,"timestamp":"1413995842465","host":"ip-10-91-142-54.eu-west-1.compute.internal","version":1,"port":9092}
stored data:
{"jmx_port":-1,"timestamp":"1413994171579","host":"ip-10-91-142-54.eu-west-1.compute.internal","version":1,"port":9092}
(kafka.utils.ZkUtils$)
[2014-10-22 16:37:22,736] INFO I wrote this conflicted ephemeral node
[{"jmx_port":-1,"timestamp":"1413995842465","host":"ip-10-91-142-54.eu-west-1.compute.internal","version":1,"port":9092}]
at /brokers/ids/0 a while back in a different session, hence I will backoff
for this node to be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
[2014-10-22 16:37:25,010] ERROR Error handling event ZkEvent[Data of
/controller changed sent to
kafka.server.ZookeeperLeaderElector$LeaderChangeListener <at> a6af882]
(org.I0Itec.zkclient.ZkEventThread)
java.lang.IllegalStateException: Kafka scheduler has not been started
        at

答：

Can you provide steps to reproduce this? I'm not sure I understand how you
run into this. It does look like a bug.

怎样产生这些问题的，我不确定你怎么做到的，它看起来像是个bug。

问：

This can reproduced with trunk.

start zookeeper
start kafka-broker
create topic or start a producer writing to a topic
stop zookeeper
stop kafka-broker( kafka broker shutdown goes into  WARN Session
0x14938d9dc010001 for server null, unexpected error, closing socket
connection and attempting reconn
ect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: Connection refused)
kill -9 kafka-broker
restart zookeeper and than kafka-broker leads into the the error posted
by Ciprian.

Ciprian,
      Can you open a jira for this.

Thanks,
Harsha

过程如下：

1. 启动Zookeeper

2. 创建一个kafka-broker

3. 创建一个topic和给这个topic写数据的producer

4. 停止Zookeeper

5. 停止kafka-broker（Kafka broker关闭，进入WARN Session 0x14938d9dc010001，报错，关闭socket连接，视图重新连接，

(org.apache.zookeeper.ClientCnxn) java.net.ConnectException: Connection refused）

6. kill -9 kafka-broker，使用kill命令关闭kafka-broker

7. 重启zookeeper，kafka-broker出现了以上的错误。

答：

Thank you for the *very* quick replies Neha, Harsha. I opened a Jira for
this issue:
https://issues.apache.org/jira/browse/KAFKA-1724

Ciprian
--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

非常感谢你的快速护肤，我在官网开了一个报错文章，用来跟踪这个错误。地址见上面。

附录：

一个讨论Kafka的论坛：

http://blog.gmane.org/gmane.comp.apache.kafka.user