Kafka 使用汇总

最新推荐文章于 2025-01-19 08:00:00 发布
原创 最新推荐文章于 2025-01-19 08:00:00 发布 · 335 阅读 · 0 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。

简介

Zookeeper搭建

bin/zkServer.sh start

启动Kafaka 拒绝链接

问题

[2020-02-19 14:58:13,666] INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-02-19 14:58:13,672] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: 拒绝连接
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[2020-02-19 14:58:14,778] INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-02-19 14:58:14,779] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: 拒绝连接
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[2020-02-19 14:58:15,879] INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-02-19 14:58:15,880] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: 拒绝连接
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[2020-02-19 14:58:16,981] INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-02-19 14:58:16,982] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: 拒绝连接
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[2020-02-19 14:58:18,083] INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-02-19 14:58:18,084] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: 拒绝连接
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[2020-02-19 14:58:19,185] INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-02-19 14:58:19,186] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: 拒绝连接
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[2020-02-19 14:58:19,672] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING
	at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply$mcV$sp(ZooKeeperClient.scala:225)
	at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:221)
	at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:221)
	at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:250)
	at kafka.zookeeper.ZooKeeperClient.kafka$zookeeper$ZooKeeperClient$$waitUntilConnected(ZooKeeperClient.scala:221)
	at kafka.zookeeper.ZooKeeperClient.<init>(ZooKeeperClient.scala:95)
	at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1547)
	at kafka.server.KafkaServer.kafka$server$KafkaServer$$createZkClient$1(KafkaServer.scala:348)
	at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:372)
	at kafka.server.KafkaServer.startup(KafkaServer.scala:202)
	at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
	at kafka.Kafka$.main(Kafka.scala:75)
	at kafka.Kafka.main(Kafka.scala)
[2020-02-19 14:58:19,673] INFO shutting down (kafka.server.KafkaServer)
[2020-02-19 14:58:19,676] WARN  (kafka.utils.CoreUtils$)
java.lang.NullPointerException
	at kafka.server.KafkaServer$$anonfun$shutdown$5.apply$mcV$sp(KafkaServer.scala:572)
	at kafka.utils.CoreUtils$.swallow(CoreUtils.scala:85)
	at kafka.server.KafkaServer.shutdown(KafkaServer.scala:572)
	at kafka.server.KafkaServer.startup(KafkaServer.scala:329)
	at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
	at kafka.Kafka$.main(Kafka.scala:75)
	at kafka.Kafka.main(Kafka.scala)
[2020-02-19 14:58:19,680] INFO shut down completed (kafka.server.KafkaServer)
[2020-02-19 14:58:19,680] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
[2020-02-19 14:58:19,682] INFO shutting down (kafka.server.KafkaServer)

尝试：

资料

监控

Kafka报错连接超时:Timed out waiting for connection while in state: CONNECTING
weixin_48960305的博客
03-24 1万+
报错连接zookeeper超时 swhua@swhua:~/Desktop/kafka_2.13-2.7.0$ bin/kafka-topics.sh --create --zookeeper localhost:9092 --replication-factor 1 --partitions 1 --topic matchresult --config cleanup.policy=compact [2021-05-09 16:56:39,279] WARN Client session timed o
java创建kafka的topic
旋风的技术
03-03 7219
kafka 0.10及其以下版本创建topic 这个版本创建topic必须使用zookeeper，一般可以使用如下命令手动创建topic： bin/kafka-topics.sh --create --zookeeper 127.0.0.1:2181 --replication-factor 3 --partitions 3 --topic test 那如何使用代码自动创建topic呢，可以使用AdminZkClient，示例如下： KafkaZkClient zkClient = KafkaZkClie
Kafka Client API 基本使用
ZHBR_F1的博客
06-19 3963
之前讲过了Kafka基本概念及原理，这次我们来看看Kafka Client的API。要使用Kafka Client的API，首先需要先部署Kafka集群，部署过程请参见官网。然后在项目中添加Kafka Client的依赖，在这里我们使用0.10.0.1版本：<dependency> <groupId>org.apache.kafka</groupId> <artifactId>kaf
Apache Kafka（三）- Kakfa CLI 使用
ZacksTang的博客
08-11 750
1. Topics CLI 1.1 首先启动 zookeeper 与 kafka > zookeeper-server-start.sh config/zookeeper.properties … INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFact...
kafka源码分析--- zk注册
wjandy0211的博客
04-23 1146
kafka启动第一步是生成zkclient，然后连接zk服务器，创建通用节点及注册brokerinfo相关操作! 我们就先从zookeeper相关操作类开始！ kafka操作zookeeper得主要类如下图： ZookeeperClient：流水线请求的ZooKeeper客户端。 KafkaZkClient: 基于ZookeeperClient构建的特定于kafka操作的客户端！ ...
获取Kafka Topic列表报ZK连接错误
cainiao1412的博客
10-09 933
详细错误如下，解决方法也很简单.... ZK的端口压根不是9092，默认是2181，之所以写成9092是因为之前直接拷贝的命令，9092用于bootstrap-server获取consumer信息使用的。
精选资源
Kafka知识汇总 18道
04-20
为了保证数据一致性，Kafka使用了一种叫做ISR（In-Sync Replica）的机制，ISR是领导者维护的一个列表，包含与领导者基本保持同步的副本。 默认情况下，Kafka的副本数量为3，这意味着每个分区有3个副本，以防止单点...
Kafka知识汇总 18道1
08-03
Kafka 使用 ZooKeeper 作为协调服务，当 Kafka 服务器（Broker）启动时，会在 ZooKeeper 上注册自身信息。ZooKeeper 负责管理集群中的元数据，如控制器（Controller）的选举，以及维护 Partition 的领导者和副本状态...
Kafka知识汇总 18道.pdf
04-08
Kafka 的生产者（Producer）使用 push 模式将消息发送到 Broker，而消费者（Consumer）则根据自己的需求从 Broker 拉取消息。消费者被组织成消费组（Consumer Group），每个 Partition 只能被同一消费组中的一个消费...
java1.8+kafka2.13版本汇总
12-02
Java，作为一种广泛使用的编程语言，以其跨平台、面向对象和安全性等特性而闻名，而Kafka则作为一个分布式流处理平台，被大量用于构建实时数据管道和流应用程序。本文档将针对Java1.8版本与Kafka2.13版本进行汇总...
kafka汇总.xmind
08-26
使用过程中，整理的kafka，安装，基本命令，topic调整，kafka的实战介绍，特点总结，希望对大家有用，和大家一起分享
【Kafka】关于Kafka启动时报错的解决过程
热门推荐
cnskylee的博客
03-17 1万+
版本信息： kafka_2.12-3.1.0、apache-zookeeper-3.8.0 报错信息： [2022-03-16 05:30:57,192] WARN An exception was thrown while closing send thread for session 0x100007216820000. (org.apache.zookeeper.ClientCnxn) EndOfStreamException: Unable to read additional data f
kafka入门踩坑 连接超时问题
cai_ji_1997的博客
05-04 8554
Timed out waiting for connection while in state: CONNECTING
错误提示WARN - Session 0x0 for server null, unexpected error, closing socket connection and attempting
ぺ芒果゜的博客
01-24 1万+
此项目 在myeclipse2014版本上正常启动。现在由于要上新项目，最低需要JDK1.8，所以升级到Myeclipse2017版本。JDK也重新安装了jdk1.8.0_162（64位）SVN检出项目，添加到 tomcat8.0 选择Exploed,启动。报错信息如下：【报错信息中的ZookKeeper连接地址是被隐藏的】dubbo version: 2.5.3, current host: 1...
kafka服务端报错: WARN [SocketServer listenerType=ZK_BROKER, nodeId=1] Unexpected error from
最新发布
qq_43071699的博客
01-19 1163
异常，并因此关闭了与客户端的连接。这个异常通常发生在Kafka尝试读取网络数据包时收到无效的数据大小（例如负数），这在你的日志中表现为。Kafka服务器（Broker）遇到了。
kafka启动异常及解决方案
weixin_45368758的博客
04-02 1535
kafka启动： .\bin\windows\kafka-server-start.bat .\config\server.properties 异常： [2020-08-06 11:22:05,915] ERROR Unexpected exception, exiting abnormally (org.apache.zookeeper.server.ZooKeeperServerMain) java.net.BindException: Address already in use
三（1）、用kafka遇到的问题
Angular_need的博客
03-13 4313
1、cdh里面加入kafka， 创建topic：kafka-topics --zookeeper node01:2181 --create –replication-factor 1 --partitions 1 --topic from_flume01 producer写入数据：kafka-console-producer --broker-list node01:9092 --topic fr...
kafka报错 WARN Session 0x0 for server null, unexpected error, closing socket connection
LaZY的博客
07-04 1万+
错误代码： [2019-07-04 07:54:44,520] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) java.net.ConnectException: Conn...
kafka连接zookeeper报错
依着风睡的博客
07-09 9795
启动kafka连接zookeeper的时候报如下错： [root@localhost kafka_2.11-2.2.0]# bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test Exception in thread "main" k...
Kafka面试题汇总与详解
5. Kafka与其它组件的集成：例如Kafka与Storm、Spark、Hadoop等大数据处理框架的集成使用，以及Kafka Streams API的使用。 6. Kafka的安全性：包括认证、授权、数据加密和如何配置安全性来保护数据传输和存储。 7....
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
表情包 代码片
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值