严重: Error initializing endpoint java.lang.Exception: Socket bind failed: [730048

Tomcat启动错误
本文记录了一次Apache Tomcat启动过程中遇到的问题,主要错误为Socket绑定失败,疑似端口被占用导致。文中提供了详细的错误日志及简单的解决方案。
2010-5-18 22:00:38 org.apache.catalina.core.AprLifecycleListener lifecycleEvent
信息: The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: C:\Program Files\Java\jdk1.6.0_10\bin;D:\Tomcat 5.5\bin
2010-5-18 22:00:38 org.apache.coyote.http11.Http11AprProtocol init
严重: Error initializing endpoint
java.lang.Exception: Socket bind failed: [730048] ?????????×???(Э?é/???????/???)????í??
at org.apache.tomcat.util.net.AprEndpoint.init(AprEndpoint.java:576)
at org.apache.coyote.http11.Http11AprProtocol.init(Http11AprProtocol.java:116)
at org.apache.catalina.connector.Connector.initialize(Connector.java:1017)
at org.apache.catalina.core.StandardService.initialize(StandardService.java:578)
at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:782)
at org.apache.catalina.startup.Catalina.load(Catalina.java:504)
at org.apache.catalina.startup.Catalina.load(Catalina.java:524)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:267)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432)
2010-5-18 22:00:38 org.apache.catalina.startup.Catalina load
严重: Catalina.start
LifecycleException: Protocol handler initialization failed: java.lang.Exception: Socket bind failed: [730048] ?????????×???(Э?é/???????/???)????í??
at org.apache.catalina.connector.Connector.initialize(Connector.java:1019)
at org.apache.catalina.core.StandardService.initialize(StandardService.java:578)
at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:782)
at org.apache.catalina.startup.Catalina.load(Catalina.java:504)
at org.apache.catalina.startup.Catalina.load(Catalina.java:524)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:267)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432)
2010-5-18 22:00:38 org.apache.catalina.startup.Catalina load
信息: Initialization processed in 390 ms
2010-5-18 22:00:38 org.apache.catalina.core.StandardService start
信息: Starting service Catalina
2010-5-18 22:00:38 org.apache.catalina.core.StandardEngine start
信息: Starting Servlet Engine: Apache Tomcat/5.5.28
2010-5-18 22:00:38 org.apache.catalina.core.StandardHost start
信息: XML validation disabled
2010-5-18 22:00:38 org.apache.catalina.core.ApplicationContext log
信息: org.apache.webapp.balancer.BalancerFilter: init(): ruleChain: [org.apache.webapp.balancer.RuleChain: [org.apache.webapp.balancer.rules.URLStringMatchRule: Target string: News / Redirect URL: http://www.cnn.com], [org.apache.webapp.balancer.rules.RequestParameterRule: Target param name: paramName / Target param value: paramValue / Redirect URL: http://www.yahoo.com], [org.apache.webapp.balancer.rules.AcceptEverythingRule: Redirect URL: http://jakarta.apache.org]]
2010-5-18 22:00:39 org.apache.catalina.core.ApplicationContext log
信息: ContextListener: contextInitialized()
2010-5-18 22:00:39 org.apache.catalina.core.ApplicationContext log
信息: SessionListener: contextInitialized()
2010-5-18 22:00:39 org.apache.catalina.core.ApplicationContext log
信息: ContextListener: contextInitialized()
2010-5-18 22:00:39 org.apache.catalina.core.ApplicationContext log
信息: SessionListener: contextInitialized()
2010-5-18 22:00:39 org.apache.coyote.http11.Http11AprProtocol start
严重: Error starting endpoint
java.lang.Exception: Socket bind failed: [730048] ?????????×???(Э?é/???????/???)????í??
at org.apache.tomcat.util.net.AprEndpoint.init(AprEndpoint.java:576)
at org.apache.tomcat.util.net.AprEndpoint.start(AprEndpoint.java:686)
at org.apache.coyote.http11.Http11AprProtocol.start(Http11AprProtocol.java:146)
at org.apache.catalina.connector.Connector.start(Connector.java:1090)
at org.apache.catalina.core.StandardService.start(StandardService.java:457)
at org.apache.catalina.core.StandardServer.start(StandardServer.java:700)
at org.apache.catalina.startup.Catalina.start(Catalina.java:552)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:295)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:433)
2010-5-18 22:00:39 org.apache.catalina.startup.Catalina start
严重: Catalina.start:
LifecycleException: service.getName(): "Catalina"; Protocol handler start failed: java.lang.Exception: Socket bind failed: [730048] ?????????×???(Э?é/???????/???)????í??
at org.apache.catalina.connector.Connector.start(Connector.java:1097)
at org.apache.catalina.core.StandardService.start(StandardService.java:457)
at org.apache.catalina.core.StandardServer.start(StandardServer.java:700)
at org.apache.catalina.startup.Catalina.start(Catalina.java:552)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:295)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:433)
2010-5-18 22:00:39 org.apache.catalina.startup.Catalina start
信息: Server startup in 1110 ms

解决办法:
有可能你开机tomcat就已经启动了,你在进程里把tomcat.exe杀掉,然后再在myeclipse中启动
[root@kafka1 hejia]# /usr/local/kafka_2.13-3.7.2/bin/kafka-server-start.sh /usr/local/kafka_2.13-3.7.2/config/server.properties [2025-09-01 17:10:47,478] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$) [2025-09-01 17:10:47,911] INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util) [2025-09-01 17:10:48,125] INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler) [2025-09-01 17:10:48,127] INFO starting (kafka.server.KafkaServer) [2025-09-01 17:10:48,128] INFO Connecting to zookeeper on 192.168.14.124:2181,192.168.14.125:2181,192.168.14.126:2181 (kafka.server.KafkaServer) [2025-09-01 17:10:48,145] INFO [ZooKeeperClient Kafka server] Initializing a new session to 192.168.14.124:2181,192.168.14.125:2181,192.168.14.126:2181. (kafka.zookeeper.ZooKeeperClient) [2025-09-01 17:10:48,151] INFO Client environment:zookeeper.version=3.8.4-9316c2a7a97e1666d8f4593f34dd6fc36ecc436c, built on 2024-02-12 22:16 UTC (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,152] INFO Client environment:host.name=kafka1 (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,152] INFO Client environment:java.version=1.8.0_171 (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,152] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,152] INFO Client environment:java.home=/usr/local/jdk1.8.0_171/jre (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,152] INFO Client environment:java.class.path=/usr/local/jdk1.8.0_171/jre/lib/ext:/usr/local/jdk1.8.0_171/lib/tools.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/activation-1.1.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/aopalliance-repackaged-2.6.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/argparse4j-0.7.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/audience-annotations-0.12.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/caffeine-2.9.3.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/checker-qual-3.19.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/commons-beanutils-1.9.4.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/commons-cli-1.4.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/commons-collections-3.2.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/commons-digester-2.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/commons-io-2.14.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/commons-lang3-3.8.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/commons-logging-1.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/commons-validator-1.7.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/connect-api-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/connect-basic-auth-extension-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/connect-json-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/connect-mirror-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/connect-mirror-client-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/connect-runtime-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/connect-transforms-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/error_prone_annotations-2.10.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/hk2-api-2.6.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/hk2-locator-2.6.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/hk2-utils-2.6.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-annotations-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-core-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-databind-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-dataformat-csv-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-datatype-jdk8-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-jaxrs-base-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-jaxrs-json-provider-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-module-jaxb-annotations-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jackson-module-scala_2.13-2.16.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jakarta.activation-api-1.2.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jakarta.annotation-api-1.3.5.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jakarta.inject-2.6.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jakarta.validation-api-2.0.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jakarta.ws.rs-api-2.1.6.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jakarta.xml.bind-api-2.3.3.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/javassist-3.29.2-GA.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/javax.activation-api-1.2.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/javax.annotation-api-1.3.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/javax.servlet-api-3.1.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/javax.ws.rs-api-2.1.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jaxb-api-2.3.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jersey-client-2.39.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jersey-common-2.39.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jersey-container-servlet-2.39.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jersey-container-servlet-core-2.39.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jersey-hk2-2.39.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jersey-server-2.39.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-client-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-continuation-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-http-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-io-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-security-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-server-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-servlet-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-servlets-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-util-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jetty-util-ajax-9.4.56.v20240826.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jline-3.25.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jopt-simple-5.0.4.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jose4j-0.9.4.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/jsr305-3.0.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka_2.13-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-clients-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-group-coordinator-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-log4j-appender-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-metadata-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-raft-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-server-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-server-common-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-shell-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-storage-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-storage-api-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-streams-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-streams-examples-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-streams-scala_2.13-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-streams-test-utils-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-tools-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/kafka-tools-api-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/lz4-java-1.8.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/maven-artifact-3.8.8.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/metrics-core-2.2.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/metrics-core-4.1.12.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-buffer-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-codec-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-common-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-handler-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-resolver-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-transport-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-transport-classes-epoll-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-transport-native-epoll-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/netty-transport-native-unix-common-4.1.115.Final.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/opentelemetry-proto-1.0.0-alpha.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/osgi-resource-locator-1.0.3.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/paranamer-2.8.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/pcollections-4.0.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/plexus-utils-3.3.1.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/protobuf-java-3.25.5.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/reflections-0.10.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/reload4j-1.2.25.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/rocksdbjni-7.9.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/scala-collection-compat_2.13-2.10.0.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/scala-java8-compat_2.13-1.0.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/scala-library-2.13.12.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/scala-logging_2.13-3.9.4.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/scala-reflect-2.13.12.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/slf4j-api-1.7.36.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/slf4j-reload4j-1.7.36.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/snappy-java-1.1.10.5.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/swagger-annotations-2.2.8.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/trogdor-3.7.2.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/zookeeper-3.8.4.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/zookeeper-jute-3.8.4.jar:/usr/local/kafka_2.13-3.7.2/bin/../libs/zstd-jni-1.5.6-4.jar (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,153] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,153] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,153] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:os.version=3.10.0-1160.el7.x86_64 (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:user.dir=/home/hejia (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:os.memory.free=1003MB (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:os.memory.max=1024MB (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,154] INFO Client environment:os.memory.total=1024MB (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,157] INFO Initiating client connection, connectString=192.168.14.124:2181,192.168.14.125:2181,192.168.14.126:2181 sessionTimeout=18000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@6150c3ec (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:48,161] INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket) [2025-09-01 17:10:48,170] INFO zookeeper.request.timeout value is 0. feature enabled=false (org.apache.zookeeper.ClientCnxn) [2025-09-01 17:10:48,172] INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient) [2025-09-01 17:10:48,174] INFO Opening socket connection to server /192.168.14.126:2181. (org.apache.zookeeper.ClientCnxn) [2025-09-01 17:10:48,178] INFO Socket connection established, initiating session, client: /192.168.14.124:42150, server: /192.168.14.126:2181 (org.apache.zookeeper.ClientCnxn) [2025-09-01 17:10:48,184] INFO Session establishment complete on server /192.168.14.126:2181, session id = 0x3000359362800e9, negotiated timeout = 18000 (org.apache.zookeeper.ClientCnxn) [2025-09-01 17:10:48,187] INFO [ZooKeeperClient Kafka server] Connected. (kafka.zookeeper.ZooKeeperClient) [2025-09-01 17:10:48,627] INFO Cluster ID = eQFewTrDRa6Csx8shnSzQQ (kafka.server.KafkaServer) [2025-09-01 17:10:48,709] INFO KafkaConfig values: advertised.listeners = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.include.jmx.reporter = true auto.leader.rebalance.enable = true background.threads = 10 broker.heartbeat.interval.ms = 2000 broker.id = 0 broker.id.generation.enable = true broker.rack = null broker.session.timeout.ms = 9000 client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.listener.names = null controller.quorum.append.linger.ms = 25 controller.quorum.election.backoff.max.ms = 1000 controller.quorum.election.timeout.ms = 1000 controller.quorum.fetch.timeout.ms = 2000 controller.quorum.request.timeout.ms = 2000 controller.quorum.retry.backoff.ms = 20 controller.quorum.voters = [] controller.quota.window.num = 11 controller.quota.window.size.seconds = 1 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delegation.token.secret.key = null delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true early.start.listeners = null eligible.leader.replicas.enable = false fetch.max.bytes = 57671680 fetch.purgatory.purge.interval.requests = 1000 group.consumer.assignors = [org.apache.kafka.coordinator.group.assignor.UniformAssignor, org.apache.kafka.coordinator.group.assignor.RangeAssignor] group.consumer.heartbeat.interval.ms = 5000 group.consumer.max.heartbeat.interval.ms = 15000 group.consumer.max.session.timeout.ms = 60000 group.consumer.max.size = 2147483647 group.consumer.min.heartbeat.interval.ms = 5000 group.consumer.min.session.timeout.ms = 45000 group.consumer.session.timeout.ms = 45000 group.coordinator.new.enable = false group.coordinator.rebalance.protocols = [classic] group.coordinator.threads = 1 group.initial.rebalance.delay.ms = 0 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 initial.broker.registration.timeout.ms = 60000 inter.broker.listener.name = null inter.broker.protocol.version = 3.7-IV4 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL listeners = PLAINTEXT://192.168.14.124:9092 log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /data/kafka/log log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.local.retention.bytes = -2 log.local.retention.ms = -2 log.message.downconversion.enable = true log.message.format.version = 3.0-IV1 log.message.timestamp.after.max.ms = 9223372036854775807 log.message.timestamp.before.max.ms = 9223372036854775807 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connection.creation.rate = 2147483647 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1048588 metadata.log.dir = null metadata.log.max.record.bytes.between.snapshots = 20971520 metadata.log.max.snapshot.interval.ms = 3600000 metadata.log.segment.bytes = 1073741824 metadata.log.segment.min.bytes = 8388608 metadata.log.segment.ms = 604800000 metadata.max.idle.interval.ms = 500 metadata.max.retention.bytes = 104857600 metadata.max.retention.ms = 604800000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 node.id = 0 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null principal.builder.class = class org.apache.kafka.common.security.authenticator.DefaultKafkaPrincipalBuilder process.roles = [] producer.id.expiration.check.interval.ms = 600000 producer.id.expiration.ms = 86400000 producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.window.num = 11 quota.window.size.seconds = 1 remote.log.index.file.cache.total.size.bytes = 1073741824 remote.log.manager.task.interval.ms = 30000 remote.log.manager.task.retry.backoff.max.ms = 30000 remote.log.manager.task.retry.backoff.ms = 500 remote.log.manager.task.retry.jitter = 0.2 remote.log.manager.thread.pool.size = 10 remote.log.metadata.custom.metadata.max.bytes = 128 remote.log.metadata.manager.class.name = org.apache.kafka.server.log.remote.metadata.storage.TopicBasedRemoteLogMetadataManager remote.log.metadata.manager.class.path = null remote.log.metadata.manager.impl.prefix = rlmm.config. remote.log.metadata.manager.listener.name = null remote.log.reader.max.pending.tasks = 100 remote.log.reader.threads = 10 remote.log.storage.manager.class.name = null remote.log.storage.manager.class.path = null remote.log.storage.manager.impl.prefix = rsm.config. remote.log.storage.system.enable = false replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 30000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [GSSAPI] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.connect.timeout.ms = null sasl.login.read.timeout.ms = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.login.retry.backoff.max.ms = 10000 sasl.login.retry.backoff.ms = 100 sasl.mechanism.controller.protocol = GSSAPI sasl.mechanism.inter.broker.protocol = GSSAPI sasl.oauthbearer.clock.skew.seconds = 30 sasl.oauthbearer.expected.audience = null sasl.oauthbearer.expected.issuer = null sasl.oauthbearer.jwks.endpoint.refresh.ms = 3600000 sasl.oauthbearer.jwks.endpoint.retry.backoff.max.ms = 10000 sasl.oauthbearer.jwks.endpoint.retry.backoff.ms = 100 sasl.oauthbearer.jwks.endpoint.url = null sasl.oauthbearer.scope.claim.name = scope sasl.oauthbearer.sub.claim.name = sub sasl.oauthbearer.token.endpoint.url = null sasl.server.callback.handler.class = null sasl.server.max.receive.size = 524288 security.inter.broker.protocol = PLAINTEXT security.providers = null server.max.startup.time.ms = 9223372036854775807 socket.connection.setup.timeout.max.ms = 30000 socket.connection.setup.timeout.ms = 10000 socket.listen.backlog.size = 50 socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.allow.dn.changes = false ssl.allow.san.changes = false ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.engine.factory.class = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.certificate.chain = null ssl.keystore.key = null ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.certificates = null ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS telemetry.max.bytes = 1048576 transaction.abort.timed.out.transaction.cleanup.interval.ms = 10000 transaction.max.timeout.ms = 900000 transaction.partition.verification.enable = true transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 1 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 1 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false unstable.api.versions.enable = false unstable.metadata.versions.enable = false zookeeper.clientCnxnSocket = null zookeeper.connect = 192.168.14.124:2181,192.168.14.125:2181,192.168.14.126:2181 zookeeper.connection.timeout.ms = 18000 zookeeper.max.in.flight.requests = 10 zookeeper.metadata.migration.enable = false zookeeper.metadata.migration.min.batch.size = 200 zookeeper.session.timeout.ms = 18000 zookeeper.set.acl = false zookeeper.ssl.cipher.suites = null zookeeper.ssl.client.enable = false zookeeper.ssl.crl.enable = false zookeeper.ssl.enabled.protocols = null zookeeper.ssl.endpoint.identification.algorithm = HTTPS zookeeper.ssl.keystore.location = null zookeeper.ssl.keystore.password = null zookeeper.ssl.keystore.type = null zookeeper.ssl.ocsp.enable = false zookeeper.ssl.protocol = TLSv1.2 zookeeper.ssl.truststore.location = null zookeeper.ssl.truststore.password = null zookeeper.ssl.truststore.type = null (kafka.server.KafkaConfig) [2025-09-01 17:10:48,784] INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:48,785] INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:48,789] INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:48,791] INFO [ThrottledChannelReaper-ControllerMutation]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:48,953] INFO Loading logs from log dirs ArraySeq(/data/kafka/log) (kafka.log.LogManager) [2025-09-01 17:10:48,960] INFO No logs found to be loaded in /data/kafka/log (kafka.log.LogManager) [2025-09-01 17:10:48,982] INFO Loaded 0 logs in 28ms (kafka.log.LogManager) [2025-09-01 17:10:48,985] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager) [2025-09-01 17:10:48,987] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager) [2025-09-01 17:10:49,700] INFO [kafka-log-cleaner-thread-0]: Starting (kafka.log.LogCleaner$CleanerThread) [2025-09-01 17:10:49,723] INFO [feature-zk-node-event-process-thread]: Starting (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread) [2025-09-01 17:10:49,754] INFO [MetadataCache brokerId=0] Updated cache from existing None to latest Features(version=3.7-IV4, finalizedFeatures={}, finalizedFeaturesEpoch=0). (kafka.server.metadata.ZkMetadataCache) [2025-09-01 17:10:49,807] INFO [zk-broker-0-to-controller-forwarding-channel-manager]: Starting (kafka.server.NodeToControllerRequestThread) [2025-09-01 17:10:50,663] INFO Updated connection-accept-rate max connection creation rate to 2147483647 (kafka.network.ConnectionQuotas) [2025-09-01 17:10:50,694] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Created data-plane acceptor and processors for endpoint : ListenerName(PLAINTEXT) (kafka.network.SocketServer) [2025-09-01 17:10:50,719] INFO [zk-broker-0-to-controller-alter-partition-channel-manager]: Starting (kafka.server.NodeToControllerRequestThread) [2025-09-01 17:10:50,797] INFO [ExpirationReaper-0-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:50,928] INFO [ExpirationReaper-0-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:50,929] INFO [ExpirationReaper-0-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:50,931] INFO [ExpirationReaper-0-ElectLeader]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:50,939] INFO [ExpirationReaper-0-RemoteFetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:50,963] INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler) [2025-09-01 17:10:50,970] INFO [AddPartitionsToTxnSenderThread-0]: Starting (kafka.server.AddPartitionsToTxnManager) [2025-09-01 17:10:51,183] INFO Creating /brokers/ids/0 (is it secure? false) (kafka.zk.KafkaZkClient) [2025-09-01 17:10:51,209] ERROR Error while creating ephemeral at /brokers/ids/0, node already exists and owner '0x200038df42600ef' does not match current session '0x3000359362800e9' (kafka.zk.KafkaZkClient$CheckedEphemeral) [2025-09-01 17:10:51,235] ERROR [KafkaServer id=0] Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists at org.apache.zookeeper.KeeperException.create(KeeperException.java:126) at kafka.zk.KafkaZkClient$CheckedEphemeral.getAfterNodeExists(KafkaZkClient.scala:2238) at kafka.zk.KafkaZkClient$CheckedEphemeral.create(KafkaZkClient.scala:2176) at kafka.zk.KafkaZkClient.checkedEphemeralCreate(KafkaZkClient.scala:2143) at kafka.zk.KafkaZkClient.registerBroker(KafkaZkClient.scala:110) at kafka.server.KafkaServer.startup(KafkaServer.scala:404) at kafka.Kafka$.main(Kafka.scala:112) at kafka.Kafka.main(Kafka.scala) [2025-09-01 17:10:51,238] INFO [KafkaServer id=0] shutting down (kafka.server.KafkaServer) [2025-09-01 17:10:51,239] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Stopping socket server request processors (kafka.network.SocketServer) [2025-09-01 17:10:51,245] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Stopped socket server request processors (kafka.network.SocketServer) [2025-09-01 17:10:51,248] INFO [ReplicaManager broker=0] Shutting down (kafka.server.ReplicaManager) [2025-09-01 17:10:51,250] INFO [LogDirFailureHandler]: Shutting down (kafka.server.ReplicaManager$LogDirFailureHandler) [2025-09-01 17:10:51,250] INFO [LogDirFailureHandler]: Stopped (kafka.server.ReplicaManager$LogDirFailureHandler) [2025-09-01 17:10:51,250] INFO [LogDirFailureHandler]: Shutdown completed (kafka.server.ReplicaManager$LogDirFailureHandler) [2025-09-01 17:10:51,251] INFO [ReplicaFetcherManager on broker 0] shutting down (kafka.server.ReplicaFetcherManager) [2025-09-01 17:10:51,252] INFO [ReplicaFetcherManager on broker 0] shutdown completed (kafka.server.ReplicaFetcherManager) [2025-09-01 17:10:51,252] INFO [ReplicaAlterLogDirsManager on broker 0] shutting down (kafka.server.ReplicaAlterLogDirsManager) [2025-09-01 17:10:51,252] INFO [ReplicaAlterLogDirsManager on broker 0] shutdown completed (kafka.server.ReplicaAlterLogDirsManager) [2025-09-01 17:10:51,253] INFO [ExpirationReaper-0-Fetch]: Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,253] INFO [ExpirationReaper-0-Fetch]: Stopped (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,254] INFO [ExpirationReaper-0-Fetch]: Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,254] INFO [ExpirationReaper-0-RemoteFetch]: Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,255] INFO [ExpirationReaper-0-RemoteFetch]: Stopped (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,255] INFO [ExpirationReaper-0-RemoteFetch]: Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,255] INFO [ExpirationReaper-0-Produce]: Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,255] INFO [ExpirationReaper-0-Produce]: Stopped (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,256] INFO [ExpirationReaper-0-Produce]: Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,256] INFO [ExpirationReaper-0-DeleteRecords]: Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,256] INFO [ExpirationReaper-0-DeleteRecords]: Stopped (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,256] INFO [ExpirationReaper-0-DeleteRecords]: Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,257] INFO [ExpirationReaper-0-ElectLeader]: Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,257] INFO [ExpirationReaper-0-ElectLeader]: Stopped (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,257] INFO [ExpirationReaper-0-ElectLeader]: Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2025-09-01 17:10:51,264] INFO [AddPartitionsToTxnSenderThread-0]: Shutting down (kafka.server.AddPartitionsToTxnManager) [2025-09-01 17:10:51,265] INFO [AddPartitionsToTxnSenderThread-0]: Stopped (kafka.server.AddPartitionsToTxnManager) [2025-09-01 17:10:51,265] INFO [AddPartitionsToTxnSenderThread-0]: Shutdown completed (kafka.server.AddPartitionsToTxnManager) [2025-09-01 17:10:51,267] INFO [ReplicaManager broker=0] Shut down completely (kafka.server.ReplicaManager) [2025-09-01 17:10:51,267] INFO [zk-broker-0-to-controller-alter-partition-channel-manager]: Shutting down (kafka.server.NodeToControllerRequestThread) [2025-09-01 17:10:51,268] INFO [zk-broker-0-to-controller-alter-partition-channel-manager]: Stopped (kafka.server.NodeToControllerRequestThread) [2025-09-01 17:10:51,268] INFO [zk-broker-0-to-controller-alter-partition-channel-manager]: Shutdown completed (kafka.server.NodeToControllerRequestThread) [2025-09-01 17:10:51,269] INFO Node to controller channel manager for alter-partition shutdown (kafka.server.NodeToControllerChannelManagerImpl) [2025-09-01 17:10:51,269] INFO [zk-broker-0-to-controller-forwarding-channel-manager]: Shutting down (kafka.server.NodeToControllerRequestThread) [2025-09-01 17:10:51,270] INFO [zk-broker-0-to-controller-forwarding-channel-manager]: Stopped (kafka.server.NodeToControllerRequestThread) [2025-09-01 17:10:51,270] INFO [zk-broker-0-to-controller-forwarding-channel-manager]: Shutdown completed (kafka.server.NodeToControllerRequestThread) [2025-09-01 17:10:51,270] INFO Node to controller channel manager for forwarding shutdown (kafka.server.NodeToControllerChannelManagerImpl) [2025-09-01 17:10:51,271] INFO Shutting down. (kafka.log.LogManager) [2025-09-01 17:10:51,273] INFO [kafka-log-cleaner-thread-0]: Shutting down (kafka.log.LogCleaner$CleanerThread) [2025-09-01 17:10:51,275] INFO [kafka-log-cleaner-thread-0]: Stopped (kafka.log.LogCleaner$CleanerThread) [2025-09-01 17:10:51,275] INFO [kafka-log-cleaner-thread-0]: Shutdown completed (kafka.log.LogCleaner$CleanerThread) [2025-09-01 17:10:51,336] INFO Shutdown complete. (kafka.log.LogManager) [2025-09-01 17:10:51,490] INFO [feature-zk-node-event-process-thread]: Shutting down (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread) [2025-09-01 17:10:51,490] INFO [feature-zk-node-event-process-thread]: Stopped (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread) [2025-09-01 17:10:51,490] INFO [feature-zk-node-event-process-thread]: Shutdown completed (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread) [2025-09-01 17:10:51,491] INFO [ZooKeeperClient Kafka server] Closing. (kafka.zookeeper.ZooKeeperClient) [2025-09-01 17:10:51,623] INFO Session: 0x3000359362800e9 closed (org.apache.zookeeper.ZooKeeper) [2025-09-01 17:10:51,624] INFO EventThread shut down for session: 0x3000359362800e9 (org.apache.zookeeper.ClientCnxn) [2025-09-01 17:10:51,745] INFO [ZooKeeperClient Kafka server] Closed. (kafka.zookeeper.ZooKeeperClient) [2025-09-01 17:10:51,748] INFO [ThrottledChannelReaper-Fetch]: Shutting down (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,758] INFO [ThrottledChannelReaper-Fetch]: Stopped (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,778] INFO [ThrottledChannelReaper-Fetch]: Shutdown completed (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,778] INFO [ThrottledChannelReaper-Produce]: Shutting down (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,792] INFO [ThrottledChannelReaper-Produce]: Stopped (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,792] INFO [ThrottledChannelReaper-Produce]: Shutdown completed (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,792] INFO [ThrottledChannelReaper-Request]: Shutting down (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,792] INFO [ThrottledChannelReaper-Request]: Stopped (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,792] INFO [ThrottledChannelReaper-Request]: Shutdown completed (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,806] INFO [ThrottledChannelReaper-ControllerMutation]: Shutting down (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,806] INFO [ThrottledChannelReaper-ControllerMutation]: Stopped (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,806] INFO [ThrottledChannelReaper-ControllerMutation]: Shutdown completed (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2025-09-01 17:10:51,830] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Shutting down socket server (kafka.network.SocketServer) [2025-09-01 17:10:52,317] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Shutdown completed (kafka.network.SocketServer) [2025-09-01 17:10:52,363] INFO Metrics scheduler closed (org.apache.kafka.common.metrics.Metrics) [2025-09-01 17:10:52,363] INFO Metrics reporters closed (org.apache.kafka.common.metrics.Metrics) [2025-09-01 17:10:52,415] INFO Broker and topic stats closed (kafka.server.BrokerTopicStats) [2025-09-01 17:10:52,554] INFO App info kafka.server for 0 unregistered (org.apache.kafka.common.utils.AppInfoParser) [2025-09-01 17:10:52,610] INFO [KafkaServer id=0] shut down completed (kafka.server.KafkaServer) [2025-09-01 17:10:52,610] ERROR Exiting Kafka due to fatal exception during startup. (kafka.Kafka$) org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists at org.apache.zookeeper.KeeperException.create(KeeperException.java:126) at kafka.zk.KafkaZkClient$CheckedEphemeral.getAfterNodeExists(KafkaZkClient.scala:2238) at kafka.zk.KafkaZkClient$CheckedEphemeral.create(KafkaZkClient.scala:2176) at kafka.zk.KafkaZkClient.checkedEphemeralCreate(KafkaZkClient.scala:2143) at kafka.zk.KafkaZkClient.registerBroker(KafkaZkClient.scala:110) at kafka.server.KafkaServer.startup(KafkaServer.scala:404) at kafka.Kafka$.main(Kafka.scala:112) at kafka.Kafka.main(Kafka.scala) [2025-09-01 17:10:52,953] INFO [KafkaServer id=0] shutting down (kafka.server.KafkaServer)
最新发布
09-02
<think>嗯,我现在遇到了一个Spark的错误,ERROR SparkContext: Error initializing SparkContext,还有java.lang.reflect.InvocationTargetException。这应该怎么解决呢?让我仔细想想。 首先,InvocationTargetException通常是在反射调用方法时,底层方法抛出了异常。也就是说,SparkContext在初始化的时候,某个被反射调用的方法抛出了异常,导致这个错误。那具体是什么原因呢? 可能的原因有很多,我需要逐一排查。首先,我应该检查错误日志中的完整堆栈信息,看看有没有更具体的异常信息。因为InvocationTargetException只是一个包装异常,真正的问题可能被包裹在里面。比如,可能是ClassNotFoundException、NoSuchMethodError,或者配置错误,资源不足,比如内存不够,端口被占用,或者依赖冲突。 如果没有完整的日志,可能需要调整日志级别,比如在Spark的配置里设置更详细的日志输出,或者查看driver的日志文件,找到具体的错误原因。比如,执行Spark应用时,可以通过--driver-java-options "-Dlog4j.configuration=file:/path/to/log4j.properties"来设置更详细的日志。 接下来,可能的常见原因之一是依赖问题。比如,项目中引入了不同版本的Scala或Spark相关库,导致冲突。比如,Spark编译时使用的Scala版本和运行时使用的版本不一致,可能会引发这个问题。例如,如果Spark是用Scala 2.12编译的,但项目中依赖了Scala 2.11的库,或者反过来,就会有问题。这时候需要检查所有依赖的版本是否一致,并且与Spark版本兼容。 另外,检查Spark的配置是否正确。比如,spark.master的设置是否正确,是否指定了正确的部署模式(local[*], yarn, spark://host:port等)。如果配置错误,SparkContext可能无法初始化。例如,在本地运行时,是否设置了setMaster("local[*]"),或者是否正确指定了内存参数,如set("spark.driver.memory", "4g"),尤其是在资源不足的情况下。 还有可能是环境问题,比如JAVA_HOME没有正确设置,或者Java版本不兼容。Spark通常需要Java 8或更高版本,但某些版本可能有特定的要求。比如,Spark 3.x需要Java 8或11,而Java 17可能还不被支持,或者需要额外配置。需要检查Java版本是否符合要求。 端口冲突也可能导致这个问题。比如,Spark的某个端口(如4040、7077等)被其他程序占用,导致无法启动。这时候可以尝试更换端口,或者关闭占用端口的程序。 还有一种可能是Hadoop库的版本不兼容。如果运行环境中的Hadoop原生库存在版本不匹配,可能会导致native库加载失败,从而引发错误。这时候需要确保Hadoop版本与Spark兼容,或者排除相关依赖,使用Spark自带的库。 还有,用户代码中的错误也可能导致SparkContext初始化失败。比如,在SparkConf或SparkContext的创建过程中,传入了无效的参数,或者代码中存在语法错误,导致初始化时抛出异常。这时候需要检查代码中的配置是否正确,比如是否有拼写错误,参数是否合理。 举个例子,如果用户代码中这样写: val conf = new SparkConf().setAppName("MyApp").setMaster("local") val sc = new SparkContext(conf) 但实际运行环境中没有正确配置local模式所需的资源,或者路径权限问题,可能导致初始化失败。或者,如果在集群模式下运行,但网络配置不正确,无法连接到集群管理器。 另外,内存不足也是一个常见问题。例如,driver的内存设置过小,无法完成初始化。可以尝试增加driver的内存,比如通过spark.driver.memory参数设置为更大的值,如"4g"或"8g"。 如果使用IDE(如IntelliJ IDEA)运行Spark程序,可能存在环境变量未正确设置的问题。比如,某些依赖库没有被正确包含到classpath中,导致类找不到。这时需要检查项目的依赖配置,确保所有必要的库都已正确引入。 还有一种情况是,用户代码中在初始化SparkContext之前或之后执行了某些操作,导致冲突。例如,尝试创建多个SparkContext实例,而Spark不允许在一个JVM中存在多个SparkContext。这时候需要检查代码,确保只有一个SparkContext被创建,并且在不需要时正确关闭。 总结一下,解决这个错误的步骤大致如下: 1. 查看完整的异常堆栈,找到被包装的具体异常原因。 2. 检查Spark配置是否正确,包括master URL、内存设置等。 3. 确保所有依赖库版本兼容,没有冲突,特别是Scala和Spark版本。 4. 检查Java版本和环境变量是否正确。 5. 确保端口未被占用,网络配置正确。 6. 检查用户代码是否存在错误,如参数错误、多个SparkContext实例等。 7. 增加内存配置,排除资源不足的问题。 8. 检查Hadoop库的兼容性,必要时排除或替换依赖。 比如,如果错误日志中显示的是ClassNotFoundException: org.apache.hadoop.fs.FileSystem,那么可能是Hadoop的类路径未正确配置,需要添加Hadoop的依赖或确保其存在于classpath中。或者,如果显示的是端口冲突,可以尝试更改spark的端口设置。 如果用户使用的是Spark Standalone集群,可能需要检查worker节点是否可用,防火墙设置是否正确,或者是否能够连接到master节点。 另外,某些情况下,Spark的临时目录(如/tmp目录)权限不足,也可能导致初始化失败。可以检查Spark的日志是否有相关的IOException,提示无法写入某个目录,这时需要修改目录权限或通过配置指定其他目录。 总之,解决这个问题的关键在于从详细的错误日志中找到具体的异常原因,然后针对性地排查和调整配置、依赖或代码。</think>遇到 `ERROR SparkContext: Error initializing SparkContext` 并伴随 `java.lang.reflect.InvocationTargetException` 时,通常是由于 SparkContext 初始化过程中底层代码抛出了异常。以下是分步解决方案: --- ### **1. 查看完整堆栈日志** - **关键步骤**:定位具体异常原因。 `InvocationTargetException` 是一个反射调用异常的包装,需通过日志找到其 **根本原因**(如 `Caused by:` 部分)。例如: - `ClassNotFoundException`(依赖缺失) - `NoSuchMethodError`(版本冲突) - `IOException`(端口占用、权限问题) - 资源不足(内存、CPU) -- ### **2. 常见原因及解决方案** #### **(1) 依赖冲突或缺失** - **表现**:日志中出现 `ClassNotFoundException` 或 `NoSuchMethodError`。 - **解决**: - **检查依赖版本**:确保所有库(如 Scala、Spark、Hadoop)版本一致。例如: - Spark 3.x 需搭配 Scala 2.12。 - 使用 Maven/Gradle 时,排除冲突依赖(如 `hadoop-client`)。 - **构建工具配置**:若使用 `spark-submit`,通过 `--packages` 指定依赖,或使用 `--jars` 添加外部 JAR。 #### **(2) 配置错误** - **表现**:`SparkConf` 参数错误或资源不足。 - **解决**: - **检查 Master URL**:确认 `setMaster("local[*]")`(本地模式)或集群地址正确。 - **增加内存**:通过 `spark.driver.memory` 或 `spark.executor.memory` 调整内存: ```scala val conf = new SparkConf() .setAppName("MyApp") .setMaster("local[*]") .set("spark.driver.memory", "4g") ``` #### **(3) 环境问题** - **Java 版本**:确保使用 Java 8 或 11(Spark 3.x 要求)。 - **端口冲突**:更换 Spark 端口: ```scala conf.set("spark.driver.port", "4041") ``` - **临时目录权限**:检查 `/tmp` 目录权限,或指定其他目录: ```bash export SPARK_LOCAL_DIRS=/path/to/tmp ``` #### **(4) 代码问题** - **多个 SparkContext**:确保代码中仅创建一个 `SparkContext`。 - **关闭旧 Context**:在创建新 Context 前,调用 `SparkContext.getOrCreate().stop()`。 --- ### **3. 排查流程示例** 1. **查看日志**: ``` Caused by: java.net.BindException: Address already in use ``` - 表示端口被占用,需更换端口或终止占用进程。 2. **调整配置**: ```scala val conf = new SparkConf() .set("spark.driver.port", "4041") ``` 3. **重新运行**:验证问题是否解决。 --- ### **4. 其他工具** - **调试本地模式**:使用 `local[*]` 简化环境问题。 - **最小化代码复现**:逐步注释代码,定位具体引发异常的语句。 --- 通过以上步骤,结合日志中的具体错误信息,可系统性解决 `SparkContext` 初始化失败的问题。若仍无法解决,建议提供完整错误日志以便进一步分析。
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值