FATAL Fatal error during KafkaServerStartable startup. java.lang.OutOfMemoryError: Java heap space

最新推荐文章于 2024-07-25 11:28:54 发布

liuhui_306

最新推荐文章于 2024-07-25 11:28:54 发布

阅读量5.5k

点赞数 3

CC 4.0 BY-SA版权

分类专栏： scala kafka

本文链接：https://blog.youkuaiyun.com/liuhui_306/article/details/52890816

scala 同时被 2 个专栏收录

5 篇文章

订阅专栏

kafka

1 篇文章

订阅专栏

本文记录了在搭建Kafka单机版进行测试过程中遇到的内存溢出问题及解决方案。通过调整启动文件kafka-server-start.sh中的KAFKA_HEAP_OPTS参数，增加分配给JVM的堆内存大小，成功解决了启动时出现的Java堆内存溢出错误。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

今天搭建了kafka单机版用于测试，配置好以后启动kafka时出现了内存溢出的问题，如下：

[2016-10-22 10:39:39,112] INFO [Kafka Server 0], shut down completed (kafka.server.KafkaServer)
[2016-10-22 10:39:39,113] FATAL Fatal error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
java.lang.OutOfMemoryError: Java heap space
	at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
	at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
	at kafka.log.SkimpyOffsetMap.<init>(OffsetMap.scala:42)
	at kafka.log.LogCleaner$CleanerThread.<init>(LogCleaner.scala:177)
	at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:86)
	at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:86)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
	at scala.collection.immutable.Range.foreach(Range.scala:141)
	at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
	at scala.collection.AbstractTraversable.map(Traversable.scala:105)
	at kafka.log.LogCleaner.<init>(LogCleaner.scala:86)
	at kafka.log.LogManager.<init>(LogManager.scala:64)
	at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:335)
	at kafka.server.KafkaServer.startup(KafkaServer.scala:85)
	at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:29)
	at kafka.Kafka$.main(Kafka.scala:46)
	at kafka.Kafka.main(Kafka.scala)
[2016-10-22 10:39:39,114] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2016-10-22 10:39:39,116] INFO [Kafka Server 0], shutting down (kafka.server.KafkaServer)

解决方法：

编辑 kafka/kafka-server-start.sh 这个启动文件，修改 KAFKA_HEAP_OPTS 这个参数，默认的参数是 export KAFKA_HEAP_OPTS="-Xmx512m -Xms512m"，增大内存即可，export KAFKA_HEAP_OPTS="-Xmx1g -Xms1g"，再次启动问题解决。