kafka installation and systemd

cd /opt
wget https://mirrors.tuna.tsinghua.edu.cn/apache/kafka/2.8.0/kafka_2.12-2.8.0.tgz
tar xvzf kafka_2.12-2.8.0.tgz
ln -s kafka_2.12-2.8.0.tgz/ kafka

vi /etc/systemd/system/kafka-zookeeper.service
[Unit]
Description=Apache Zookeeper server (Kafka)
Documentation=http://zookeeper.apache.org
Requires=network.target remote-fs.target
After=network.target remote-fs.target

[Service]
Type=simple
User=root
Group=root
Environment=JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-2.el8_3.x86_64/jre
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh

[Install]
WantedBy=multi-user.target

vi /etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka server (broker)
Documentation=http://kafka.apache.org/documentation.html
Requires=network.target remote-fs.target
After=network.target remote-fs.target kafka-zookeeper.service

[Service]
Type=simple
User=root
Group=root
Environment=JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-2.el8_3.x86_64/jre
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh

[Install]
WantedBy=multi-user.target

#vi kafka/config/server.properties
#edit listeners propertie
#listeners=PLAINTEXT://192.168.13.133:9092

systemctl daemon-reload
systemctl start kafka-zookeeper.service
systemctl start kafka.service

设置服务启动

systemctl enable kafka-zookeeper.service
systemctl enable kafka.service

systemctl stop *.service   # 停止某服务 

 

修改Kafka的启动内存

1.修改bin目录下的 zookeeper-server-start.sh，将初始堆的大小(-Xms)设置小一些

    export KAFKA_HEAP_OPTS="-Xmx1G -Xms128M"
 

1. 修改bin目录下的kafka-server-start.sh文件，将初始堆的大小(-Xms)设置小一些
2. if [ "x$KAFKA_HEAP_OPTS" = "x" ]; then
       export KAFKA_HEAP_OPTS="-Xmx1G -Xms128M"
   fi
    

1. 在config目录下的server.properties中增加

  log.cleaner.dedupe.buffer.size= prefered buffer size in byte

这一个是Kafka初始化LogManager时候用到的buffer size