在k8s中安装kafka集群说明

本文介绍了如何在k8s环境下安装单节点和多节点的Kafka集群。首先,通过kubectl apply创建zookeeper服务,接着创建kafka服务,确保每个节点正常运行。对于多节点集群,采用3个Deployment分别搭建Zookeeper和Kafka,并验证集群功能。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

本文主要参考以下博文进行试验:https://www.cnblogs.com/00986014w/p/9561901.htmlhttps://my.oschina.net/jianming/blog/2870757

一、安装单节点kafka

1)用kubectl apply -f 创建zookeeper服务

zookeeper-svc.yaml内容如下:

apiVersion: v1

kind: Service

metadata:

  labels:

    app: zookeeper-service

  name: zookeeper-service

spec:

  ports:

  - name: zookeeper-port

    port: 2181

    targetPort: 2181

  selector:

app: zookeeper

zookeeper-deployment.yaml内容如下:

apiVersion: extensions/v1beta1

kind: Deployment

metadata:

  labels:

    app: zookeeper

  name: zookeeper

spec:

  replicas: 1

  template:

    metadata:

      labels:

        app: zookeeper

    spec:

      containers:

      - image: wurstmeister/zookeeper

        imagePullPolicy: IfNotPresent

        name: zookeeper

        ports:

        - containerPort: 2181

2)等zookeeper pod变成running后继续创建kafka。

kafka-svc.yaml的内容如下:

apiVersion: v1

kind: Service

metadata:

  name: kafka-service

  labels:

    app: kafka

spec:

  type: NodePort

  ports:

  - port: 9092

    name: kafka-port

    targetPort: 9092

    nodePort: 30092

    protocol: TCP

  selector:

app: kafka

kafka-deployment.yaml的内容如下:

kind: Deployment

apiVersion: extensions/v1beta1

metadata:

  name: kafka-deployment

spec:

  replicas: 1

  selector:

    matchLabels:

      name: kafka

  template:

    metadata:

      labels:

        name: kafka

        app: kafka

    spec:

      containers:

      - name: kafka

        image: wurstmeister/kafka

        imagePullPolicy: IfNotPresent

        ports:

        - containerPort: 9092

        env:

        - name: KAFKA_ADVERTISED_PORT

          value: "9092"

        - name: KAFKA_ADVERTISED_HOST_NAME

          value: "[kafka-service-clusterIP]"

        - name: KAFKA_ZOOKEEPER_CONNECT

          value: “[zookeeper-service-clusterIP]:2181”

        - name: KAFKA_BROKER_ID

          value: "1"

注意上面[kafka-service-clusterIP]和[zookeeper-service-clusterIP]应换成对应服务真实的clusterIP,如下面图中的10.106.64.111和10.99.59.195

评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值