k8s部署elk+filebeat+logstash+kafka集群（二）kafka-zookeeper模式集群

原创

已于 2022-10-13 16:00:15 修改 · 836 阅读

2 ·

CC 4.0 BY-SA版权

文章标签：

#kafka #kubernetes #elk #zookeeper

于 2022-09-30 14:39:43 首次发布

本文介绍了如何在Kubernetes中使用官方Zookeeper镜像部署3.5版本集群，并配置RBAC权限，包括ServiceAccount、ClusterRole和ClusterRoleBinding。随后展示了如何部署Kafka集群，包括创建服务、StatefulSet，以及与Zookeeper的集成。重点在于服务的配置和权限管理。

zookeeper集群部署

zookeeper使用官方镜像，版本为3.5，上传到镜像仓库

rbac

apiVersion: v1
kind: ServiceAccount
metadata:
  name: kafka
  namespace: elk
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
  name: kafka
  labels:
    app: kafka-clusterrole
rules:
- apiGroups:
  - ""
  resources:
  - nodes
  - events
  - namespaces
  - pods
  verbs:
  - get
  - watch
  - list
- apiGroups:
  - ""
  resourceNames:
  - kafka-prospectors
  resources:
  - configmaps
  verbs:
  - get
  - update
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
  name: kafka
  labels:
    app: kafka-clusterrolebinding
roleRef:
  apiGroup: ""
  kind: ClusterRole
  name: kafka
subjects:
- apiGroup: ""
  kind: ServiceAccount
  name: kafka
  namespace: elk

zk集群

# cat zk-statefulset.yaml

apiVersion: v1
kind: Service
metadata:
  name: zk-svc
  namespace: elk
  labels:
    app: zk-cluster-svc
spec:
  selector:
    app: zookeeper-3.5
  type: ClusterIP
  clusterIP: None
  #publishNotReadyAddresses: true
  sessionAffinity: ClientIP
  ports:
  - name: clientport
    port: 2181
    protocol: TCP
    targetPort: 2181
  - name: select-port
    port: 3888
    protocol: TCP
    targetPort: 3888
  - name: leader-port
    port: 2888
    protocol: TCP
    targetPort: 2888
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: zk-statefulset
  namespace: elk
spec:
  podManagementPolicy: OrderedReady
  replicas: 3
  selector:
    matchLabels:
      app: zookeeper-3.5
  serviceName: zk-svc