k8s集群部署zookeeper集群。

本次部署的服务分别为一个无头服务、 一个 Service、 一个 PodDisruptionBudget 和一个 StatefulSet。

cat zookeeper-service.yaml 
apiVersion: v1
kind: Service
metadata:
  name: zk-hs
  namespace: service-zookeeper
  labels:
    app: zk
spec:
  ports:
  - port: 2888
    name: server
  - port: 3888
    name: leader-election
  clusterIP: None
  selector:
    app: zk
---
apiVersion: v1
kind: Service
metadata:
  name: zk-cs
  namespace: service-zookeeper
  labels:
    app: zk
spec:
  ports:
  - port: 2181
    name: client
  selector:
    app: zk


cat zookeeper-pdb.yaml 
apiVersion: policy/v1
kind: PodDisruptionBudget
metadata:
  name: zk-pdb
  namespace: service-zookeeper
spec:
  selector:
    matchLabels:
      app: zk
  maxUnavailable: 1


cat zookeeper-StatefulSet.yaml 
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: zk
  namespace: service-zookeeper
spec:
  selector:
    matchLabels:
      app: zk
  serviceName: zk-hs
  replicas: 3
  updateStrategy:
    type: RollingUpdate
  podManagementPolicy: OrderedReady
  template:
    metadata:
      labels:
        app: zk
    spec:
      affinity:
        podAntiAffinity:
          requiredDuringSchedulingIgnoredDuringExecution:
            - labelSelector:
                matchExpressions:
                  - key: "app"
                    operator: In
                    values:
                    - zk
              topologyKey: "kubernetes.io/hostname"
      #imagePullSecrets:
      #- name: harbor-regcred
      containers:
      - name: kubernetes-zookeeper
        imagePullPolicy: Always
        image: "registry.k8s.io/kubernetes-zookeeper:1.0-3.4.10"
        #resources:
          #requests:
            #memory: "1Gi"
            #cpu: "0.5"
        ports:
        - containerPort: 2181
          name: client
        - containerPort: 2888
          name: server
        - containerPort: 3888
          name: leader-election
        command:
        - sh
        - -c
        - "start-zookeeper \
          --servers=3 \
          --data_dir=/var/lib/zookeeper/data \
          --data_log_dir=/var/lib/zookeeper/data/log \
          --conf_dir=/opt/zookeeper/conf \
          --client_port=2181 \
          --election_port=3888 \
          --server_port=2888 \
          --tick_time=2000 \
          --init_limit=10 \
          --sync_limit=5 \
          --heap=512M \
          --max_client_cnxns=60 \
          --snap_retain_count=3 \
          --purge_interval=12 \
          --max_session_timeout=40000 \
          --min_session_timeout=4000 \
          --log_level=INFO"
        readinessProbe:
          exec:
            command:
            - sh
            - -c
            - "zookeeper-ready 2181"
          initialDelaySeconds: 10
          timeoutSeconds: 5
        livenessProbe:
          exec:
            command:
            - sh
            - -c
            - "zookeeper-ready 2181"
          initialDelaySeconds: 10
          timeoutSeconds: 5
        volumeMounts:
        - name: datadir
          mountPath: /var/lib/zookeeper
      securityContext:
        runAsUser: 1000
        fsGroup: 1000
  volumeClaimTemplates:
  - metadata:
      name: datadir
    spec:
      accessModes: [ "ReadWriteMany" ]
      resources:
        requests:
          storage: 10Gi
      storageClassName: "zookeeper-storage"    这里的zookeeper-storage名字要和存储PV的storageClassName名字一致。

持久化存储使用的的是阿里云的oss，如果使用本地部署可以使用nfs等。

cat zookeeper-pv.yaml 
apiVersion: v1
kind: PersistentVolume
metadata:
  labels:
    alicloud-pvname: zookeeper-pv-1
  name: zookeeper-pv-1
spec:
  accessModes:
    - ReadWriteMany
  capacity:
    storage: 10Gi
  csi:
    driver: ossplugin.csi.alibabacloud.com
    nodePublishSecretRef:
      name: ack-oss-key
      namespace: service-zookeeper
    volumeAttributes:
      bucket: xxx-test
      otherOpts: '-o umask=000 -o allow_other'
      path: /test/zookeeper/zookeeper-1/
      url: oss-xxx
    volumeHandle: zookeeper-pv-1
  persistentVolumeReclaimPolicy: Retain
  storageClassName: zookeeper-storage
  volumeMode: Filesystem
---
apiVersion: v1
kind: PersistentVolume
metadata:
  labels:
    alicloud-pvname: zookeeper-pv-2
  name: zookeeper-pv-2
spec:
  accessModes:
    - ReadWriteMany
  capacity:
    storage: 10Gi
  csi:
    driver: ossplugin.csi.alibabacloud.com
    nodePublishSecretRef:
      name: ack-oss-key
      namespace: service-zookeeper
    volumeAttributes:
      bucket: xxx-test
      otherOpts: '-o umask=000 -o allow_other'
      path: /test/zookeeper/zookeeper-2/
      url: oss-xxx
    volumeHandle: zookeeper-pv-2
  persistentVolumeReclaimPolicy: Retain
  storageClassName: zookeeper-storage
  volumeMode: Filesystem
---
apiVersion: v1
kind: PersistentVolume
metadata:
  labels:
    alicloud-pvname: zookeeper-pv-3
  name: zookeeper-pv-3
spec:
  accessModes:
    - ReadWriteMany
  capacity:
    storage: 10Gi
  csi:
    driver: ossplugin.csi.alibabacloud.com
    nodePublishSecretRef:
      name: ack-oss-key
      namespace: service-zookeeper
    volumeAttributes:
      bucket: xxx-test
      otherOpts: '-o umask=000 -o allow_other'
      path: /test/zookeeper/zookeeper-3/
      url: oss-xxx
    volumeHandle: zookeeper-pv-3
  persistentVolumeReclaimPolicy: Retain
  storageClassName: zookeeper-storage
  volumeMode: Filesystem

参考网站：https://kubernetes.io/zh-cn/docs/tutorials/stateful-application/zookeeper/