node 节点 kubelet 无法启动

Mar 19 13:09:21 node01 kubelet: F0319 13:09:21.542653   72843 server.go:269] failed to run Kubelet: misconfiguration: kubelet cgroup driver: "systemd" is different from docker cgroup driver: "cgroupfs"
Mar 19 13:09:21 node01 kubelet: goroutine 1 [running]:
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/k8s.io/klog/v2.stacks(0xc00012a001, 0xc000194a00, 0xaa, 0xfc)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1026 +0xb9
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).output(0x70c7460, 0xc000000003, 0x0, 0x0, 0xc000d5a230, 0x6f32a12, 0x9, 0x10d, 0x411b00)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:975 +0x19b
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printDepth(0x70c7460, 0xc000000003, 0x0, 0x0, 0x0, 0x0, 0x1, 0xc0001d9210, 0x1, 0x1)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:732 +0x16f
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).print(...)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:714
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/k8s.io/klog/v2.Fatal(...)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1482
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/cmd/kubelet/app.NewKubeletCommand.func1(0xc0000318c0, 0xc000120190, 0x5, 0x5)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubelet/app/server.go:269 +0x845
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute(0xc0000318c0, 0xc000120190, 0x5, 0x5, 0xc0000318c0, 0xc000120190)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:854 +0x2c2
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc0000318c0, 0x182e1c101b367303, 0x70c7020, 0x409b25)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:958 +0x375
Mar 19 13:09:21 node01 systemd: kubelet.service: main process exited, code=exited, status=255/n/a
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute(...)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:895
Mar 19 13:09:21 node01 kubelet: main.main()
Mar 19 13:09:21 node01 kubelet: _output/dockerized/go/src/k8s.io/kubernetes/cmd/kubelet/kubelet.go:41 +0xe5
Mar 19 13:09:21 node01 kubelet: goroutine 19 [chan receive]:
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).flushDaemon(0x70c7460)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1169 +0x8b
Mar 19 13:09:21 node01 kubelet: created by k8s.io/kubernetes/vendor/k8s.io/klog/v2.init.0
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:417 +0xdf
Mar 19 13:09:21 node01 kubelet: goroutine 81 [chan receive]:
Mar 19 13:09:21 node01 kubelet: k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server.SetupSignalContext.func1(0xc0001d8100)
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/signal.go:48 +0x36
Mar 19 13:09:21 node01 kubelet: created by k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server.SetupSignalContext
Mar 19 13:09:21 node01 kubelet: /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/signal.go:47 +0xf3
Mar 19 13:09:21 node01 kubelet: goroutine 162 [select]:

其中这条是关键报错：

failed to run Kubelet: misconfiguration: kubelet cgroup driver: "systemd" is different from docker cgroup driver: "cgroupfs“

原因：

这条日志明确指出了问题的根源：kubelet 配置的 cgroup driver 是 systemd，而 Docker 配置的 cgroup driver 是 cgroupfs。Kubernetes 要求 kubelet 和 Docker 的 cgroup driver 必须一致。

1、 查看 kubelet 配置文件（如 /var/lib/kubelet/config.yaml），过滤 cgroupDriver 字段，看值是 cgroupfs 还是 systemd,

#cat /var/lib/kubelet/config.yaml |grep cgroupDriver
cgroupDriver: systemd

2、如果是 systemd ，docker 配置也需要添加 "exec-opts": ["native.cgroupdriver=systemd"]

at /etc/docker/daemon.json 
{
  "registry-mirrors": ["https://*******"],#镜像加速地址
  "exec-opts": ["native.cgroupdriver=systemd"]
}

3、重装配置，重启服务,查看状态

systemctl daemon-reload
systemctl restart docker kubelet
systemctl status docker kubelet