Kubernetes重启kubelet服务异常:kubelet.service异常退出,错误代码=exited,状态=/FAILURE

480 篇文章 ¥59.90 ¥99.00
本文探讨了Kubernetes集群中kubelet服务异常退出的常见原因,如配置错误、系统组件问题、资源不足等,并提供了查看日志、重启服务、检查配置文件等调试方法。同时,建议使用kubectl等工具进行集群监控和管理,以及在必要时重新安装kubelet软件包。

Kubernetes重启kubelet服务异常:kubelet.service异常退出,错误代码=exited,状态=/FAILURE

在Kubernetes集群管理中,kubelet服务是一个非常关键的组件,负责管理单个节点上的容器化工作负载。然而,有时候我们可能会遇到kubelet服务异常退出的问题,这可能导致节点无法正常工作。本文将针对此问题展开讨论,并提供相应的源代码示例。

首先,我们需要了解一些常见的kubelet服务异常退出的原因。其中一种常见情况是kubelet服务配置错误,比如配置文件中出现了错误的参数或者缺失了必要的参数。另外,如果Kubernetes节点上的系统组件出现了问题,也可能导致kubelet服务异常退出。此外,磁盘空间不足、内存不足、网络故障以及其他底层资源问题也可能引发该问题。

为了解决这个问题,我们可以采取一些常用的调试步骤和方法。首先,我们可以检查kubelet服务的日志文件,通常位于/var/log/kubelet.log路径下。日志文件中可能包含有关出错原因的详细信息,例如具体的错误消息或堆栈跟踪。通过查看日志,我们可以初步判断问题所在,进而采取相应的措施。

除了查看日志,我们还可以尝试通过重启kubelet服务来解决问题。在大多数Linux发行版中,我们可以使用systemctl命令来管理系统服务。下面是一个重启kubelet服务的示例命令:

sudo systemctl restart kubelet

执行该命令后,系统会尝试重新启动kubelet服务。如果服务能够成功启动并正常运行,那么问题可能已经解决。但是,如果重启过程中出现错误,我们需要

8月 14 20:38:51 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:38:51 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. 8月 14 20:39:01 localhost.localdomain systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 63. 8月 14 20:39:01 localhost.localdomain systemd[1]: Started kubelet: The Kubernetes Node Agent. 8月 14 20:39:01 localhost.localdomain (kubelet)[35711]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_KUBEADM_ARGS 8月 14 20:39:01 localhost.localdomain kubelet[35711]: E0814 20:39:01.509470 35711 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" 8月 14 20:39:01 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:39:01 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. 8月 14 20:39:11 localhost.localdomain systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 64. 8月 14 20:39:11 localhost.localdomain systemd[1]: Started kubelet: The Kubernetes Node Agent. 8月 14 20:39:11 localhost.localdomain (kubelet)[35780]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_KUBEADM_ARGS 8月 14 20:39:11 localhost.localdomain kubelet[35780]: E0814 20:39:11.765548 35780 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" 8月 14 20:39:11 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:39:11 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. 8月 14 20:39:21 localhost.localdomain systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 65. 8月 14 20:39:21 localhost.localdomain systemd[1]: Started kubelet: The Kubernetes Node Agent. 8月 14 20:39:21 localhost.localdomain (kubelet)[35852]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_KUBEADM_ARGS 8月 14 20:39:22 localhost.localdomain kubelet[35852]: E0814 20:39:22.005231 35852 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" 8月 14 20:39:22 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:39:22 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. 8月 14 20:39:32 localhost.localdomain systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 66. 8月 14 20:39:32 localhost.localdomain systemd[1]: Started kubelet: The Kubernetes Node Agent. 8月 14 20:39:32 localhost.localdomain (kubelet)[35923]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_KUBEADM_ARGS 8月 14 20:39:32 localhost.localdomain kubelet[35923]: E0814 20:39:32.263622 35923 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" 8月 14 20:39:32 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:39:32 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. 8月 14 20:39:42 localhost.localdomain systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 67. 8月 14 20:39:42 localhost.localdomain systemd[1]: Started kubelet: The Kubernetes Node Agent. 8月 14 20:39:42 localhost.localdomain (kubelet)[35993]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_KUBEADM_ARGS 8月 14 20:39:42 localhost.localdomain kubelet[35993]: E0814 20:39:42.510408 35993 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" 8月 14 20:39:42 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:39:42 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. 8月 14 20:39:52 localhost.localdomain systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 68. 8月 14 20:39:52 localhost.localdomain systemd[1]: Started kubelet: The Kubernetes Node Agent. 8月 14 20:39:52 localhost.localdomain (kubelet)[36068]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_KUBEADM_ARGS 8月 14 20:39:52 localhost.localdomain kubelet[36068]: E0814 20:39:52.764578 36068 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" 8月 14 20:39:52 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:39:52 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. 8月 14 20:40:02 localhost.localdomain systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 69. 8月 14 20:40:02 localhost.localdomain systemd[1]: Started kubelet: The Kubernetes Node Agent. 8月 14 20:40:02 localhost.localdomain (kubelet)[36137]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_KUBEADM_ARGS 8月 14 20:40:03 localhost.localdomain kubelet[36137]: E0814 20:40:03.018209 36137 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" 8月 14 20:40:03 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:40:03 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. 8月 14 20:40:13 localhost.localdomain systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 70. 8月 14 20:40:13 localhost.localdomain systemd[1]: Started kubelet: The Kubernetes Node Agent. 8月 14 20:40:13 localhost.localdomain (kubelet)[36207]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_KUBEADM_ARGS 8月 14 20:40:13 localhost.localdomain kubelet[36207]: E0814 20:40:13.263321 36207 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" 8月 14 20:40:13 localhost.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE 8月 14 20:40:13 localhost.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'.
08-15
[root@ex2 ~]# kubeadm config print init-defaults > kubeadm-config.yaml [root@ex2 ~]# vim /etc/kubernetes/ manifests/ pki/ [root@ex2 ~]# ls anaconda-ks.cfg kubeadm-config.yaml.bak kube-install pause-3.6.tar.gz pull_images.sh kubeadm-config.yaml kubeadm.yaml kube-install-allinone-v0.9.0.tgz pull_image.sh pull_k8s_images.sh [root@ex2 ~]# vim kubeadm-config.yaml [root@ex2 ~]# kubeadm init phase kubelet-start --config /etc/kuber^Ctes/kubeadm-config.yaml [root@ex2 ~]# cp -a kubeadm-config.yaml /etc/kubernetes/ [root@ex2 ~]# ls^C [root@ex2 ~]# kubeadm init phase kubelet-start --config /etc/kubernetes/kubeadm-config.yaml [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet-start] Starting the kubelet [root@ex2 ~]# vim /var/lib/kubelet/config.yaml [root@ex2 ~]# cat /var/lib/kubelet/config.yaml apiVersion: kubelet.config.k8s.io/v1beta1 authentication: anonymous: enabled: false webhook: cacheTTL: 0s enabled: true x509: clientCAFile: /etc/kubernetes/pki/ca.crt authorization: mode: Webhook webhook: cacheAuthorizedTTL: 0s cacheUnauthorizedTTL: 0s cgroupDriver: systemd clusterDNS: - 10.96.0.10 clusterDomain: cluster.local containerRuntimeEndpoint: "" cpuManagerReconcilePeriod: 0s evictionPressureTransitionPeriod: 0s fileCheckFrequency: 0s healthzBindAddress: 127.0.0.1 healthzPort: 10248 httpCheckFrequency: 0s imageMaximumGCAge: 0s imageMinimumGCAge: 0s kind: KubeletConfiguration logging: flushFrequency: 0 options: json: infoBufferSize: "0" verbosity: 0 memorySwap: {} nodeStatusReportFrequency: 0s nodeStatusUpdateFrequency: 0s rotateCertificates: true runtimeRequestTimeout: 0s shutdownGracePeriod: 0s shutdownGracePeriodCriticalPods: 0s staticPodPath: /etc/kubernetes/manifests streamingConnectionIdleTimeout: 0s syncFrequency: 0s volumeStatsAggPeriod: 0s [root@ex2 ~]# systemctl daemon-reload && systemctl restart kubelet [root@ex2 ~]# journalctl -u kubelet -n 50 --no-pager -- Logs begin at Tue 2025-05-06 11:12:05 CST, end at Tue 2025-05-13 10:18:45 CST. -- May 13 10:17:36 ex2.orange.com systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE May 13 10:17:36 ex2.orange.com systemd[1]: kubelet.service: Failed with result 'exit-code'. May 13 10:17:47 ex2.orange.com systemd[1]: kubelet.service: Service RestartSec=10s expired, scheduling restart. May 13 10:17:47 ex2.orange.com systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 421. May 13 10:17:47 ex2.orange.com systemd[1]: Stopped kubelet: The Kubernetes Node Agent. May 13 10:17:47 ex2.orange.com systemd[1]: Started kubelet: The Kubernetes Node Agent. May 13 10:17:47 ex2.orange.com kubelet[6480]: E0513 10:17:47.121328 6480 run.go:74] "command failed" err="failed to construct kubelet dependencies: unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory" May 13 10:17:47 ex2.orange.com systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE May 13 10:17:47 ex2.orange.com systemd[1]: kubelet.service: Failed with result 'exit-code'. May 13 10:17:57 ex2.orange.com systemd[1]: kubelet.service: Service RestartSec=10s expired, scheduling restart. May 13 10:17:57 ex2.orange.com systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 422. May 13 10:17:57 ex2.orange.com systemd[1]: Stopped kubelet: The Kubernetes Node Agent. May 13 10:17:57 ex2.orange.com systemd[1]: Started kubelet: The Kubernetes Node Agent. May 13 10:17:57 ex2.orange.com kubelet[6490]: E0513 10:17:57.369462 6490 run.go:74] "command failed" err="failed to construct kubelet dependencies: unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory" May 13 10:17:57 ex2.orange.com systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE May 13 10:17:57 ex2.orange.com systemd[1]: kubelet.service: Failed with result 'exit-code'. May 13 10:18:07 ex2.orange.com systemd[1]: kubelet.service: Service RestartSec=10s expired, scheduling restart. May 13 10:18:07 ex2.orange.com systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 423. May 13 10:18:07 ex2.orange.com systemd[1]: Stopped kubelet: The Kubernetes Node Agent. May 13 10:18:07 ex2.orange.com systemd[1]: Started kubelet: The Kubernetes Node Agent. May 13 10:18:07 ex2.orange.com kubelet[6499]: E0513 10:18:07.620902 6499 run.go:74] "command failed" err="failed to construct kubelet dependencies: unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory" May 13 10:18:07 ex2.orange.com systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE May 13 10:18:07 ex2.orange.com systemd[1]: kubelet.service: Failed with result 'exit-code'. May 13 10:18:17 ex2.orange.com systemd[1]: kubelet.service: Service RestartSec=10s expired, scheduling restart. May 13 10:18:17 ex2.orange.com systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 424. May 13 10:18:17 ex2.orange.com systemd[1]: Stopped kubelet: The Kubernetes Node Agent. May 13 10:18:17 ex2.orange.com systemd[1]: Started kubelet: The Kubernetes Node Agent. May 13 10:18:17 ex2.orange.com kubelet[6509]: E0513 10:18:17.871088 6509 run.go:74] "command failed" err="failed to construct kubelet dependencies: unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory" May 13 10:18:17 ex2.orange.com systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE May 13 10:18:17 ex2.orange.com systemd[1]: kubelet.service: Failed with result 'exit-code'. May 13 10:18:28 ex2.orange.com systemd[1]: kubelet.service: Service RestartSec=10s expired, scheduling restart. May 13 10:18:28 ex2.orange.com systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 425. May 13 10:18:28 ex2.orange.com systemd[1]: Stopped kubelet: The Kubernetes Node Agent. May 13 10:18:28 ex2.orange.com systemd[1]: Started kubelet: The Kubernetes Node Agent. May 13 10:18:28 ex2.orange.com kubelet[6518]: E0513 10:18:28.119819 6518 run.go:74] "command failed" err="failed to construct kubelet dependencies: unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory" May 13 10:18:28 ex2.orange.com systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE May 13 10:18:28 ex2.orange.com systemd[1]: kubelet.service: Failed with result 'exit-code'. May 13 10:18:38 ex2.orange.com systemd[1]: kubelet.service: Service RestartSec=10s expired, scheduling restart. May 13 10:18:38 ex2.orange.com systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 426. May 13 10:18:38 ex2.orange.com systemd[1]: Stopped kubelet: The Kubernetes Node Agent. May 13 10:18:38 ex2.orange.com systemd[1]: Started kubelet: The Kubernetes Node Agent. May 13 10:18:38 ex2.orange.com kubelet[6527]: E0513 10:18:38.371683 6527 run.go:74] "command failed" err="failed to construct kubelet dependencies: unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory" May 13 10:18:38 ex2.orange.com systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE May 13 10:18:38 ex2.orange.com systemd[1]: kubelet.service: Failed with result 'exit-code'. May 13 10:18:45 ex2.orange.com systemd[1]: /etc/systemd/system/kubelet.service.d/10-kubeadm.conf:7: Unknown lvalue '--node-ip' in section 'Service' May 13 10:18:45 ex2.orange.com systemd[1]: Stopped kubelet: The Kubernetes Node Agent. May 13 10:18:45 ex2.orange.com systemd[1]: Started kubelet: The Kubernetes Node Agent. May 13 10:18:45 ex2.orange.com kubelet[6557]: E0513 10:18:45.449971 6557 run.go:74] "command failed" err="failed to construct kubelet dependencies: unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory" May 13 10:18:45 ex2.orange.com systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE May 13 10:18:45 ex2.orange.com systemd[1]: kubelet.service: Failed with result 'exit-code'. [root@ex2 ~]# netstat -tulnp | grep kube-apiserver [root@ex2 ~]#
05-14
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值