都是3个master服务器都需要操作的
1.生成证书
cat > /etc/ssl/kube-controller-manager/kube-controller-manager-csr.json <<EOF{
"CN": "system:kube-controller-manager",
"key": {
"algo": "rsa",
"size": 2048
},
"hosts": [
"127.0.0.1",
"192.168.1.40",
"192.168.1.41",
"192.168.1.42"
],
"names": [
{
"C": "CN",
"ST": "ChengDu",
"L": "ChengDu",
"O": "system:kube-controller-manager",
"OU": "dessler"
}
]
}
EOF复制代码
cfssl gencert -ca=/etc/ssl/ca.pem \
-ca-key=/etc/ssl/ca-key.pem \
-config=/etc/ssl/ca-config.json \
-profile=kubernetes kube-controller-manager-csr.json | cfssljson -bare kube-controller-manager复制代码
2.创建kubeconfig 文件
kubectl config set-cluster kubernetes \
--certificate-authority=/etc/ssl/ca.pem \
--embed-certs=true \
--server=https://192.168.1.43:8443 \
--kubeconfig=kube-controller-manager.kubeconfig
Cluster "kubernetes" set.
复制代码
kubectl config set-credentials system:kube-controller-manager \
--client-certificate=/etc/ssl/kube-controller-manager/kube-controller-manager.pem \
--client-key=/etc/ssl/kube-controller-manager/kube-controller-manager-key.pem \
--embed-certs=true \
--kubeconfig=kube-controller-manager.kubeconfig
User "system:kube-controller-manager" set.
复制代码
kubectl config set-context system:kube-controller-manager \
--cluster=kubernetes \
--user=system:kube-controller-manager \
--kubeconfig=kube-controller-manager.kubeconfig
Context "system:kube-controller-manager" created.
复制代码
kubectl config use-context system:kube-controller-manager --kubeconfig=kube-controller-manager.kubeconfig
Switched to context "system:kube-controller-manager".
复制代码
3.分发配置文件证书二进制文件
#分发路径,为了后面的服务调用
/opt/kubernetes/cfg/复制代码
4.配置kube-controller-manager服务
cat > /usr/lib/systemd/system/kube-controller-manager.service <<EOF
[Unit]
Description=Kubernetes Controller Manager
Documentation=https://github.com/GoogleCloudPlatform/kubernetes
[Service]
ExecStart=/opt/kubernetes/bin/kube-controller-manager \\
--port=0 \\
--secure-port=10252 \\
--bind-address=127.0.0.1 \\
--kubeconfig=/opt/kubernetes/cfg/kube-controller-manager.kubeconfig \\
--service-cluster-ip-range=10.254.0.0/16 \\
--cluster-name=kubernetes \\
--cluster-signing-cert-file=/etc/ssl/ca.pem \\
--cluster-signing-key-file=/etc/ssl/ca-key.pem \\
--experimental-cluster-signing-duration=8760h \\
--root-ca-file=/etc/ssl/ca.pem \\
--service-account-private-key-file=/etc/ssl/ca-key.pem \\
--leader-elect=true \\
--feature-gates=RotateKubeletServerCertificate=true \\
--controllers=*,bootstrapsigner,tokencleaner \\
--horizontal-pod-autoscaler-use-rest-clients=true \\
--horizontal-pod-autoscaler-sync-period=10s \\
--tls-cert-file=/etc/ssl/kube-controller-manager/kube-controller-manager.pem \\
--tls-private-key-file=/etc/ssl/kube-controller-manager/kube-controller-manager-key.pem \\
--use-service-account-credentials=true \\
--alsologtostderr=true \\
--logtostderr=false \\
--log-dir=/var/log/kubernetes \\
--v=2
Restart=on
Restart=on-failure
RestartSec=5
#User=k8s
[Install]
WantedBy=multi-user.target
EOF
复制代码
- 说明:
- --port=0:关闭监听 http /metrics 的请求,同时--address 参数无效,--bind-address 参数有效;
- --secure-port=10252、--bind-address=0.0.0.0: 在所有网络接口监听 10252 端口的 https /metrics 请求
- --kubeconfig:指定 kubeconfig 文件路径,kube-controller-manager 使用它连接和验证 kube-apiserver
- --cluster-signing-*-file:签名 TLS Bootstrap 创建的证书
- --experimental-cluster-signing-duration:指定 TLS Bootstrap 证书的有效期
- --root-ca-file:放置到容器 ServiceAccount 中的 CA 证书,用来对 kube-apiserver 的证书进行校验
- --service-account-private-key-file:签名 ServiceAccount 中 Token 的私钥文件,必须和 kube-apiserver 的--service-account-key-file 指定的公钥文件配对使用
- --service-cluster-ip-range :指定 Service Cluster IP 网段,必须和 kube-apiserver 中的同名参数一致
- --leader-elect=true:集群运行模式,启用选举功能;被选为 leader 的节点负责处理工作,其它节点为阻塞状态
- --feature-gates=RotateKubeletServerCertificate=true:开启 kublet server 证书的自动更新特性
- --controllers=*,bootstrapsigner,tokencleaner:启用的控制器列表,tokencleaner 用于自动清理过期的 Bootstrap token
- --horizontal-pod-autoscaler-*:custom metrics 相关参数,支持 autoscaling/v2alpha1
- --tls-cert-file、--tls-private-key-file:使用 https 输出 metrics 时使用的 Server 证书和秘钥
- --use-service-account-credentials=true:
- User=k8s:使用 k8s 账户运行
- kube-controller-manager 不对请求 https metrics 的 Client 证书进行校验,故不需要指定--tls-ca-file 参数,而且该参数已被淘汰
5.启动服务
ystemctl daemon-reload
systemctl enable kube-controller-manager
systemctl restart kube-controller-manager
systemctl status kube-controller-manager
复制代码
6.检查服务状态
kubectl get endpoints kube-controller-manager --namespace=kube-system -o yaml
apiVersion: v1
kind: Endpoints
metadata:
annotations:
control-plane.alpha.kubernetes.io/leader: '{"holderIdentity":"host40_ad80b214-301e-11e9-9e4e-525400a2fd4d","leaseDurationSeconds":15,"acquireTime":"2019-02-14T06:06:32Z","renewTime":"2019-02-14T06:10:11Z","leaderTransitions":0}'
creationTimestamp: "2019-02-14T06:06:32Z"
name: kube-controller-manager
namespace: kube-system
resourceVersion: "931"
selfLink: /api/v1/namespaces/kube-system/endpoints/kube-controller-manager
uid: ad841617-301e-11e9-9b82-5254006b7ed6
复制代码
curl -s --cacert /etc/ssl/ca.pem https://127.0.0.1:10252/metrics
复制代码