基于cobra开发的k8s命令行管理工具k8s-manager

已于 2025-01-21 09:29:45 修改
阅读量894 收藏 14
点赞数 23
文章标签： kubernetes 容器 云原生
于 2024-12-22 15:46:23 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.youkuaiyun.com/Drosssse/article/details/144645642
版权

基于cobra开发的k8s命令行管理工具k8s-manager

如果觉得好用，麻烦给个Star!

项目介绍：Github地址 ，代码已开源

  • https://github.com/qinlang258/cobra-k8s-manager/tree/main
  • 脚本下载地址 https://github.com/qinlang258/cobra-k8s-manager/releases/ 选择v1.0.3版本
  • k8s-manager管理工具，fsnotify监听 /root/.kube/config的变化来修改 prometheus.yaml配置文件
  • 新增导出excel的功能

该命令有以下几个功能：analysis，image，node，resource，top，config
使用 方法：下载项目github空间下,使用k8s-manager即可，无需进行额外配置，使用k8s-manager config获取在/root/.kube/文件夹下的yaml文件生成用于调用prometheus的配置文件。如果需要调用prometheus监控信息，可手动调整 /root/.kube/jcrose-prometheus/prometheus.yaml

jcrose的k8s管理工具，功能涵盖如下
        1 analysis 分析某一节点的资源使用情况，类似于describe node xxx
        2 config 生成 /root/.kube/jcrose-prometheus/prometheus.yaml 配置文件，获取默认路径/root/.kube/下的yaml文件导入prometheus的地址
        3 image 获取镜像地址
        4 node 获取所有node节点的信息
        5 resource 获取pod所使用的 limit与requests 与java_opts的环境变量，可以加上-p获取对应集群的最近7天平均内存和CPU数值
        6 获取容器的实际使用资源开销

Usage:
  k8s-manager [flags]
  k8s-manager [command]

Available Commands:
  analysis    分析某一节点的资源使用情况
  completion  Generate the autocompletion script for the specified shell
  config      初始化prometheus配置文件
  help        Help about any command
  image       获取镜像信息
  node        获取节点的资源信息
  resource    获取pod资源的相关 Limit与Resource信息
  top         获取容器的实际使用资源开销

Flags:
      --export              是否输出Excel?默认不输出
  -h, --help                help for k8s-manager
      --kubeconfig string   请输入 kubeconfig的文件路径 (default "/root/.kube/config")

Use "k8s-manager [command] --help" for more information about a command.

通用配置

  • 所有命令均可附带 --kubeconfig指定配置文件
    ./k8s-manager --kubeconfig <指定使用的k8s配置文件>

  • 可以输入 --export导出当前的内容生成excel

  • 监听因切换集群导致的/root/.kube/config变化。
    执行了该命令之后切换集群导致的config变化，使prometheus.yaml 的/root/.kube/config字段对应的prometheus地址产生同样的变化
    nohup pkg/fsnotify/fsnotify & 也可以在github下载 fsnotify 这个文件

1 node 分析所有node的资源情况

示例代码

1 获取所有节点的资源信息
./k8s-manager node

示例代码

root@k8s:/usr/local/cobra-k8s-manager# k8s-manager node
+--------+----------------+--------------------+-------------+---------------------------+-------------+-----------+-------------------------+--------------+------------+--------------------------+
| 节点名 |     节点IP     |       OS镜像       | KUBELET版本 | CONTAINER RUNTIME VERSION | 已使用的CPU | CPU总大小 | CPU使用占服务器的百分比 | 已使用的内存 | 内存总大小 | 内存使用占服务器的百分比 |
+--------+----------------+--------------------+-------------+---------------------------+-------------+-----------+-------------------------+--------------+------------+--------------------------+
| k8s    | 192.168.44.134 | Ubuntu 22.04.4 LTS | v1.26.7     | containerd://1.6.8        | 363.00m     | 8000m     | 4.54%                   | 6585.25Mi    | 7901.89Mi  | 83.34%                   |
+--------+----------------+--------------------+-------------+---------------------------+-------------+-----------+-------------------------+--------------+------------+--------------------------+

2 analysis 分析Node节点上的资源使用构成

1 分析指定节点上的所有容器的资源开销
./k8s-manager analysis --node <节点名>

示例代码

root@k8s:/usr/local/cobra-k8s-manager# k8s-manager analysis --node k8s
E1222 05:55:41.502661   75816 analysis.go:46] context.BackgroundError fetching metrics for pod ingress-nginx-admission-create-r24ff: pods "ingress-nginx-admission-create-r24ff" not found
E1222 05:55:41.504124   75816 analysis.go:46] context.BackgroundError fetching metrics for pod ingress-nginx-admission-patch-w5gnn: pods "ingress-nginx-admission-patch-w5gnn" not found
+--------+---------------+--------------------------------------------------+---------------------------------+-----------------+-------------------------+------------------+--------------------------+
| 节点名 |   NAMESPACE   |                     POD NAME                     |             容器名              | 当前已使用的CPU | CPU使用占服务器的百分比 | 当前已使用的内存 | 内存使用占服务器的百分比 |
+--------+---------------+--------------------------------------------------+---------------------------------+-----------------+-------------------------+------------------+--------------------------+
| k8s    | kube-system   | kube-apiserver-k8s                               | kube-apiserver                  | 35.00m          | 0.44%                   | 492.68m          | 6.24%                    |
| k8s    | monitoring    | prometheus-k8s-0                                 | prometheus                      | 10.00m          | 0.12%                   | 383.23m          | 4.85%                    |
| k8s    | monitoring    | prometheus-k8s-1                                 | prometheus                      | 17.00m          | 0.21%                   | 342.59m          | 4.34%                    |
| k8s    | ingress-nginx | ingress-nginx-controller-f87d69b54-t8kd8         | controller                      | 1.00m           | 0.01%                   | 166.57m          | 2.11%                    |
| k8s    | monitoring    | grafana-9bb74449d-8m8xl                          | grafana                         | 4.00m           | 0.05%                   | 134.36m          | 1.70%                    |
| k8s    | kube-system   | calico-node-7zbfk                                | calico-node                     | 24.00m          | 0.30%                   | 102.68m          | 1.30%                    |
| k8s    | kube-system   | etcd-k8s                                         | etcd                            | 18.00m          | 0.22%                   | 86.12m           | 1.09%                    |
| k8s    | kube-system   | kube-controller-manager-k8s                      | kube-controller-manager         | 11.00m          | 0.14%                   | 85.29m           | 1.08%                    |
| k8s    | monitoring    | prometheus-adapter-854d95bc45-pvfh7              | prometheus-adapter              | 3.00m           | 0.04%                   | 58.35m           | 0.74%                    |
| k8s    | monitoring    | prometheus-operator-57cf88fbcb-wks8t             | prometheus-operator             | 1.00m           | 0.01%                   | 45.33m           | 0.57%                    |
| k8s    | kube-system   | coredns-5bbd96d687-x9qmp                         | coredns                         | 2.00m           | 0.03%                   | 43.17m           | 0.55%                    |
| k8s    | kube-system   | metrics-server-7d5c696976-wlms5                  | metrics-server                  | 3.00m           | 0.04%                   | 38.56m           | 0.49%                    |
| k8s    | kube-system   | kube-scheduler-k8s                               | kube-scheduler                  | 2.00m           | 0.03%                   | 35.71m           | 0.45%                    |
| k8s    | monitoring    | node-exporter-6cqz8                              | kube-rbac-proxy                 | 1.00m           | 0.01%                   | 34.83m           | 0.44%                    |
| k8s    | monitoring    | kube-state-metrics-79996cfcc5-5286s              | kube-state-metrics              | 1.00m           | 0.01%                   | 33.56m           | 0.42%                    |
| k8s    | kube-system   | calico-kube-controllers-57b57c56f-d5p6n          | calico-kube-controllers         | 1.00m           | 0.01%                   | 31.89m           | 0.40%                    |
| k8s    | monitoring    | prometheus-adapter-854d95bc45-tz822              | prometheus-adapter              | 3.00m           | 0.04%                   | 30.73m           | 0.39%                    |
| k8s    | kube-system   | kube-proxy-nb9tq                                 | kube-proxy                      | 1.00m           | 0.01%                   | 29.99m           | 0.38%                    |
| k8s    | monitoring    | alertmanager-main-1                              | alertmanager                    | 2.00m           | 0.03%                   | 29.04m           | 0.37%                    |
| k8s    | kube-system   | coredns-5bbd96d687-thl59                         | coredns                         | 2.00m           | 0.03%                   | 29.00m           | 0.37%                    |
| k8s    | monitoring    | alertmanager-main-0                              | alertmanager                    | 2.00m           | 0.03%                   | 27.72m           | 0.35%                    |
| k8s    | monitoring    | alertmanager-main-2                              | alertmanager                    | 2.00m           | 0.03%                   | 27.71m           | 0.35%                    |
| k8s    | monitoring    | alertmanager-main-0                              | config-reloader                 | 0.00m           | 0.00%                   | 22.56m           | 0.29%                    |
| k8s    | monitoring    | blackbox-exporter-59dddb7bb6-8lp69               | blackbox-exporter               | 1.00m           | 0.01%                   | 21.18m           | 0.27%                    |
| k8s    | monitoring    | prometheus-k8s-1                                 | config-reloader                 | 1.00m           | 0.01%                   | 20.79m           | 0.26%                    |
| k8s    | monitoring    | alertmanager-main-1                              | config-reloader                 | 1.00m           | 0.01%                   | 20.40m           | 0.26%                    |
| k8s    | monitoring    | prometheus-k8s-0                                 | config-reloader                 | 0.00m           | 0.00%                   | 20.16m           | 0.26%                    |
| k8s    | monitoring    | alertmanager-main-2                              | config-reloader                 | 1.00m           | 0.01%                   | 18.77m           | 0.24%                    |
| k8s    | nfs           | nfs-subdir-external-provisioner-65664b8954-qrs2q | nfs-subdir-external-provisioner | 1.00m           | 0.01%                   | 17.30m           | 0.22%                    |
| k8s    | monitoring    | node-exporter-6cqz8                              | node-exporter                   | 13.00m          | 0.16%                   | 15.90m           | 0.20%                    |
| k8s    | monitoring    | kube-state-metrics-79996cfcc5-5286s              | kube-rbac-proxy-main            | 1.00m           | 0.01%                   | 9.80m            | 0.12%                    |
| k8s    | monitoring    | prometheus-operator-57cf88fbcb-wks8t             | kube-rbac-proxy                 | 1.00m           | 0.01%                   | 9.67m            | 0.12%                    |
| k8s    | monitoring    | blackbox-exporter-59dddb7bb6-8lp69               | kube-rbac-proxy                 | 1.00m           | 0.01%                   | 9.62m            | 0.12%                    |
| k8s    | monitoring    | kube-state-metrics-79996cfcc5-5286s              | kube-rbac-proxy-self            | 1.00m           | 0.01%                   | 9.15m            | 0.12%                    |
| k8s    | monitoring    | blackbox-exporter-59dddb7bb6-8lp69               | module-configmap-reloader       | 0.00m           | 0.00%                   | 4.00m            | 0.05%                    |
+--------+---------------+--------------------------------------------------+---------------------------------+-----------------+-------------------------+------------------+--------------------------+

3 image 获取指定namespace的所有镜像地址

示例代码

1 获取所有namespace的镜像地址  
./k8s-manager image  
2 获取指定namespace的镜像地址
./k8s-manager image -n <namespace>

示例代码

root@k8s:/usr/local/cobra-k8s-manager# k8s-manager image
+---------------+--------------+---------------------------------+---------------------------------+---------------------------------------------------------------------------------+
|   NAMESPACE   |   资源类型   |             资源名              |             容器名              |                                    镜像地址                                     |
+---------------+--------------+---------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| ingress-nginx | deployment   | ingress-nginx-controller        | controller                      | registry.cn-zhangjiakou.aliyuncs.com/jcrose-k8s/ingress-nginx-controller:v1.7.0 |
| kube-system   | deployment   | calico-kube-controllers         | calico-kube-controllers         | docker.io/calico/kube-controllers:v3.25.0                                       |
| kube-system   | deployment   | coredns                         | coredns                         | registry.aliyuncs.com/google_containers/coredns:v1.9.3                          |
| kube-system   | deployment   | metrics-server                  | metrics-server                  | k8s.dockerproxy.net/metrics-server/metrics-server:v0.7.2                        |
| kube-system   | daemonsets   | calico-node                     | calico-node                     | docker.io/calico/node:v3.25.0                                                   |
| kube-system   | daemonsets   | kube-proxy                      | kube-proxy                      | registry.aliyuncs.com/google_containers/kube-proxy:v1.26.7                      |
| monitoring    | deployment   | blackbox-exporter               | blackbox-exporter               | quay.io/prometheus/blackbox-exporter:v0.24.0                                    |
| monitoring    | deployment   | blackbox-exporter               | module-configmap-reloader       | jimmidyson/configmap-reload:v0.5.0                                              |
| monitoring    | deployment   | blackbox-exporter               | kube-rbac-proxy                 | quay.io/brancz/kube-rbac-proxy:v0.14.2                                          |
| monitoring    | deployment   | grafana                         | grafana                         | grafana/grafana:9.5.3                                                           |
| monitoring    | deployment   | kube-state-metrics              | kube-state-metrics              | bitnami/kube-state-metrics:2.9.2                                                |
| monitoring    | deployment   | kube-state-metrics              | kube-rbac-proxy-main            | quay.io/brancz/kube-rbac-proxy:v0.14.2                                          |
| monitoring    | deployment   | kube-state-metrics              | kube-rbac-proxy-self            | quay.io/brancz/kube-rbac-proxy:v0.14.2                                          |
| monitoring    | deployment   | prometheus-adapter              | prometheus-adapter              | xuxiaoweicomcn/prometheus-adapter:v0.11.1                                       |
| monitoring    | deployment   | prometheus-operator             | prometheus-operator             | quay.io/prometheus-operator/prometheus-operator:v0.67.1                         |
| monitoring    | deployment   | prometheus-operator             | kube-rbac-proxy                 | quay.io/brancz/kube-rbac-proxy:v0.14.2                                          |
| monitoring    | statefulsets | alertmanager-main               | alertmanager                    | quay.io/prometheus/alertmanager:v0.26.0                                         |
| monitoring    | statefulsets | alertmanager-main               | config-reloader                 | quay.io/prometheus-operator/prometheus-config-reloader:v0.67.1                  |
| monitoring    | statefulsets | prometheus-k8s                  | prometheus                      | quay.io/prometheus/prometheus:v2.46.0                                           |
| monitoring    | statefulsets | prometheus-k8s                  | config-reloader                 | quay.io/prometheus-operator/prometheus-config-reloader:v0.67.1                  |
| monitoring    | daemonsets   | node-exporter                   | node-exporter                   | quay.io/prometheus/node-exporter:v1.6.1                                         |
| monitoring    | daemonsets   | node-exporter                   | kube-rbac-proxy                 | quay.io/brancz/kube-rbac-proxy:v0.14.2                                          |
| nfs           | deployment   | nfs-subdir-external-provisioner | nfs-subdir-external-provisioner | dyrnq/nfs-subdir-external-provisioner:v4.0.2                                    |
+---------------+--------------+---------------------------------+---------------------------------+---------------------------------------------------------------------------------+

4 resource 获取指定namespace的所有limit 与 Requests大小

新增 Java XMX XMS的展示，比较直观的展示 CPU内存的Limit与Requests，Prometheus根据7天查询的内存CPU使用（已经根据转换得到与kubectl top po一直的数据格式），Java_opts的XMX,XMS，可以作为一个参考依据来调整。
示例代码

1 获取所有namespace的limit 与 Requests大小  
./k8s-manager resource  
2 获取指定namespace的limit 与 Requests大小
./k8s-manager resource -n <namespace>

3 在prometheus查询最近七天的内存CPU使用情况,启用prometheus监控数据
./k8s-manager resource prometheus -u

在这里插入图片描述

示例代码：获取requests与Limit,并且查询prometheus的实际开销

root@k8s:/usr/local/cobra-k8s-manager# go run main.go resource -n freshx -p
所使用的prometheus地址是：  http://prometheus.dc-prod.yunlizhi.net
+-------------------------------+-----------+-------------------------------------+--------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+
|            节点名             | NAMESPACE |              POD NAME               |    容器名    | CPU限制 | CPU所需 | 最近7天已使用的CPU | 内存限制 | 内存所需 | JAVA-XMX  | JAVA-XMS  | 最近7天已使用的内存 |
+-------------------------------+-----------+-------------------------------------+--------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+
| prod-dc-10.22.126.151-zjk-ali | freshx    | fe-freshx-customer-57c65f95bc-c5tbk | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 334.07Mi            |
| prod-dc-10.22.6.210-zjk-ali   | freshx    | fe-freshx-customer-57c65f95bc-lbv7l | rest-service |       1 | 100m    | 0.02m              | 1Gi      | 1Gi      |           |           | 334.25Mi            |
| prod-dc-10.22.126.145-zjk-ali | freshx    | fe-freshx-platform-647f444577-gfv7s | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 333.55Mi            |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | fe-freshx-platform-647f444577-tt6xz | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 333.67Mi            |
| prod-dc-10.22.126.151-zjk-ali | freshx    | fe-freshx-procure-7b79d65c57-7pqrl  | rest-service |       1 | 100m    | 0.08m              | 1Gi      | 1Gi      |           |           | 333.70Mi            |
| prod-dc-10.22.209.105-zjk-ali | freshx    | fe-freshx-procure-7b79d65c57-qgrxq  | rest-service |       1 | 100m    | 3.04m              | 1Gi      | 1Gi      |           |           | 334.02Mi            |
| prod-dc-10.22.209.100-zjk-ali | freshx    | fe-freshx-supplier-5fd5ff9c5c-2wrrs | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 334.43Mi            |
| prod-dc-10.22.126.145-zjk-ali | freshx    | fe-freshx-supplier-5fd5ff9c5c-4d94k | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 333.90Mi            |
| prod-dc-10.22.126.146-zjk-ali | freshx    | feishu-companion-fd4f8c8fb-pls8l    | rest-service |       2 | 200m    | 3.75m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1358.15Mi           |
| prod-dc-10.22.6.210-zjk-ali   | freshx    | feishu-companion-fd4f8c8fb-xhd46    | rest-service |       2 | 200m    | 3.39m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1008.57Mi           |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | kafka-0                             | kafka-broker |       2 | 100m    | 30.51m             | 4Gi      | 4Gi      |           |           | 1673.03Mi           |
| prod-dc-10.22.6.210-zjk-ali   | freshx    | kafka-1                             | kafka-broker |       2 | 100m    | 33.30m             | 4Gi      | 4Gi      |           |           | 1682.64Mi           |
| prod-dc-10.22.126.146-zjk-ali | freshx    | kafka-2                             | kafka-broker |       2 | 100m    | 33.90m             | 4Gi      | 4Gi      |           |           | 1743.94Mi           |
| prod-dc-10.22.209.100-zjk-ali | freshx    | kafka-zookeeper-0                   | zookeeper    |       0 |       0 | 1.16m              |        0 |        0 |           |           | 385.40Mi            |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | kafka-zookeeper-1                   | zookeeper    |       0 |       0 | 0.96m              |        0 |        0 |           |           | 360.83Mi            |
| prod-dc-10.22.126.146-zjk-ali | freshx    | kafka-zookeeper-2                   | zookeeper    |       0 |       0 | 0.99m              |        0 |        0 |           |           | 351.36Mi            |
| prod-dc-10.22.6.228-zjk-ali   | freshx    | openapi-biz-67bd9555d-57krs         | rest-service |       2 | 200m    | 6.49m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1219.90Mi           |
| prod-dc-10.22.126.145-zjk-ali | freshx    | openapi-biz-67bd9555d-hkssw         | rest-service |       2 | 200m    | 5.05m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1222.02Mi           |
| prod-dc-10.22.6.217-zjk-ali   | freshx    | reach-system-bd5fc4694-9nxmh        | rest-service |       2 | 200m    | 10.34m             | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1114.30Mi           |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | reach-system-bd5fc4694-v5pwf        | rest-service |       2 | 200m    | 12.46m             | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1115.27Mi           |
| prod-dc-10.22.209.100-zjk-ali | freshx    | saas-auth-77d66b4444-ct7v2          | rest-service |       2 | 200m    | 5.42m              | 2500M    | 2500M    | -Xmx2048m | -Xms2048m | 1105.18Mi           |
| prod-dc-10.22.126.146-zjk-ali | freshx    | saas-auth-77d66b4444-gtj9j          | rest-service |       2 | 200m    | 5.56m              | 2500M    | 2500M    | -Xmx2048m | -Xms2048m | 1088.73Mi           |
| prod-dc-10.22.209.105-zjk-ali | freshx    | saas-freshx-biz-bdf68c6d4-bvzhw     | rest-service |       2 | 200m    | 26.03m             | 6G       | 6G       | -Xmx3400m | -Xms3400m | 1960.09Mi           |
| prod-dc-10.22.6.210-zjk-ali   | freshx    | saas-freshx-biz-bdf68c6d4-gphdf     | rest-service |       2 | 200m    | 25.86m             | 6G       | 6G       | -Xmx3400m | -Xms3400m | 1921.45Mi           |
| prod-dc-10.22.126.146-zjk-ali | freshx    | saas-gateway-65f9b78d5b-dxm5b       | rest-service |       2 | 200m    | 16.67m             | 2500M    | 2500M    | -Xmx2048m | -Xms2048m | 1436.83Mi           |
| prod-dc-10.22.6.217-zjk-ali   | freshx    | saas-gateway-65f9b78d5b-q5ttb       | rest-service |       2 | 200m    | 14.20m             | 2500M    | 2500M    | -Xmx2048m | -Xms2048m | 1665.02Mi           |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | saas-register-68f7bc75f5-qqjq7      | rest-service |       2 | 200m    | 9.05m              | 4G       | 4G       | -Xmx3096m | -Xms3096m | 1397.01Mi           |
| prod-dc-10.22.126.145-zjk-ali | freshx    | saas-upms-biz-6885b4b954-kl2pd      | rest-service |       3 | 400m    | 5.80m              | 4Gi      | 4Gi      | -Xmx3200m | -Xms3200m | 1700.01Mi           |
| prod-dc-10.22.6.228-zjk-ali   | freshx    | saas-upms-biz-6885b4b954-ln929      | rest-service |       3 | 400m    | 6.27m              | 4Gi      | 4Gi      | -Xmx3200m | -Xms3200m | 1701.80Mi           |
| prod-dc-10.22.6.217-zjk-ali   | freshx    | saas-xxl-job-admin-849dbc777b-gltxm | rest-service |       2 | 200m    | 4.39m              | 2560Mi   | 2560Mi   | -Xmx2048m | -Xms2048m | 1193.35Mi           |
| prod-dc-10.22.209.88-zjk-ali  | freshx    | saas-xxl-job-admin-849dbc777b-r9z4t | rest-service |       2 | 200m    | 4.72m              | 2560Mi   | 2560Mi   | -Xmx2048m | -Xms2048m | 1261.38Mi           |
+-------------------------------+-----------+-------------------------------------+--------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+

5 top 获取指定namespace的资源使用情况

这个命令是查看以namespace为单位的，不能top node节点，如果需要看 node信息，使用 k8s-manager node 或者 k8s-manager analysis --node

1 获取所有namespace的资源开销
./k8s-manager top
2 获取指定namespace的资源开销
./k8s-managerresource -n freshx -p

示例代码

root@jcrose  当前k8s集群:prod-dc-k8s-zjk-aliyun 当前namespace: null #/usr/local/github/cobra-k8s-manager go run main.go resource -n freshx -p
+-------------------------------+-----------+-------------------------------------+--------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+
|            节点名             | NAMESPACE |              POD NAME               |    容器名    | CPU限制 | CPU所需 | 最近7天已使用的CPU | 内存限制 | 内存所需 | JAVA-XMX  | JAVA-XMS  | 最近7天已使用的内存 |
+-------------------------------+-----------+-------------------------------------+--------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+
| prod-dc-10.22.126.151-zjk-ali | freshx    | fe-freshx-customer-57c65f95bc-c5tbk | rest-service |       1 | 100m    | 0.01m              | 1Gi      | 1Gi      |           |           | 334.07Mi            |
| prod-dc-10.22.6.210-zjk-ali   | freshx    | fe-freshx-customer-57c65f95bc-lbv7l | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 334.18Mi            |
| prod-dc-10.22.126.145-zjk-ali | freshx    | fe-freshx-platform-647f444577-gfv7s | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 333.55Mi            |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | fe-freshx-platform-647f444577-tt6xz | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 333.67Mi            |
| prod-dc-10.22.126.151-zjk-ali | freshx    | fe-freshx-procure-7b79d65c57-7pqrl  | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 333.69Mi            |
| prod-dc-10.22.209.105-zjk-ali | freshx    | fe-freshx-procure-7b79d65c57-qgrxq  | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 334.02Mi            |
| prod-dc-10.22.209.100-zjk-ali | freshx    | fe-freshx-supplier-5fd5ff9c5c-2wrrs | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 334.43Mi            |
| prod-dc-10.22.126.145-zjk-ali | freshx    | fe-freshx-supplier-5fd5ff9c5c-4d94k | rest-service |       1 | 100m    | 0.00m              | 1Gi      | 1Gi      |           |           | 333.90Mi            |
| prod-dc-10.22.126.146-zjk-ali | freshx    | feishu-companion-fd4f8c8fb-pls8l    | rest-service |       2 | 200m    | 1.81m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1358.13Mi           |
| prod-dc-10.22.6.210-zjk-ali   | freshx    | feishu-companion-fd4f8c8fb-xhd46    | rest-service |       2 | 200m    | 4.34m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1008.54Mi           |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | kafka-0                             | kafka-broker |       2 | 100m    | 42.58m             | 4Gi      | 4Gi      |           |           | 1673.03Mi           |
| prod-dc-10.22.6.210-zjk-ali   | freshx    | kafka-1                             | kafka-broker |       2 | 100m    | 29.96m             | 4Gi      | 4Gi      |           |           | 1682.62Mi           |
| prod-dc-10.22.126.146-zjk-ali | freshx    | kafka-2                             | kafka-broker |       2 | 100m    | 31.34m             | 4Gi      | 4Gi      |           |           | 1743.96Mi           |
| prod-dc-10.22.209.100-zjk-ali | freshx    | kafka-zookeeper-0                   | zookeeper    |       0 |       0 | 1.16m              |        0 |        0 |           |           | 385.40Mi            |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | kafka-zookeeper-1                   | zookeeper    |       0 |       0 | 1.07m              |        0 |        0 |           |           | 360.83Mi            |
| prod-dc-10.22.126.146-zjk-ali | freshx    | kafka-zookeeper-2                   | zookeeper    |       0 |       0 | 0.98m              |        0 |        0 |           |           | 351.36Mi            |
| prod-dc-10.22.6.228-zjk-ali   | freshx    | openapi-biz-67bd9555d-57krs         | rest-service |       2 | 200m    | 8.86m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1219.82Mi           |
| prod-dc-10.22.126.145-zjk-ali | freshx    | openapi-biz-67bd9555d-hkssw         | rest-service |       2 | 200m    | 19.94m             | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1221.82Mi           |
| prod-dc-10.22.6.217-zjk-ali   | freshx    | reach-system-bd5fc4694-9nxmh        | rest-service |       2 | 200m    | 11.79m             | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1114.29Mi           |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | reach-system-bd5fc4694-v5pwf        | rest-service |       2 | 200m    | 9.82m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 1115.26Mi           |
| prod-dc-10.22.209.100-zjk-ali | freshx    | saas-auth-77d66b4444-ct7v2          | rest-service |       2 | 200m    | 1.63m              | 2500M    | 2500M    | -Xmx2048m | -Xms2048m | 1105.18Mi           |
| prod-dc-10.22.126.146-zjk-ali | freshx    | saas-auth-77d66b4444-gtj9j          | rest-service |       2 | 200m    | 3.73m              | 2500M    | 2500M    | -Xmx2048m | -Xms2048m | 1088.73Mi           |
| prod-dc-10.22.209.105-zjk-ali | freshx    | saas-freshx-biz-bdf68c6d4-bvzhw     | rest-service |       2 | 200m    | 25.43m             | 6G       | 6G       | -Xmx3400m | -Xms3400m | 1959.85Mi           |
| prod-dc-10.22.6.210-zjk-ali   | freshx    | saas-freshx-biz-bdf68c6d4-gphdf     | rest-service |       2 | 200m    | 34.83m             | 6G       | 6G       | -Xmx3400m | -Xms3400m | 1920.83Mi           |
| prod-dc-10.22.126.146-zjk-ali | freshx    | saas-gateway-65f9b78d5b-dxm5b       | rest-service |       2 | 200m    | 24.63m             | 2500M    | 2500M    | -Xmx2048m | -Xms2048m | 1436.81Mi           |
| prod-dc-10.22.6.217-zjk-ali   | freshx    | saas-gateway-65f9b78d5b-q5ttb       | rest-service |       2 | 200m    | 19.40m             | 2500M    | 2500M    | -Xmx2048m | -Xms2048m | 1664.99Mi           |
| prod-dc-10.22.209.86-zjk-ali  | freshx    | saas-register-68f7bc75f5-qqjq7      | rest-service |       2 | 200m    | 7.57m              | 4G       | 4G       | -Xmx3096m | -Xms3096m | 1397.01Mi           |
| prod-dc-10.22.126.145-zjk-ali | freshx    | saas-upms-biz-6885b4b954-kl2pd      | rest-service |       3 | 400m    | 9.03m              | 4Gi      | 4Gi      | -Xmx3200m | -Xms3200m | 1699.96Mi           |
| prod-dc-10.22.6.228-zjk-ali   | freshx    | saas-upms-biz-6885b4b954-ln929      | rest-service |       3 | 400m    | 10.03m             | 4Gi      | 4Gi      | -Xmx3200m | -Xms3200m | 1701.77Mi           |
| prod-dc-10.22.6.217-zjk-ali   | freshx    | saas-xxl-job-admin-849dbc777b-gltxm | rest-service |       2 | 200m    | 5.67m              | 2560Mi   | 2560Mi   | -Xmx2048m | -Xms2048m | 1193.35Mi           |
| prod-dc-10.22.209.88-zjk-ali  | freshx    | saas-xxl-job-admin-849dbc777b-r9z4t | rest-service |       2 | 200m    | 6.59m              | 2560Mi   | 2560Mi   | -Xmx2048m | -Xms2048m | 1261.38Mi           |
+-------------------------------+-----------+-------------------------------------+--------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+

6 config 自动获取K8S配置文件路径下所有集群的prometheus的ingress地址

如果配置文件路径不对，或者其他原因。可以手动在config/promtheus.yaml修改
示例代码

1 默认获取 /root/.kube/文件下所有yaml文件的prometheus地址
go run main.go config
2 获取指定文件下所有yaml文件的prometheus地址
go run main.go config -p /data/k8s

常用的使用套路

1 k8s节点异常卡顿，容器频繁重启

k8s-manager analysis --node k8s #查看实际node上的开销情况，数据是由metrics-server提供的，使用的资源在服务器的占比

2 优化limit requests

支持 namespace与 node的筛选

root@k8s:/usr/local/cobra-k8s-manager# go run main.go resource prometheus -u http://192.168.44.134:20248/  --node k8s -n nfs
+--------+-----------+--------------------------------------------------+---------------------------------+---------+---------+--------------------+----------+----------+---------------------+
| 节点名 | NAMESPACE |                     POD NAME                     |             容器名              | CPU限制 | CPU所需 | 最近7天已使用的CPU | 内存限制 | 内存所需 | 最近7天已使用的内存 |
+--------+-----------+--------------------------------------------------+---------------------------------+---------+---------+--------------------+----------+----------+---------------------+
| k8s    | nfs       | nfs-subdir-external-provisioner-65664b8954-qrs2q | nfs-subdir-external-provisioner |       0 |       0 | 4.10m              |        0 |        0 | 9.60Mi              |
+--------+-----------+--------------------------------------------------+---------------------------------+---------+---------+--------------------+----------+----------+---------------------+

3 分析某一namespace的资源开销并生成excel分析

root@jcrose  当前k8s集群:qa-dc-k8s-zjk-aliyun 当前namespace: null #/usr/local/github/cobra-k8s-manager k8s-manager resource -n freshx -p --export
所使用的prometheus地址是：  http://prometheus.dc-prod.yunlizhi.net

+----------------------------+-----------+-------------------------------------+---------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+
|           节点名           | NAMESPACE |              POD NAME               |    容器名     | CPU限制 | CPU所需 | 最近7天已使用的CPU | 内存限制 | 内存所需 | JAVA-XMX  | JAVA-XMS  | 最近7天已使用的内存 |
+----------------------------+-----------+-------------------------------------+---------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+
| qa-dc-10.24.99.236-zjk-ali | freshx    | fe-freshx-customer-d5b65c59c-462dn  | rest-service2 |       0 |       0 | 0.00m              |        0 |        0 |           |           | 0.00Mi              |
| qa-dc-10.24.99.240-zjk-ali | freshx    | fe-freshx-platform-574969bbbb-xhqjq | rest-service2 |       0 |       0 | 0.00m              |        0 |        0 |           |           | 0.00Mi              |
| qa-dc-10.24.25.225-zjk-ali | freshx    | fe-freshx-procure-ddc487c7b-62jj6   | rest-service2 |       0 |       0 | 0.00m              |        0 |        0 |           |           | 0.00Mi              |
| qa-dc-10.24.25.221-zjk-ali | freshx    | fe-freshx-supplier-7bd5b79484-qxnwl | rest-service2 |       0 |       0 | 0.00m              |        0 |        0 |           |           | 0.00Mi              |
| qa-dc-10.24.99.243-zjk-ali | freshx    | feishu-companion-5f7d47cd6c-gskrs   | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.25.218-zjk-ali | freshx    | kafka-0                             | kafka-broker  |       2 | 100m    | 28.60m             | 4Gi      | 4Gi      |           |           | 1675.85Mi           |
| qa-dc-10.24.99.236-zjk-ali | freshx    | kafka-1                             | kafka-broker  |       2 | 100m    | 28.33m             | 4Gi      | 4Gi      |           |           | 1688.93Mi           |
| qa-dc-10.24.99.239-zjk-ali | freshx    | kafka-2                             | kafka-broker  |       2 | 100m    | 23.27m             | 4Gi      | 4Gi      |           |           | 1748.72Mi           |
| qa-dc-10.24.99.236-zjk-ali | freshx    | kafka-zookeeper-0                   | zookeeper     |       0 |       0 | 1.02m              |        0 |        0 |           |           | 385.39Mi            |
| qa-dc-10.24.25.220-zjk-ali | freshx    | kafka-zookeeper-1                   | zookeeper     |       0 |       0 | 0.86m              |        0 |        0 |           |           | 360.83Mi            |
| qa-dc-10.24.99.239-zjk-ali | freshx    | kafka-zookeeper-2                   | zookeeper     |       0 |       0 | 0.97m              |        0 |        0 |           |           | 351.36Mi            |
| qa-dc-10.24.99.243-zjk-ali | freshx    | openapi-biz-5b45595dc9-s5vb9        | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.25.221-zjk-ali | freshx    | reach-system-5c786fd988-8dx6r       | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.25.218-zjk-ali | freshx    | redis-master-0                      | redis         |       2 | 100m    | 0.00m              | 5Gi      | 5Gi      |           |           | 0.00Mi              |
| qa-dc-10.24.99.247-zjk-ali | freshx    | saas-auth-5fc8f759d-q9d6w           | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.25.221-zjk-ali | freshx    | saas-freshx-biz-758d8cd4c9-5swwz    | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.25.221-zjk-ali | freshx    | saas-gateway-675745d64-x7scv        | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.99.236-zjk-ali | freshx    | saas-register-7ddbb448cc-z5dn9      | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.25.220-zjk-ali | freshx    | saas-upms-biz-bf9699565-tnkzf       | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.25.220-zjk-ali | freshx    | saas-xxl-job-admin-74b94bf4c-qz6d4  | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
| qa-dc-10.24.25.220-zjk-ali | freshx    | wechat-companion-5d756b994d-t5vhp   | rest-service2 |       2 | 200m    | 0.00m              | 2Gi      | 2Gi      | -Xmx1536m | -Xms1536m | 0.00Mi              |
+----------------------------+-----------+-------------------------------------+---------------+---------+---------+--------------------+----------+----------+-----------+-----------+---------------------+

# 查看是否生成excel?
root@jcrose  当前k8s集群:qa-dc-k8s-zjk-aliyun 当前namespace: null #/usr/local/github/cobra-k8s-manager ls
cmd  demo  go.mod  go.sum  LICENSE  main.go  pkg  prod-dc-k8s-zjk-aliyun集群-analysis-cpu-memory-2025-01-21-092404.xlsx  README.md  tmp

可以发现已经生成了  prod-dc-k8s-zjk-aliyun集群-analysis-cpu-memory-2025-01-21-092404.xlsx 按照当前集群，以及时间戳生成xlsx
jcrose2580
关注
【ubutnu24.04】k8s部署3:重新安装1.31.0并init成功
突围
08-15 766
#!/bin/sh sudo systemctl restart containerd sudo systemctl status containerd
【ubuntu24.04】k8s 部署5：配置calico 镜像拉取
突围
08-19 881
docker.io/calico/csi:v3.28.1
K8S 开发环境操作工具
一个技术菜鸟的博客
08-20 301
#! /bin/bash NAMESPACE=dev function undeploy() { execkubectrl svc $1 execkubectrl hpa $1 execkubectrl deploy $1 execkubectrl ingress $1 echo “卸载完成” } function execkubectrl() { echo “卸载$1…” CNT=kubectl get $1 -n ${NAMESPACE} |grep "^$2"|wc -l if [ $CNT -gt
超实用的K8S命令行工具
m0_47495420的博客
06-11 441
当我们有多个集群需要操作的时候，如果是只使用原生的kubectl会比较麻烦，要不断的切来切去，下面就来介绍几个实用的工具。合并多集群配置1. 下载工具：kubecm# curl -Lo kubecm.tar.gz https://github.com/sunny0826/kubecm/releases/download/v0.21.0/kubecm_v0.21.0_Darwin_x86_64.ta...
Cobra 库上手—自建命令行工具
cnzzs的博客
08-08 1081
Cobra 简介 Cobra 是一个流行的 Go 语言库，用于创建强大且灵活的命令行应用程序。它由 spf13 开发，设计用于与 Go 生态系统中的其他流行库(如 Viper 配置库)无缝集成。Cobra 支持多级命令结构，允许定义根命令和任意数量的子命令，还可以轻松处理全局和本地标志。它自动生成帮助和使用信息，并支持 B...
2022最新7个开源Kubernetes(k8s)开发工具
ChatGPTer
04-21 6506
Kubernetes现在是一个非常流行的话题，随着它越来越受欢迎，更多的开发人员将需要更多的工具来用于他们的Kubernetes应用程序。
云计算虚拟化：k8s进阶-CRD开发基础
dustzhu的博客
01-01 6126
一. 前言 CRD:Custom Resources Definition,即在Kubernetes 中添加一个和 Pod、service 类似的、新的 API 资源类型，用于统一部署/编排多个内置K8S资源（pod,service等）。 为什么需要CRD? helm也可以做到统一部署/编排deployment,service,ingress，但它缺乏对资源的全生命周期的监控，CRD通过apiserver接口，在etcd中注册一种新的资源类型，此后就可以创建对应的资源对象&并监控它们的状态&
Cobra + Client-go实现K8s 自定义插件开发
分享身边生活经验blog
07-11 1075
一 背景 在我们使用kubectl查看k8s资源的时候，想直接查看对应资源的容器名称和镜像名称，目前kubectl还不支持该选型，需要我们describe然后来查看，对于集群自己比较多，不是很方便，因此萌生了自己开发kubectl 插件来实现该功能。 二 相关技术 2.1 Cobra Cobra是一个命令行程序库，其是一个用来编写命令行的神器，提供了一个脚手架，用于快速生成基于Cobra应用程序框架。我们可以利用Cobra快速的去开发出我们想要的命令行工具，非常的方便快捷。 详细可参考：Golan
云计算虚拟化：k8s进阶-CRD项目部署
dustzhu的博客
01-03 3024
一. 前言
k8s scheduler开发实战（一）：简单的，无参数，无自定义配置文件的调度器
cser的博客
02-18 834
本文基于k8s 1.23.3版本，本文会带你实现一个最简单的k8s调度器插件
K8S中编写自己的CRD及Controller简明指南
热门推荐
qianggezhishen的专栏
06-28 1万+
Table of Contents 一、背景 二、环境准备及基本开发流程 1、Golang 环境搭建 1.1 Golang 语言版本 1.2 Golang 环境配置 2、CRD Controller 开发环境搭建 2.1、使用时的一些注意事项 3、CRD Controller的开发逻辑 4、CRD controller的测试与部署 三、演示 3.1 构架代码生成 3.1.1 采用 GOPATH 来生成 3.1.2 采用 go mod 来生成 3.2 验证生成的代码 3.2.1
sealos自动部署k8s集群
qq_70531838的博客
10-25 1669
官网： 安装 K8s 集群 | Sealos: 专为云原生开发打造的以 K8s 为内核的云操作系统#执行之前各节点记得做免密钥报错记录： Error: cluster status is not ClusterSuccesspanic: arch /root/.bashrc: line 13: kubectl: command not found x86_64 not yet supported, feel free to file an issuegoroutine 1 [running]: githu
k8s Api server 源码解读
qq_32381527的博客
01-09 2086
背景      由于在工作中，需要引入k8s Resource Quota,所以这次借此契机研究Api Sever源码和resource quota的创建流程。            K8s源码版本: v 1.10            Golang版本: 1.10.5            etcd： 3.0+            ide： idea    对于1.10及以上的k8...
k8s学习记录（五）：Pod亲和性详解
仔哥学编程
04-27 910
k8s 调度规则，节点亲和性详解
kubernetes》》k8s》》Service 、Ingress 区别
u013400314的博客
04-30 350
在 userSpace 模式下，kube-proxy 会为每一个 Service 创建一个监听端口，当有请求发往Cluster IP 的时候，会被 Iptables 规则重定向到 kube-proxy 监听的端口上，kube-proxy 会根据 LB 算法选择一个 Pod 提供服务并建立起连接。这个模式下，kube-proxy 充当的角色是一个 四层负责均衡器，由于 kube-proxy 运行在 userSpace 模式下，在进行转发处理的时候会增加内核和用户空间之间的数据拷贝，因此效率比较低。
K8S - 命名空间实战 - 从资源隔离到多环境管理
最新发布
weixin_46619605的博客
04-30 482
K8S - 命名空间实战 - 从资源隔离到多环境管理
k8s学习记录（四）：节点亲和性
仔哥学编程
04-26 1089
在上一篇文章里，我们了解了 Pod 中的nodeName和这两个属性，通过它们能够指定 Pod 调度到哪个 Node 上。今天，我们将进一步深入探索 Pod 相关知识。这部分内容不仅信息量较大，理解起来也有一定难度，如果在学习过程中感觉吃力，建议大家反复研读，以便更好地掌握。本文聚焦 Kubernetes 的节点亲和性。在 Pod 调度中，以往的 nodeName 和 nodeSelector 存在局限，亲和性则更为强大，其中节点亲和性包含软、硬亲和性。软亲和性是建议性规则。测试时，期望调度到。
K8S - HPA + 探针实战 - 实现弹性扩缩与自愈
weixin_46619605的博客
04-30 516
K8S - HPA + 探针实战 - 实现弹性扩缩与自愈
《云原生安全攻防》-- K8s容器安全：基于Falco实现运行时入侵检测
04-26 424
利用AI工具生成可用的安全检测规则，提高效率的同时，安全人员仍然需要保持对底层原理的理解，因为AI生成的规则仍然需要安全人员来测试和调整，理解规则背后的系统调用逻辑。Falco是一款开源的云原生安全工具，专注于为云原生环境提供实时的安全威胁检测。在本节课程中，我们将以CentOS作为测试环境，演示如何在主机上安全Falco，自定义检测规则，并在K8s中集成Falco。Falco提供了默认的检测规则，同时也支持用户自定义规则，因此具备很强的扩展能力，自定义规则的编写和使用，实现更精准的入侵检测和安全告警。
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值