十二、Prometheus 告警实战

0.22版本以后，增加了AlertmanagerConfig:

https://github.com/prometheus-operator/prometheus-operator/blob/master/example/user-guides/alerting/alertmanager-config-example.yaml

https://github.com/prometheus-operator/prometheus-operator/blob/master/Documentation/api.md#alertmanagerconfig

一、PrometheusRule

可以通过如下命令查看默认配置的告警策略：

[root@k8s-master01 manifests]#kubectl get prometheusrule -n monitoring
NAME                              AGE
alertmanager-main-rules           20d
grafana-rules                     20d
kube-prometheus-rules             20d
kube-state-metrics-rules          20d
kubernetes-monitoring-rules       20d
node-exporter-rules               20d
prometheus-k8s-prometheus-rules   20d
prometheus-operator-rules         20d

也可以通过-oyaml 查看某个 rules 的详细配置：

[root@k8s-master01 manifests] # kubectl get prometheusrule -n monitoring node-exporter-rules -oyaml
apiVersion: monitoring.coreos.com/v1
kind: PrometheusRule
......
spec:
  groups:
  - name: node-exporter
    rules:
    - alert: NodeFilesystemSpaceFillingUp
      annotations:
        description: Filesystem on {
   
   {
   
    $labels.device }}, mounted on {
   
   {
   
    $labels.mountpoint