SaltStack之数据系统

 
 
 

1. SaltStack数据系统

---

SaltStack有两大数据系统，分别是：

• Grains
• Pillar

 
 

2. SaltStack数据系统组件

---

2.1 SaltStack组件之Grains

SaltStack组件之Grains
Grains是SaltStack的一个组件，其存放着minion启动时收集到的信息。

Grains是SaltStack组件中非常重要的组件之一，因为我们在做配置部署的过程中会经常使用它，Grains是SaltStack记录minion的一些静态信息的组件。可简单理解为Grains记录着每台minion的一些常用属性，比如CPU、内存、磁盘、网络信息等。我们可以通过grains.items查看某台minion的所有Grains信息。
 
 
Grains的功能：

• 收集资产信息
   

Grains应用场景：

• 信息查询
• 在命令行下进行目标匹配
• 在top file中进行目标匹配
• 在模板中进行目标匹配

 
 

grains使用方法

grains.items查询实例

grains.items
[root@master ~]# salt '192.168.30.245' grains.items
192.168.30.245:
    ----------
    SSDs:
    biosreleasedate:
        07/29/2019
    biosversion:
        6.00
    cpu_flags:
        - fpu
        - vme
        - de
        - pse
        - tsc
        - msr
        - pae
        - mce
        - cx8
        - apic
        - sep
        - mtrr
        - pge
        - mca
        - cmov
        - pat
        - pse36
        - clflush
        - mmx
        - fxsr
        - sse
        - sse2
        - ss
        - syscall
        - nx
        - pdpe1gb
        - rdtscp
        - lm
        - constant_tsc
        - arch_perfmon
        - nopl
        - xtopology
        - tsc_reliable
        - nonstop_tsc
        - eagerfpu
        - pni
        - pclmulqdq
        - vmx
        - ssse3
        - fma
        - cx16
        - pcid
        - sse4_1
        - sse4_2
        - x2apic
        - movbe
        - popcnt
        - tsc_deadline_timer
        - aes
        - xsave
        - avx
        - f16c
        - rdrand
        - hypervisor
        - lahf_lm
        - abm
        - 3dnowprefetch
        - tpr_shadow
        - vnmi
        - ept
        - vpid
        - fsgsbase
        - tsc_adjust
        - bmi1
        - avx2
        - smep
        - bmi2
        - invpcid
        - rdseed
        - adx
        - smap
        - clflushopt
        - xsaveopt
        - xsavec
        - arat
    cpu_model:
        Intel(R) Core(TM) i5-8300H CPU @ 2.30GHz
    cpuarch:
        x86_64
    cwd:
        /
    disks:
        - sda
        - sr0
        - dm-0
        - dm-1
    dns:
        ----------
        domain:
        ip4_nameservers:
            - 192.168.30.2
        ip6_nameservers:
        nameservers:
            - 192.168.30.2
        options:
        search:
        sortlist:
    domain:
    fqdn:
        minion
    fqdn_ip4:
        - 192.168.30.245
    fqdn_ip6:
        - fe80::def9:ed60:13e2:5273
        - fe80::b115:abb6:c786:a261
    fqdns:
    gid:
        0
    gpus:
        |_
          ----------
          model:
              SVGA II Adapter
          vendor:
              vmware
    groupname:
        root
    host:
        minion
    hwaddr_interfaces:
        ----------
        ens33:
            00:0c:29:c8:03:9e
        ens37:
            00:0c:29:c8:03:a8
        lo:
            00:00:00:00:00:00
    id:
        192.168.30.245
    init:
        systemd
    ip4_gw:
        192.168.30.2
    ip4_interfaces:
        ----------
        ens33:
            - 192.168.30.245
        ens37:
        lo:
            - 127.0.0.1
    ip6_gw:
        False
    ip6_interfaces:
        ----------
        ens33:
            - fe80::b115:abb6:c786:a261
            - fe80::def9:ed60:13e2:5273
        ens37:
        lo:
            - ::1
    ip_gw:
        True
    ip_interfaces:
        ----------
        ens33:
            - 192.168.30.245
            - fe80::b115:abb6:c786:a261
            - fe80::def9:ed60:13e2:5273
        ens37:
        lo:
            - 127.0.0.1
            - ::1
    ipv4:
        - 127.0.0.1
        - 192.168.30.245
    ipv6:
        - ::1
        - fe80::b115:abb6:c786:a261
        - fe80::def9:ed60:13e2:5273
    kernel:
        Linux
    kernelrelease:
        3.10.0-693.el7.x86_64
    kernelversion:
        #1 SMP Thu Jul 6 19:56:57 EDT 2017
    locale_info:
        ----------
        defaultencoding:
            UTF-8
        defaultlanguage:
            zh_CN
        detectedencoding:
            UTF-8
        timezone:
            CST
    localhost:
        minion
    lsb_distrib_codename:
        Red Hat Enterprise Linux Server 7.4 (Maipo)
    lsb_distrib_id:
        Red Hat Enterprise Linux Server
    lsb_distrib_release:
        7.4
    machine_id:
        8c068b39975947e6bbbe5cd465208f3f
    manufacturer:
        VMware, Inc.
    master:
        192.168.30.244
    mdadm:
    mem_total:
        1823
    nodename:
        minion
    num_cpus:
        1
    num_gpus:
        1
    os:
        RedHat
    os_family:
        RedHat
    osarch:
        x86_64
    oscodename:
        Maipo
    osfinger:
        Red Hat Enterprise Linux Server-7
    osfullname:
        Red Hat Enterprise Linux Server
    osmajorrelease:
        7
    osrelease:
        7.4
    osrelease_info:
        - 7
        - 4
    path:
        /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
    pid:
        1267
    productname:
        VMware Virtual Platform
    ps:
        ps -efHww
    pythonexecutable:
        /usr/bin/python
    pythonpath:
        - /usr/bin
        - /usr/lib64/python27.zip
        - /usr/lib64/python2.7
        - /usr/lib64/python2.7/plat-linux2
        - /usr/lib64/python2.7/lib-tk
        - /usr/lib64/python2.7/lib-old
        - /usr/lib64/python2.7/lib-dynload
        - /usr/lib64/python2.7/site-packages
        - /usr/lib64/python2.7/site-packages/gtk-2.0
        - /usr/lib/python2.7/site-packages
    pythonversion:
        - 2
        - 7
        - 5
        - final
        - 0
    saltpath:
        /usr/lib/python2.7/site-packages/salt
    saltversion:
        3000.3
    saltversioninfo:
        - 3000
        - 3
    selinux:
        ----------
        enabled:
            False
        enforced:
            Disabled
    serialnumber:
        VMware-56 4d f9 ab 8c 6e 03 7a-96 e4 31 e2 1e c8 03 9e
    server_id:
        748726451
    shell:
        /bin/sh
    swap_total:
        2047
    systemd:
        ----------
        features:
            +PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN
        version:
            219
    uid:
        0
    username:
        root
    uuid:
        abf94d56-6e8c-7a03-96e4-31e21ec8039e
    virtual:
        VMware
    zfs_feature_flags:
        False
    zfs_support:
        False
    zmqversion:
        4.1.4

 

只查询grains的key项

[root@master ~]# salt '*' grains.ls
192.168.30.245:
    - SSDs
    - biosreleasedate
    - biosversion
    - cpu_flags
    - cpu_model
    - cpuarch
    - cwd
    - disks
    - dns
    - domain
    - fqdn
    - fqdn_ip4
    - fqdn_ip6
    - fqdns
    - gid
    - gpus
    - groupname
    - host
    - hwaddr_interfaces
    - id
    - init
    - ip4_gw
    - ip4_interfaces
    - ip6_gw
    - ip6_interfaces
    - ip_gw
    - ip_interfaces
    - ipv4
    - ipv6
    - kernel
    - kernelrelease
    - kernelversion
    - locale_info
    - localhost
    - lsb_distrib_codename
    - lsb_distrib_id
    - lsb_distrib_release
    - machine_id
    - manufacturer
    - master
    - mdadm
    - mem_total
    - nodename
    - num_cpus
    - num_gpus
    - os
    - os_family
    - osarch
    - oscodename
    - osfinger
    - osfullname
    - osmajorrelease
    - osrelease
    - osrelease_info
    - path
    - pid
    - productname
    - ps
    - pythonexecutable
    - pythonpath
    - pythonversion
    - saltpath
    - saltversion
    - saltversioninfo
    - selinux
    - serialnumber
    - server_id
    - shell
    - swap_total
    - systemd
    - uid
    - username
    - uuid
    - virtual
    - zfs_feature_flags
    - zfs_support
    - zmqversion

 

查询某个key值

//获取IP
[root@master ~]# salt '*' grains.get fqdn_ip4
192.168.30.245:
    - 192.168.30.245




//查询网卡设备上的IP
[root@master ~]# salt '*' grains.get ip4_interfaces
192.168.30.245:
    ----------
    ens33:
        - 192.168.30.245
    ens37:
    lo:
        - 127.0.0.1



//查看指定网卡信息
[root@master ~]# salt '*' grains.get ip4_interfaces:ens33
192.168.30.245:
    - 192.168.30.245

 
 

目标匹配实例

用Grains来匹配minion：

[root@master ~]# salt -G 'os:redhat' cmd.run 'ls /root/'
192.168.30.245:
    111
    anaconda-ks.cfg
    dir
    zyy
    zyy.bak

 
 

在top file里面使用grains

[root@master ~]# vim /srv/salt/base/top.sls
base:
  'os:RedHat':
    - match: grain
    - web.apache.apache-install

 
 

自定义grains

自定义grains的两种方法：

• minion配置文件，在配置文件中搜索grains
• 在/etc/salt下生成一个grains文件，在此文件中定义(推荐方式)
   

1.修改minion grains

//取消注释
[root@minion ~]# vim /etc/salt/minion
#grains:
#  roles:
#    - webserver
#    - memcache
#  deployment: datacenter4
#  cabinet: 13
#  cab_u: 14-15

 
 
2.在/etc/salt/创建自定义文件grains(推荐使用)

1.编写自定义文件
[root@master ~]# vim /etc/salt/grains 
role: apache-server




2.传送给所有主机/etc/salt/下
[root@master ~]# salt-cp '*' /etc/salt/grains /etc/salt/grains 
192.168.30.245:
    ----------
    /etc/salt/grains:
        True




3.同步
[root@master ~]# salt '*' saltutil.sync_grains
192.168.30.245:





4.测试，能否找到role key
[root@master ~]# salt '*' grains.get role
192.168.30.245:
    apache-server

 
 

2.2 SaltStack组件之Pillar

---

Pillar也是SaltStack组件中非常重要的组件之一，是数据管理中心，经常配置states在大规模的配置管理工作中使用它。Pillar在SaltStack中主要的作用就是存储和定义配置管理中需要的一些数据，比如软件版本号、用户名密码等信息，它的定义存储格式与Grains类似，都是YAML格式。

在Master配置文件中有一段Pillar settings选项专门定义Pillar相关的一些参数：

[root@master ~]# vim /etc/salt/master

#pillar_roots:
#  base:
#   - /srv/pillar/

 
默认Base环境下Pillar的工作目录在/srv/pillar目录下。若你想定义多个环境不同的Pillar工作目录，只需要修改此处配置文件即可。

Pillar的特点：

• 可以给指定的minion定义它需要的数据
• 只有指定的人才能看到定义的数据
• 在master配置文件里设置

//查看pirrar信息
[root@master ~]# salt '*' pillar.items
192.168.30.245:
    ----------

默认pillar是没有任何信息的，如果想查看信息，需要在 master 配置文件上把 pillar_opts的注释取消，并将其值设为 True。

1.改为True
[root@master ~]# vim /etc/salt/master
pillar_opts: True



2.重启服务
[root@master ~]# systemctl restart salt-master



3.查看
[root@master ~]# salt '*' pillar.items

.......
 winrepo_remotes:
            - https://github.com/saltstack/salt-winrepo.git
        winrepo_remotes_ng:
            - https://github.com/saltstack/salt-winrepo-ng.git
        winrepo_ssl_verify:
            True
        winrepo_user:
        worker_threads:
            5
        zmq_backlog:
            1000
        zmq_filtering:
            False
        zmq_monitor:
            False

 
 

pillar使用方法

pillar自定义数据

在master的配置文件里找pillar_roots可以看到其存放pillar的位置

1.//取消注释，可以增加环境
[root@master ~]# vim /etc/salt/master

pillar_roots:
  base:
    - /srv/pillar/base
  test:
    - /srv/pillar/test
  prod:
    - /srv/pillar/prod




2.创建所需目录
[root@master ~]# mkdir -p /srv/pillar/{base,test,prod}


[root@master pillar]# tree /srv/pillar/
/srv/pillar/
├── base 
├── prod
└── test



3.重启服务
[root@master ~]# systemctl restart salt-master





[root@master ~]# vim /srv/pillar/base/apache-install.sls 
{% if grains['os'] == 'RedHat' %}
apache: httpd
{% elif grains['os'] == 'CentOS' %}
apache: apache
{% endif %}




//定义top file入口文件
[root@master ~]# vim /srv/pillar/base/top.sls
base:              #//指定环境
  '*':                   #//指定目标
    - apache-install          #//引用apache-install.sls





测试，可以使用
[root@master pillar]# salt '*' pillar.items
192.168.30.245:
    ----------
    apache:
        httpd






//在salt下修改apache的状态文件，引用pillar的数据
[root@master ~]# vim /srv/salt/base/web/http/http-install.sls 
apache-install:
  pkg.installed:
    - name: {{ pillar['apache'] }}    ##这里的apache就是我们在pillar目录下定义的变量

apache-service:
  service.running:
    - name: {{ pillar['apache'] }}     ##
    - enable: True





编写top.sls,方便使用
[root@master ~]# vim /srv/salt/base/top.sls
base:
  '*':
    - web.http.http-install





测试
[root@master ~]# salt '*' state.highstate
192.168.30.245:
----------
          ID: apache-install
    Function: pkg.installed
        Name: httpd
      Result: True
     Comment: All specified packages are already installed
     Started: 19:28:54.055555
    Duration: 421.608 ms
     Changes:   
----------
          ID: apache-service
    Function: service.running
        Name: httpd
      Result: True
     Comment: The service httpd is already running
     Started: 19:28:54.478079
    Duration: 30.055 ms
     Changes:   

Summary for 192.168.30.245
------------
Succeeded: 2
Failed:    0
------------
Total states run:     2
Total run time: 451.663 ms