背景:公司一台生产物理rac数据库上的asm共享盘使用量飙满,本来是1T,使用率已经超90%,急需扩容
1、物理SAN存储扩容
由于此1T目录的容量是物理SAN存储直接分配的,所以要扩容首先就要在物理SAN存储上先扩,如下:
博主的存储是DELL的,如果各位用的是其他物理存储,扩容步骤可能不同。
2、Multipath多路径硬盘设备扩容
由于物理SAN存储分配的盘在rac物理机上显示有4份,所以当时做了Multipath多路径绑定,如下:
[root@racdb1 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 447.1G 0 disk
├─sda1 8:1 0 200M 0 part /boot/efi
├─sda2 8:2 0 1G 0 part /boot
└─sda3 8:3 0 445.9G 0 part
├─rhel-root 253:0 0 429.9G 0 lvm /
└─rhel-swap 253:1 0 16G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
└─vg01-lv01 253:6 0 300G 0 lvm /u01
sdc 8:32 0 10G 0 disk
└─mpathb 253:3 0 10G 0 mpath
sdd 8:48 0 10G 0 disk
└─mpathc 253:4 0 10G 0 mpath
sde 8:64 0 1T 0 disk
└─mpathd 253:5 0 1T 0 mpath
sdf 8:80 0 10G 0 disk
└─mpatha 253:2 0 10G 0 mpath
sdg 8:96 0 10G 0 disk
└─mpathb 253:3 0 10G 0 mpath
sdh 8:112 0 10G 0 disk
└─mpathc 253:4 0 10G 0 mpath
sdi 8:128 0 1T 0 disk
└─mpathd 253:5 0 1T 0 mpath
sdj 8:144 0 10G 0 disk
└─mpatha 253:2 0 10G 0 mpath
sdk 8:160 0 10G 0 disk
└─mpatha 253:2 0 10G 0 mpath
sdl 8:176 0 10G 0 disk
└─mpathb 253:3 0 10G 0 mpath
sdm 8:192 0 10G 0 disk
└─mpathc 253:4 0 10G 0 mpath
sdn 8:208 0 1T 0 disk
└─mpathd 253:5 0 1T 0 mpath
sdo 8:224 0 10G 0 disk
└─mpathb 253:3 0 10G 0 mpath
sdp 8:240 0 10G 0 disk
└─mpathc 253:4 0 10G 0 mpath
sdq 65:0 0 1T 0 disk
└─mpathd 253:5 0 1T 0 mpath
sdr 65:16 0 10G 0 disk
└─mpatha 253:2 0 10G 0 mpath
[root@racdb1 ~]# multipath -ll
mpathd (36000d31005b18600000000000000000c) dm-5 COMPELNT,Compellent Vol
size=1.0T features='1 queue_if_no_path' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
|- 14:0:0:4 sde 8:64 active ready running
|- 14:0:2:4 sdi 8:128 active ready running
|- 16:0:1:4 sdn 8:208 active ready running
`- 16:0:2:4 sdq 65:0 active ready running
2.1 扩容后,需重新扫描存储设备的SCSI总线
[root@racdb1 ~]# echo 1 > /sys/block/sde/device/rescan
[root@racdb1 ~]# echo 1 > /sys/block/sdi/device/rescan
[root@racdb1 ~]# echo 1 > /sys/block/sdn/device/rescan
[root@racdb1 ~]# echo 1 > /sys/block/sdq/device/rescan
扫描后查看容量是否已刷新:
[root@racdb1 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 447.1G 0 disk
├─sda1 8:1 0 200M 0 part /boot/efi
├─sda2 8:2 0 1G 0 part /boot
└─sda3 8:3 0 445.9G 0 part
├─rhel-root 253:0 0 429.9G 0 lvm /
└─rhel-swap 253:1 0 16G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
└─vg01-lv01 253:6 0 300G 0 lvm /u01
sdc 8:32 0 10G 0 disk
└─mpathb 253:3 0 10G 0 mpath
sdd 8:48 0 10G 0 disk
└─mpathc 253:4 0 10G 0 mpath
sde 8:64 0 2T 0 disk
└─mpathd 253:5 0 1T 0 mpath
sdf 8:80 0 10G 0 disk
└─mpatha 253:2 0 10G 0 mpath
sdg 8:96 0 10G 0 disk
└─mpathb 253:3 0 10G 0 mpath
sdh 8:112 0 10G 0 disk
└─mpathc 253:4 0 10G 0 mpath
sdi 8:128 0 2T 0 disk
└─mpathd 253:5 0 1T 0 mpath
sdj 8:144 0 10G 0 disk
└─mpatha 253:2 0 10G 0 mpath
sdk 8:160 0 10G 0 disk
└─mpatha 253:2 0 10G 0 mpath
sdl 8:176 0 10G 0 disk
└─mpathb 253:3 0 10G 0 mpath
sdm 8:192 0 10G 0 disk
└─mpathc 253:4 0 10G 0 mpath
sdn 8:208 0 2T 0 disk
└─mpathd 253:5 0 1T 0 mpath
sdo 8:224 0 10G 0 disk
└─mpathb 253:3 0 10G 0 mpath
sdp 8:240 0 10G 0 disk
└─mpathc 253:4 0 10G 0 mpath
sdq 65:0 0 2T 0 disk
└─mpathd 253:5 0 1T 0 mpath
sdr 65:16 0 10G 0 disk
└─mpatha 253:2 0 10G 0 mpath
2.2 SCSI容量刷新后,4块设备对应的mpath也需扩容
从上面可以看到4块设备的SCSI容量更新后,对应的同一个mpath并没有跟着扩容,此时需要通过Multipathd命令扩容
[root@racdb1 ~]# multipath -ll
mpathd (36000d31005b18600000000000000000c) dm-5 COMPELNT,Compellent Vol
size=1.0T features='1 queue_if_no_path' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
|- 14:0:0:4 sde 8:64 active ready running
|- 14:0:2:4 sdi 8:128 active ready running
|- 16:0:1:4 sdn 8:208 active ready running
`- 16:0:2:4 sdq 65:0 active ready running
[root@racdb1 ~]# multipathd -k"resize map dm-5" #注意-k和"之间没有空格
ok
回显成功后,再次查看容量:
[root@racdb1 ~]# multipath -ll
mpathd (36000d31005b18600000000000000000c) dm-5 COMPELNT,Compellent Vol
size=2.0T features='1 queue_if_no_path' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
|- 14:0:0:4 sde 8:64 active ready running
|- 14:0:2:4 sdi 8:128 active ready running
|- 16:0:1:4 sdn 8:208 active ready running
`- 16:0:2:4 sdq 65:0 active ready running
mpathd已成功扩容到2T~!