RAC集群因为OCR磁盘物理问题而导致的集群启动失败

某日对数据库集群进行例行检查，发现两个节点CRS服务都没有启动，OCRCHECK报访问物理存储错误：

查看ASM磁盘情况：

OCR磁盘未挂载；

检查CRS相关服务信息：

$ crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4535: Cannot communicate with Cluster Ready Services

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

发现CRS服务未启动Cannot communicate with Cluster Ready Services

检查表决磁盘信息：

$ crsctl query css votedisk

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

 1. ONLINE   29c20de0db034fb0bfdb058d4884c201 (/dev/OCR1) [OCR]

 2. ONLINE   8c6dcc130a444fe8bff94950b0680dfe (/dev/OCR2) [OCR]

 3. ONLINE   aece8019d1764fcebfcc42f24145f5a3 (/dev/OCR3) [OCR]

Located 3 voting disk(s).

表决磁盘在线，尝试使用mount解决

sqlplus / as sysasm

成功挂载，然后启动节点服务：

[root@lyhdb1 bin]# ./crsctl start cluster

CRS-2672: Attempting to start 'ora.crsd' on 'lyhdb1'

CRS-2676: Start of 'ora.crsd' on 'lyhdb1' succeeded

OK，恢复成功。