20200620-Oracle RAC启动失败(DNS故障)

问题：

数据库启动报错：ORA-00119、ORA-00132等

环境：

DB:Oracle 11.2.0.4.0
OS:Redhat 6.5

问题现象：

启动数据库报错：

[grid@rac01 ~]$ srvctl start database -d cjcdb

PRCR-1079 : Failed to start resource ora.cjcdb.db
CRS-5017: The resource action "ora.cjcdb.db start" encountered the following error: 
ORA-00119: invalid specification for system parameter REMOTE_LISTENER
ORA-00132: syntax error or unresolved network name 'rac-scan.cjc.com:1521'
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/rac02/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-5017: The resource action "ora.cjcdb.db start" encountered the following error: 
ORA-00119: invalid specification for system parameter REMOTE_LISTENER
ORA-00132: syntax error or unresolved network name 'rac-scan.cjc.com:1521'
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/rac01/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-2674: Start of 'ora.cjcdb.db' on 'rac02' failed
CRS-2674: Start of 'ora.cjcdb.db' on 'rac01' failed
CRS-2632: There are no more servers to try to place resource 'ora.cjcdb.db' on that would satisfy its placement policy

其中remote_listener参数值为：rac-scan.cjc.com:1521

问题原因:

怀疑DNS解析SCAN失败

登录到rac01执行nslookup rac-scan.cjc.com

[root@rac01 bin]# nslookup rac-scan.cjc.com
;; connection timed out; trying next origin
;; connection timed out; no servers could be reached

查看resolv.conf配置信息被清空了，实际上每次服务器重启网卡resolv.conf配置都会被自动清空

[root@rac01 bin]# cat /etc/resolv.conf
# Generated by NetworkManager
nameserver 8.8.8.8

检查网卡配置文件里没有指定90的DNS，手动添加90DNS。

[root@rac02 bin]# cd /etc/sysconfig/network-scripts/
[root@rac02 network-scripts]# vim ifcfg-eth0
DNS1="192.168.31.90"

解决方案:

重新添加resolv.conf配置信息

[root@rac01 bin]# vim /etc/resolv.conf
# Generated by NetworkManager
nameserver 8.8.8.8
domain  cjc.com
nameserver 192.168.31.90
options rotate
options timeout:2
options attempts:5

可以正常解析了

[root@rac01 bin]# nslookup rac-scan.cjc.com
Server:192.168.31.90
Address:192.168.31.90#53
Name:rac-scan.cjc.com
Address: 192.168.31.60
Name:rac-scan.cjc.com
Address: 192.168.31.70
Name:rac-scan.cjc.com
Address: 192.168.31.50

启动数据

[root@rac01 bin]# ./srvctl start instance -d cjcdb -i cjcdb1
[root@rac01 bin]# ./srvctl start instance -d cjcdb -i cjcdb2

检查实例状态

[root@rac01 bin]# ./srvctl status database -d cjcdb
Instance cjcdb1 is running on node rac01
Instance cjcdb2 is running on node rac02

欢迎关注我的微信公众号"IT小Chen"