刚才解决了一个和RAC相关的问题!

OS组想扩充一下/oracle_backup.结果重启机器了。里面的文件都没了。

还好里面都是备份文件。

机器重启后数据库没启动。

$ srvctl status database -d RTST

Instance RTST1 is not running on node tst-rac01-ud-us-eqx
Instance RTST2 is not running on node tst-rac02-ud-us-eqx
$ $ srvctl start database -d RTST
PRKP-1001 : Error starting instance RTST1 on node tst-rac01-ud-us-eqx
CRS-0215: Could not start resource 'ora.RTST.RTST1.inst'.
PRKP-1001 : Error starting instance RTST2 on node tst-rac02-ud-us-eqx
CRS-0215: Could not start resource 'ora.RTST.RTST2.inst'.
$ tail -f al*.log
Interface type 1 e1000g0 10.12.32.0 configured from OCR for use as a public interface
Picked latch-free SCN scheme 3
Thu Mar 26 21:15:44 2009
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 e1000g2 172.16.0.128 configured from OCR for use as a cluster interconnect
Interface type 1 e1000g3 172.16.1.0 configured from OCR for use as a cluster interconnect
Interface type 1 e1000g0 10.12.32.0 configured from OCR for use as a public interface
Picked latch-free SCN scheme 3
$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....ST1.srv application ONLINE OFFLINE
ora....TST1.cs application ONLINE OFFLINE
ora....T1.inst application ONLINE OFFLINE
ora....ST2.srv application ONLINE OFFLINE
ora....TST2.cs application ONLINE OFFLINE
ora....T2.inst application ONLINE OFFLINE
ora.RTST.db application ONLINE OFFLINE
ora....QX.lsnr application ONLINE ONLINE tst-...-eqx
ora....eqx.ons application ONLINE ONLINE tst-...-eqx
ora....eqx.vip application ONLINE ONLINE tst-...-eqx
ora....QX.lsnr application ONLINE ONLINE tst-...-eqx
ora....eqx.ons application ONLINE ONLINE tst-...-eqx
ora....eqx.vip application ONLINE ONLINE tst-...-eqx
看来问题严重了。
$ crs_start -all
Attempting to start `ora.RTST.RTST1.inst` on member `tst-rac01-ud-us-eqx`
Attempting to start `ora.RTST.RTST2.inst` on member `tst-rac02-ud-us-eqx`
Start of `ora.RTST.RTST1.inst` on member `tst-rac01-ud-us-eqx` failed.
Start of `ora.RTST.RTST2.inst` on member `tst-rac02-ud-us-eqx` failed.
tst-rac02-ud-us-eqx : CRS-1019: Resource ora.RTST.RTST1.inst (application) cannot run on tst-rac02-ud-us-eqx


tst-rac01-ud-us-eqx : CRS-1019: Resource ora.RTST.RTST2.inst (application) cannot run on tst-rac01-ud-us-eqx


Attempting to start `ora.RTST.RTST1.RTST1.srv` on member `tst-rac01-ud-us-eqx`
Attempting to start `ora.RTST.RTST1.cs` on member `tst-rac01-ud-us-eqx`
Attempting to start `ora.RTST.RTST2.cs` on member `tst-rac02-ud-us-eqx`
Attempting to start `ora.RTST.db` on member `tst-rac01-ud-us-eqx`
Attempting to start `ora.RTST.RTST2.RTST2.srv` on member `tst-rac02-ud-us-eqx`
Start of `ora.RTST.RTST1.RTST1.srv` on member `tst-rac01-ud-us-eqx` failed.
Attempting to start `ora.RTST.RTST1.RTST1.srv` on member `tst-rac02-ud-us-eqx`
Start of `ora.RTST.RTST2.RTST2.srv` on member `tst-rac02-ud-us-eqx` failed.
Attempting to start `ora.RTST.RTST2.RTST2.srv` on member `tst-rac01-ud-us-eqx`
Start of `ora.RTST.RTST1.RTST1.srv` on member `tst-rac02-ud-us-eqx` failed.
CRS-1006: No more members to consider

Start of `ora.RTST.RTST2.RTST2.srv` on member `tst-rac01-ud-us-eqx` failed.
CRS-1006: No more members to consider

Start of `ora.RTST.db` on member `tst-rac01-ud-us-eqx` failed.
Attempting to start `ora.RTST.db` on member `tst-rac02-ud-us-eqx`
Start of `ora.RTST.RTST1.cs` on member `tst-rac01-ud-us-eqx` failed.
Attempting to start `ora.RTST.RTST1.cs` on member `tst-rac02-ud-us-eqx`
Start of `ora.RTST.RTST2.cs` on member `tst-rac02-ud-us-eqx` failed.
Attempting to start `ora.RTST.RTST2.cs` on member `tst-rac01-ud-us-eqx`
Start of `ora.RTST.db` on member `tst-rac02-ud-us-eqx` failed.
CRS-1006: No more members to consider

Start of `ora.RTST.RTST1.cs` on member `tst-rac02-ud-us-eqx` failed.
CRS-1006: No more members to consider

Start of `ora.RTST.RTST2.cs` on member `tst-rac01-ud-us-eqx` failed.
CRS-1006: No more members to consider

CRS-0215: Could not start resource 'ora.RTST.RTST1.RTST1.srv'.

CRS-0215: Could not start resource 'ora.RTST.RTST1.cs'.

CRS-0215: Could not start resource 'ora.RTST.RTST1.inst'.

CRS-0215: Could not start resource 'ora.RTST.RTST2.RTST2.srv'.

CRS-0215: Could not start resource 'ora.RTST.RTST2.cs'.

CRS-0215: Could not start resource 'ora.RTST.RTST2.inst'.

CRS-0215: Could not start resource 'ora.RTST.db'.
到数据库里试一下，
SQL> startup
ORA-32004: obsolete and/or deprecated parameter(s) specified
ORA-01261: Parameter db_recovery_file_dest destination string cannot be translated
ORA-01262: Stat failed on a file destination directory
SVR4 Error: 2: No such file or directory
SQL> show parameter db_recovery_file
ORA-01034: ORACLE not available。
发现问题了。
在备份的PFILE中找到这个参数的设置：
*.db_recovery_file_dest='/oracle_backup/RTST/flash'
mkdir -p /oracle_backup/RTST/flash

$ crs_start -all
Attempting to start `ora.RTST.RTST1.inst` on member `tst-rac01-ud-us-eqx`
Start of `ora.RTST.RTST1.inst` on member `tst-rac01-ud-us-eqx` succeeded.
$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....ST1.srv application ONLINE ONLINE tst-...-eqx
ora....TST1.cs application ONLINE ONLINE tst-...-eqx
ora....T1.inst application ONLINE ONLINE tst-...-eqx
ora....ST2.srv application ONLINE ONLINE tst-...-eqx
ora....TST2.cs application ONLINE ONLINE tst-...-eqx
ora....T2.inst application ONLINE ONLINE tst-...-eqx
ora.RTST.db application ONLINE ONLINE tst-...-eqx
ora....QX.lsnr application ONLINE ONLINE tst-...-eqx
ora....eqx.ons application ONLINE ONLINE tst-...-eqx
ora....eqx.vip application ONLINE ONLINE tst-...-eqx
ora....QX.lsnr application ONLINE ONLINE tst-...-eqx
ora....eqx.ons application ONLINE ONLINE tst-...-eqx
ora....eqx.vip application ONLINE ONLINE tst-...-eqx