Oracle 11gR2.0.3 RAC install On Linux(CentOS release 5.9 ) Using NFS实践记录by lwg

最新推荐文章于 2025-07-18 10:59:20 发布

原创最新推荐文章于 2025-07-18 10:59:20 发布 · 509 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#grid #NFS #oracle11G RAC instal

本文记录了在Linux CentOS 5.9上使用NFS进行Oracle 11gR2 RAC安装的详细过程，包括操作系统级别的配置、安装部署步骤及遇到的问题及解决方案。旨在分享技术实践经验和解决方法。

Oracle 11gR2.0.3 RAC install On Linux(CentOS release 5.9 ) Using NFS实践记录

发次博文原因背景和原因：

注册为csdn的用户已经有十多年了，很惭愧，第一次在这里发博文。上周参加过oracle2014技术嘉年华后被老盖等人的分享精神所感动，特在此发表第一偏博文，分享今年上半年的一次技术实践文章.不妥之处敬请大侠们包涵。

第一部分：整体规划
功能说明：
---------------
在192.168.11.61 62上无磁盘阵列（--通过NFS共享软件）安装oracle 11gR2.0.3 RAC,database
cluster ,database 分别安装在本地rac1,rac2节点对应位置上，
ocr,voting disk, datafile存放到共享磁盘上，共享磁盘使用NFS

操作系统介绍： 64位，16G内存， CentOS release 5.9版本
----------------------------查看命令-----------
[root@rac1 ~]# uname -a
Linux rac1 2.6.18-348.el5 #1 SMP Tue Jan 8 17:53:53 EST 2013 x86_64 x86_64 x86_64 GNU/Linux
[root@rac1 ~]# free
total used free shared buffers cached
Mem: 16425800 16185688 240112 0 511652 13804928
-/+ buffers/cache: 1869108 14556692
Swap: 42600684 172 42600512
[root@rac1 ~]# more /etc/issue
CentOS release 5.9 (Final)
--------------------------------------------------

oracle 版本以及安装介质：
----------------------------------
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
rac1:/home/ora_soft$ls -lh
total 3.3G
drwxr-xr-x 8 root root 4.0K Sep 22 2011 database
drwxr-xr-x 8 root root 4.0K Sep 22 2011 grid
-rw-r--r-- 1 root root 23K Jan 24 2013 libXp-1.0.0-8.1.el5.i386.rpm
-rw-r--r-- 1 root root 1.3G Jan 29 2013 p10404530_112030_Linux-x86-64_1of7.zip
-rw-r--r-- 1 root root 1.1G Jan 27 2013 p10404530_112030_Linux-x86-64_2of7.zip
-rw-r--r-- 1 root root 934M Jan 29 2013 p10404530_112030_Linux-x86-64_3of7.zip

网络规划和配置
---------------
[root@rac1 grid]# vi /etc/hosts
#node1
192.168.11.61 rac1 rac1.gboss.com
10.10.10.61 rac1-priv
192.168.11.161 rac1-vip
#node2
192.168.11.62 rac2 rac2.gboss.com
10.10.10.62 rac2-priv
192.168.11.162 rac2-vip
#scan
192.168.11.165 scan cluster-scan
#nas
192.168.11.61 nas

环境变量规划：

grid环境变量
---------------------------------------
export ORACLE_BASE=/opt/grid/base
export ORACLE_HOME=/opt/grid/11.2.0/crs
export ORACLE_SID=+ASM1|2

oracle环境变量
---------------------------------------
export ORACLE_BASE=/opt/oracle
export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
export ORACLE_UNQNAME=gbossdb
export ORACLE_SID=gbossdb1|2

存储规划：
---------------------------------------
1、cluster ,database 分别安装在本地rac1,rac2节点对应位置：grid和oracle 的$ORACLE_HOME 位置上
2、ocr,voting disk, datafile存放到共享磁盘上：存放位置为rac1的：/data 下

主机名规划
--------------------------------------
node1: rac1----对应192.168.11.61
node2: rac2----对应192.168.11.62

第二部分：安装部署实施过程

第一节：操作系统级别配置

1、swap 确认：要稍微大于物理内存
rac1:/home/ora_soft$free
total used free shared buffers cached
Mem: 16425800 16186608 239192 0 514408 13801716
-/+ buffers/cache: 1870484 14555316
Swap: 42600684 172 42600512

若swap 小于物理内存，让系统工程师调整，否则后面安装过程会报警。

2、主机名配置
在安装cluseter时会用到，当时两个主机名一样，导致无法安装

3、网络配置确保
eth0---物理IP，上面分配两个IP地址：节点1：rac1,rac1-vip,scan 节点2：rac2,rac2-vip
eth1---heartbeat心跳网卡：负责两个节点内部数据的通信，分配私有IP：节点1：rac1-priv 节点2：rac2-priv
网卡IP配置方法，root用户调用图形界面，使用命令 #setup
重启网络服务的方法：# service network restart
你要是想重启单独的网卡可以用这个命令：
# ifconfig eth0 down
# ifconfig eth0 up
网卡配置路径、配置文件
[root@rac2 ~]# cd /etc/sysconfig/network-scripts/
[root@rac2 network-scripts]# ls -l
total 404
-rw-r--r-- 3 root root 228 Aug 20 13:18 ifcfg-eth0
-rw-r--r-- 3 root root 190 Aug 20 13:53 ifcfg-eth1

配置正常运行后的网卡检查结果如下：
[root@rac1 ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr D4:BE:D9:B4:C8:37
inet addr:192.168.11.61 Bcast:192.168.11.255 Mask:255.255.255.0
eth0:1 Link encap:Ethernet HWaddr D4:BE:D9:B4:C8:37
inet addr:192.168.11.161 Bcast:192.168.11.255 Mask:255.255.255.0
eth0:2 Link encap:Ethernet HWaddr D4:BE:D9:B4:C8:37
inet addr:192.168.11.165 Bcast:192.168.11.255 Mask:255.255.255.0
eth1 Link encap:Ethernet HWaddr D4:BE:D9:B4:C8:39
inet addr:10.10.10.61 Bcast:10.10.10.255 Mask:255.255.255.0

[root@rac2 ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr D4:BE:D9:F2:B7:FF
inet addr:192.168.11.62 Bcast:192.168.11.255 Mask:255.255.255.0

eth0:1 Link encap:Ethernet HWaddr D4:BE:D9:F2:B7:FF
inet addr:192.168.11.162 Bcast:192.168.11.255 Mask:255.255.255.0
eth1 Link encap:Ethernet HWaddr D4:BE:D9:F2:B8:01
inet addr:10.10.10.62 Bcast:10.10.10.255 Mask:255.255.255.0
------------------------------------------
4 主机名的配置
# vi /etc/hosts
# vi /etc/sysconfig/network中的hostname 为rac1 rac2

第三节：网络、共享存储配置

5、网络、主机名、节点规划---@rac1,2 /etc/hosts
------------------------------------------
[root@rac1 grid]# vi /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
#node1
192.168.11.61 rac1 rac1.gboss.com
10.10.10.61 rac1-priv
192.168.11.161 rac1-vip
#node2
192.168.11.62 rac2 rac2.gboss.com
10.10.10.62 rac2-priv
192.168.11.162 rac2-vip
#scan
192.168.11.165 scan cluster-scan
#nas
192.168.11.61 nas

6、NFS 服务器配置：建共享存储目录、配置NFS服务、重启NFS服务：run@rac1
Create Shared Disks创建共享存储路径：
First we need to set up some NFS shares. In this case we will do this on the RAC1 node,
but you can do the on a NAS or a third server if you have one available.
On the RAC1 node create the following directories.
mkdir -p /data/shared_config
mkdir -p /data/shared_data

Add the following lines to the "/etc/exports" file @NFS 服务器 on rac1 192.168.11.61
/data/shared_config *(rw,sync,no_wdelay,insecure_locks,no_root_squash)
/data/shared_data *(rw,sync,no_wdelay,insecure_locks,no_root_squash)

Run the following command to export the NFS shares.@@NFS 服务器 on rac1

#chkconfig nfs on
#service nfs restart

7、共享存储的配置：NFS 服务器rac1、客户端rac2创建目录、配置启动时自动挂载、mount

创建目录
On both RAC1 and RAC2 create the directories in which the Oracle software will be installed.
mkdir -p /opt/grid/shared_config #grid 的ocr ,voting disk 磁盘共享
mkdir -p /opt/oracle/oradata #oracle的data file ,archive 磁盘共享
mkdir -p /opt/grid/11.2.0/crs #grid 的$ORACLE_HOME 本地
mkdir -p /opt/oracle/product/11.2.0/db_1 #oracle 的$ORACLE_HOME 本地

配置随机启动自动挂载
Add the following lines to the "/etc/fstab" file.---on both service @ rac1 rac2 启动时自动挂载

nas:/data/shared_config /opt/grid/shared_config nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
nas:/data/shared_data /opt/oracle/oradata nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0

挂载共享存储
Mount the NFS shares on both servers@rac1,rac2.
mount /opt/grid/shared_config
mount /opt/oracle/oradata

第二节：用户、目录、环境变量配置、内核参数配置
8.在各节点上添加组和用户
# groupadd -g 1000 oinstall
# groupadd -g 1031 dba
# useradd -u 1101 -g oinstall -G dba oracle
# passwd oracle
# useradd -u 1100 -g oinstall -G dba grid
# passwd grid

9.在各节点上创建文件夹
#mkdir -p /opt/grid/shared_config
#mkdir -p /opt/grid/
#mkdir -p /opt/grid/11.2.0/crs
#mkdir -p /opt/oracle/product/11.2.0/db_1
#mkdir -p /opt/oracle/oradata
#mkdir -p /opt/oracle/

路径属性读写权限配置：
Make sure the permissions on the shared directories are correct.
#chown -R grid:oinstall /opt/grid/shared_config
#chown -R grid:oinstall /opt/grid/
#chown -R grid:oinstall /opt/grid/11.2.0/crs
#chown -R oracle:oinstall /opt/oracle/product/11.2.0/db_1
#chown -R oracle:oinstall /opt/oracle/oradata
#chown -R oracle:oinstall /opt/oracle/
#
#chmod -R 775 /opt/grid/shared_config /opt/grid/11.2.0/crs /opt/oracle/product/11.2.0/db_1 /opt/oracle/oradata /opt/grid

10 内核参数，其他参数的配置检查
vi /etc/sysctl.conf
#-------------------------------------------
fs.aio-max-nr = 1048576
fs.file-max = 6815744
#kernel.shmall = 2097152
#kernel.shmmax = 4294967295
kernel.shmmni = 4096
# semaphores: semmsl, semmns, semopm, semmni
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default=262144
net.core.rmem_max=4194304
net.core.wmem_default=262144
net.core.wmem_max=1048586

kernel.shmmax = 68719476736
# Controls the maximum number of shared memory segments, in pages
kernel.shmall = 4294967296
使参数生效
/sbin/sysctl -p

Add the following lines to the "/etc/security/limits.conf" file.

oracle soft nproc 2047
oracle hard nproc 16384
oracle soft nofile 1024
oracle hard nofile 65536

Add the following lines to the "/etc/pam.d/login" file, if it does not already exist.

session required pam_limits.so

#备注/etc/pam.d/login 64bit
##### add by liangweiguang 20111020##############3
session required /lib64/security/pam_limits.so
#########################end ###################

4,取消NTP服务@rac1,2
Either configure NTP, or make sure it is not configured so the Oracle Cluster Time Synchronization Service (ctssd) can synchronize the times of the RAC nodes.
If you want to deconfigure NTP do the following.
service ntpd stop
#Shutting down ntpd: [ OK ]
chkconfig ntpd off
mv /etc/ntp.conf /etc/ntp.conf.orig
rm /var/run/ntpd.pid

第三节以grid用户执行目录grid下的runInstaller命令，进入图像界面安装（前面配置完好后，后面安装会很顺利，只需注意以下要点即可）:
$ ./runInstaller
执行runInstaller,启动安装图形界面.

1>设置网格基础结构
安装选项: 安装和配置集群的网格基础结构.
安装类型: 高级安装
语言: 简体中文
网格即插即用: 集群名称: rac-cluster
SCAN名称: rac-scan
SCAN端口: 1521
不配置GNS,如果需要自动生成虚拟IP，需配置GNS
GNS子域: racgrid
GNS VIP地址: 192.168.89.91
集群节点信息: 编辑和添加主机和虚拟IP名称
主机名虚拟IP名
rac1 rac1-vip
rac2 rac2-vip
点ssh按钮配置节点ssh互信(需要输入grid用户密码)
网络接口使用情况: 接口名称子网接口类型
PublicNet 192.168.11.0 公共
PrivateNet 10.10.10.0 专用

存储选项: Shared file system 共享文件
OCR存储： .Nomal Redundancy :要选三个不同路径
.External Redundancy: /opt/grid/shared_config/ocr

Voting Disk存储： .Nomal Redundancy :要选三个不同路径
.External Redundancy: /opt/grid/shared_config/vdisk
--------------------------------------------------------------
附录：如果存储选项是自动存储管理(ASM）配置如下
存储选项: 自动存储管理(ASM)
创建ASM磁盘组: 当选择存储选项:自动存储管理(ASM)后，需要创建ASM磁盘.
设置ASM磁盘搜索路径/dev/oracleasm/disks/DISK*,出现开始用asmlib创建的磁盘.
/dev/asmdisk*,出现udev配置的磁盘.
设置磁盘组名，使用外部冗余，勾选出现的磁盘
ASM口令: 设置SYS和ASMSNMP的口令，是用相同口令
---------------------------------------------------------------
故障隔离: 不使用智能平台管理接口(IPMI).
安装位置: 设置安装位置默认:Oracle基目录/opt/grid/base，软件位置/opt/grid/11.2.0/crs
先决条件检查: 自动检查先决条件
安装

按提示在各节点上以root用户执行脚本.
# /u01/app/oraInventory/orainstRoot.sh
# /u01/app/11.2.0/grid/root.sh
如果执行出错，须检查各节点的磁盘权限，之前需要配置磁盘权限.
# chown grid:dba /dev/oracleasm/disks/DISK1
或
# chown grid:dba /dev/asmdisk1

执行完脚本，点ok后继续配置
最后验证时出现错误[INS-20802]Oracle Cluster Verification Utility failed.
是因为在Hosts配置文件里配置了SCAN，未启用DNS解析，不影响RAC正常运行
点ok后完成安装.

第四节执行完后检查CRS是否成功检查
[grid@rac1 grid]$ olsnodes
rac1
rac2
[grid@rac01 grid]$ crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

[grid@rac01 grid]$ crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE rac01
ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE rac01
[grid@rac01 ~]$ srvctl status listener
监听程序 LISTENER 已启用
监听程序 LISTENER 正在节点上运行: rac01,rac02

表示CRS已成功.

重新启动节点后，如果集群服务不能启动.
# ./crsctl check crs
Failure 1 contacting CSS daemon
Cannot communicate with CRS
Cannot communicate with EVM
需要检查设备权限的问题，如果没有使用udev的rules文件配置设备文件权限，重启后磁盘设备owner会被修改为root.
或者没有设置crs随系统启动.
# /opt/grid/11.2.0/crs/bin/crsctl stop crs # 停止CRS服务
# /opt/grid/11.2.0/crs/bin/crsctl start crs # 启动CRS服务
# /opt/grid/11.2.0/crs/bin/crsctl disable crs # 禁止随系统启动
# /opt/grid/11.2.0/crs/bin/crsctl enable crs # 允许随系统启动
# /opt/grid/11.2.0/crs/bin/crsctl stop cluster -all # 停止所有节点上运行的全部集群资源
# /opt/grid/11.2.0/crs/bin/crsctl start cluster -all # 启动所有节点上运行的全部集群资源

第五节安装Oracle数据库软件（RDBMS）
# su - oracle
$ vi .bash_profile
。。。
# unzip linux.x64_11gR2_database_1of2.zip
# unzip linux.x64_11gR2_database_2of2.zip

修改目录权限。
# chown -R oracle:oinstall /opt/oracle
# chmod -R 775 /opt/oracle

以oracle登入系统，运行database下的runInstaller文件。
$ ./runInstaller
配置安全更新不需要接收更新
安装选项选择仅安装数据库软件，后续再通过dbca创建数据库.
网格选项 Real Application Clusters数据库安装
节点全选
点按钮SSH Connectivity.配置oracle下ssh互信.
此时好像有bug，无法输入oracle用户密码，先选单实例，下一步直到输入路径，然后后退，再选择集群数据库可以解决.
产品语言根据需要选择:英语、简体中文
数据库版本企业版
安装位置默认(根据.bash_profile中的全局变量设置)
Oracle基目录: /opt/oracle
软件位置: /opt/oracle/product/11.2.0/db_1
操作系统组 oinstall
先决条件检查忽略警告
安装

按提示在每个节点上执行脚本/opt/oracle/product/11.2.0/db_1/root.sh
点OK完成安装

第四部分遇到的问题以及解决

本人安装过程出现了好多问题，逐个分析原因，都依次顺利解决了，把遇到的问题列举以下：

1、 xmanager 无法掉图形界面：
Solved : SSH X11 forwarding request failed on channel 0
原因：缺包缺 libxp... xterm.x86_64
解决
[root@]# rpm -ivh libXp-1.0.0-8.1.el5.i386.rpm
[root@]# yum install xterm.x86_64
#libXtst.so.6: cannot open shared object file: No such file or directory
解决：
yum install libXtst-devel.i386
yum install libXtst.i386

vi /etc/inittab
id:3:initdefault:
#看来需要把3 改为 5

vi 将sshd_config中设置 X11Forwarding yes
重启sshd服务。
配置和启动命令：
#vi /etc/ssh/sshd_config
X11Forwarding yes
重启命令
# /etc/rc.d/init.d/sshd restart

2、取消ntp服务
因现场没有配置ntpd服务器，使用Oracle CTSS服务来同步时间，ntpd服务配置已经更改，命令如下：
-------------------
cp /etc/ntp.conf /etc/ntp.conf.init_ok
service ntpd stop
chkconfig ntpd off
rm /var/run/ntpd.pid
-------------------

3、11G RAC在安装的时候
出现错误：[INS-40719] IP address configured for Single Client Access Name (SCAN): scan-rac is already assigned to another system.
解决办法：变更cluster name

4,INS-40706 GNS配置
解决办法：不配置，取消打钩
5、INS-40904 ORACLE_HOSTNAME does not resolve to a valid host name
原因：两台机器主机名相同
解决办法：修改主机名，重启。

6、INS-41310 三个位置存放到同一分区,INS-41321 Invalid Oracle Cluster Registry (OCR)location
原因： OCR 存储选择了 Normal Redundancy 存放到三个位置
解决办法：改为 External Redundancy 只存一份

7 INS-41321 Invalid Oracle Cluster Registry (OCR)location
原因： /data/sharedate/ocr路径 NFS配置不当，不能在两个节点共享
解决办法：重新配置NFS共享存储

8.用grid安装cluster 时报错：INS-32026 The Software location specified should not be under Oracle base location
原因： ORACLE_BASE=/opt/grid
software location= /opt/grid/11.2.0/crs (即ORACLE_HOME)
错误原因 ORACLE_HOME（crs软件）直接放到了ORACLE_BASE/下

解决办法：修改 ORACLE_BASE=/opt/grid/base

9 内核参数报警
解决办法：重新配置内核参数
vi /etc/sysctl.conf
-------------------------------------------
fs.aio-max-nr = 1048576
fs.file-max = 6815744
#kernel.shmall = 2097152
#kernel.shmmax = 4294967295
kernel.shmmni = 4096
# semaphores: semmsl, semmns, semopm, semmni
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default=262144
net.core.rmem_max=4194304
net.core.wmem_default=262144
net.core.wmem_max=1048586

kernel.shmmax = 68719476736
# Controls the maximum number of shared memory segments, in pages
kernel.shmall = 4294967296
#-----------------------------------------

Run the following command to change the current kernel parameters.
使参数生效
/sbin/sysctl -p

10 SCAN配置报警
PRVF-4657
解决办法：ignore 忽略继续进行，大不了不用SCAN功能。

11 缺包报警：
解决办法：手动安装11g RAC安装的包
yum install binutils-2.*
yum install compat-libstdc++-33*
yum install elfutils-libelf-0.*
yum install elfutils-libelf-devel-*
yum install gcc-4.*
yum install gcc-c++-4.*
yum install glibc-2.*
yum install glibc-common-2.*
yum install glibc-devel-2.*
yum install glibc-headers-2.*
yum install ksh-2*
yum install libaio-0.*
yum install libaio-devel-0.*
yum install libgcc-4.*
yum install libstdc++-4.*
yum install libstdc++-devel-4.*
yum install make-3.*
yum install sysstat-7.*
yum install unixODBC-2.*
yum install unixODBC-devel-2.*
yum install sysstat.x86_64
yum install pdksh.x86_64
yum install compat-libstdc++-296.i386
yum install compat-libstdc++-33.i386
yum install compat-libstdc++-33.x86_64

----执行
yum install compat-db.x86_64
yum install compat-db.i386
yum install compat-gcc-34.x86_64
yum install compat-gcc-34.x86_64
yum install compat-gcc-34.x86_64
yum install setarch.x86_64
yum install compat-gcc-34.x86_64
yum install compat-gcc-34-c++.x86_64
yum install compat-libstdc++-296.i386
yum install compat-libstdc++-33.x86_64
yum install compat-db.i386
yum install compat-db.x86_64
yum install xterm.x86_64
yum install compat-gcc-34.x86_64
yum install compat-gcc-34-g77.x86_64
yum install libaio-devel.x86_64
yum install libaio-devel.i386
yum install openmotif-devel.x86_64
yum install openmotif-devel.i386
yum install openmotif.x86_64
yum install openmotif.i386
yum install compat-gcc-34-c++.x86_64
yum install compat-gcc-34-c++.x86_64
---------------------------------------
yum install setarch.x86_64
yum install compat-gcc-34.x86_64
yum install compat-gcc-34-c++.x86_64
yum install compat-libstdc++-296.i386
yum install compat-libstdc++-33.x86_64
yum install compat-db.i386
yum install compat-db.x86_64
yum install xterm.x86_64
yum install compat-gcc-34.x86_64
yum install compat-gcc-34-g77.x86_64
yum install libaio-devel.x86_64
yum install libaio-devel.i386
--------------------------------2013年1月24日10:39:52
yum install openmotif-devel.x86_64
yum install openmotif-devel.i386
yum install openmotif.x86_64
yum install openmotif.i386
yum install compat-gcc-34-c++.x86_64
yum install compat-gcc-34-c++.x86_64

12 grid在两个节点上的id不同、oracle在两个节点上的id不同；
解决办法，使用usermod -u uid grid命令修改
#usermod -u 580 grid
#usermod -u 590 oracle

13 swap大小小于物理内存报警：
查看系统当前的分区情况：
#free -m
创建用于交换分区的文件:
#dd if=/dev/zero of=/whatever/swap bs=block_size count=number_of_block
设置交换分区文件:
#mkswap /whatever/swap
立即启用交换分区文件:
#swapon /whateever/swap

若要想使开机时自启用，则需修改文件/etc/fstab中的swap行：
#vi /etc/fstab
/whatever/swap swap swap defaults 0 0

14 两个节点主机名一样：
解决办法：修改主机名
第一步：
#hostname oratest
第二步：
修改/etc/sysconfig/network中的hostname
第三步：
修改/etc/hosts文件

第五部分 rac 自动漂移测试

select instance_name from v$instance;
select * from tab;

连接串操作阻断措施结果
-------------------------------------------------------------------------------------------
rac_vip虚拟IP 1) select... 关闭正在连接节点的监听器不影响select,不中断
2) select... 关闭正在连接节点的实例 vip,物理IP不影响select,不中断自动切换到活动节点,但是scan会中断

rac物理IP 1) select... 关闭正在连接节点的监听器不影响select,不中断
2) select... 关闭正在连接节点的实例不影响select,不中断

scan IP
-------------------------------------------------------------------------------

第六部分，附录，实施成功后的参数摘录：

grid 环境变量配置
--------------------------
rac1:/home/grid$more .bash_profile

#add by liangweiguang:
export ORACLE_BASE=/opt/grid/base
export ORACLE_HOME=/opt/grid/11.2.0/crs
export ORACLE_SID=+ASM1|2
export NLS_LANG=AMERICAN_AMERICA.zhs16gbk
export NLS_DATE_FORMAT="yyyy-mm-dd hh24:mi:ss"
export PATH=${PATH}:$HOME/bin:$ORACLE_HOME/bin
export PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin
export PATH=${PATH}:$ORACLE_BASE/common/oracle/bin
export ORACLE_PATH=${PATH}:$ORACLE_BASE/common/oracle/sql:$ORACLE_HOME/rdbms/admin
export ORACLE_TERM=xterm
export TNS_ADMIN=$ORACLE_HOME/network/admin
export ORA_NLS10=$ORACLE_HOME/nls/data
export LD_LIBRARY_PATH=$ORACLE_HOME/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib
export CLASSPATH=$ORACLE_HOME/JRE
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib
export THREADS_FLAG=native
export TEMP=/tmp
export TMPDIR=/tmp
export PS1=`hostname`:'$PWD'"$"

export DISPLAY=192.168.30.102:0.0

oracle的环境变量配置：
-----------------------
export ORACLE_BASE=/opt/oracle
export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
export ORACLE_UNQNAME=gbossdb
export ORACLE_SID=gbossdb1|2
#export NLS_LANG=AMERICAN_AMERICA.zhs16gbk
#export NLS_DATE_FORMAT="yyyy-mm-dd hh24:mi:ss"
export PATH=${PATH}:$HOME/bin:$ORACLE_HOME/bin
export PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin
export PATH=${PATH}:$ORACLE_BASE/common/oracle/bin
export ORACLE_TERM=xterm
export AIXTHREAD_SCOPE=S
export TNS_ADMIN=$ORACLE_HOME/network/admin
export CLASSPATH=$ORACLE_HOME/JRE
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib
export THREADS_FLAG=native
export TEMP=/tmp
export TMPDIR=/tmp
export PS1=`hostname`:'$PWD'"$"

-------------------------------------------------

附录二：
4.在各节点上检查和安装需要用到的软件包
根据Oracle官方文档，需要以下软件包:
binutils-2.17.50.0.6
compat-libstdc++-33-3.2.3
compat-libstdc++-33-3.2.3 (32 bit)
elfutils-libelf-0.125
elfutils-libelf-devel-0.125
gcc-4.1.2
gcc-c++-4.1.2
glibc-2.5-24
glibc-2.5-24 (32 bit)
glibc-common-2.5
glibc-devel-2.5
glibc-devel-2.5 (32 bit)
glibc-headers-2.5
ksh-20060214
libaio-0.3.106
libaio-0.3.106 (32 bit)
libaio-devel-0.3.106
libaio-devel-0.3.106 (32 bit)
libgcc-4.1.2
libgcc-4.1.2 (32 bit)
libstdc++-4.1.2
libstdc++-4.1.2 (32 bit)
libstdc++-devel 4.1.2
make-3.81
numactl-devel-0.9.8.x86_64
sysstat-7.0.2
以root用户登录系统，执行以下语句检查软件包是否安装
# rpm -q binutils compat-libstdc++-33 elfutils-libelf elfutils-libelf-devel gcc gcc-c++
# rpm -q glibc glibc-common glibc-devel glibc-headers ksh libaio libaio-devel
# rpm -q libgcc libstdc++ libstdc++-devel make numactl-devel sysstat unixODBC unixODBC-devel
找到Redhat Enterprise Linux5 x86_64安装光盘的Server目录，安装没有安装的软件包
# rpm -ivh compat-db-4.2.52-5.1.x86_64.rpm

附录三：时钟服务器
If you are using DNS, then only the first line needs to be present in the "/etc/hosts" file. The other entries are defined in the DNS, as described here. Having said that, I typically include all but the SCAN addresses.

Change the setting of SELinux to permissive by editing the "/etc/selinux/config" file, making sure the SELINUX flag is set as follows.

SELINUX=permissive
Alternatively, this alteration can be done using the GUI tool (System > Administration > Security Level and Firewall). Click on the SELinux tab and disable the feature.

If you have the Linux firewall enabled, you will need to disable or configure it, as shown here or here. The following is an example of disabling the firewall.

# service iptables stop
# chkconfig iptables off
Either configure NTP, or make sure it is not configured so the Oracle Cluster Time Synchronization Service (ctssd) can synchronize the times of the RAC nodes. If you want to deconfigure NTP do the following.

# service ntpd stop
Shutting down ntpd: [ OK ]
# chkconfig ntpd off
# mv /etc/ntp.conf /etc/ntp.conf.orig
# rm /var/run/ntpd.pid
If you want to use NTP, you must add the "-x" option into the following line in the "/etc/sysconfig/ntpd" file.

OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid"
Then restart NTP.

# service ntpd restart