接到客户的电话,说他们数据库1号节点13号晚上21:06分的时候有过强制重启,环境为两个节点的RAC DB版本为10.2.0.4 OS版本为Red Hat as 4 up ,以下为alert日志信息
Mon Jun 13 21:06:50 2011
Errors in file /u01/app/oracle/admin/ncdb/bdump/ncdb1_lms5_29371.trc:
ORA-00600: internal error code, arguments: [kjmpsch:rcvrd], [49], [6], [], [], [], [],
[]
Mon Jun 13 21:06:50 2011
Trace dumping is performing id=[cdmp_20110613210650]
Mon Jun 13 21:06:54 2011
Errors in file /u01/app/oracle/admin/ncdb/bdump/ncdb1_lms5_29371.trc:
ORA-00600: internal error code, arguments: [kjmpsch:rcvrd], [49], [6], [], [], [], [],
[]
Mon Jun 13 21:06:54 2011
LMS5: terminating instance due to error 484
Mon Jun 13 21:06:56 2011
Shutting down instance (abort)
License high water mark = 137
Mon Jun 13 21:06:59 2011
Instance terminated by LMS5, pid = 29371
Mon Jun 13 21:07:01 2011
Instance terminated by USER, pid = 1992
Mon Jun 13 21:07:09 2011
Starting ORACLE instance (normal)
是个600的错误,第一字段的rcvrd应该跟网络接收方面有关,实例被LMS5进程abort了。通过查询metalink发现了有关类似的错误:
Bug 8613454: ORA-00600: INTERNAL ERROR CODE, ARGUMENTS: [KJMPSCH:RCVRD] |
|
Hdr: 8613454 10.2.0.4 RDBMS 10.2.0.4 RAC PRODID-5 PORTID-226
Abstract: RA-600: INTERNAL ERROR CODE, ARGUMENTS: [KJMPSCH:RCVRD]
*** 06/18/09 07:15 am ***
TAR:
----
PROBLEM:
--------
Instance terminated due to [kjmpsch:rcvrd].There is no bonding of network
cards. Jumbo frame is not used. OSW logs does not show any packet dropped
or error.
DIAGNOSTIC ANALYSIS:
--------------------
Alert log instance 2
===================
Errors in file /oracle/app/admin/orcl/bdump/orcl1_lms1_8712.trc:
ORA-600: internal error code, arguments: [kjmpsch:rcvrd], [49], [2], [],
[], [], [], []
Mon May 25 22:05:38 2009
Errors in file /oracle/app/admin/orcl/bdump/orcl1_lms1_8712.trc:
ORA-600: internal error code, arguments: [kjmpsch:rcvrd], [49], [2], [],
[], [], [], []
Mon May 25 22:05:38 2009
Trace dumping is performing id=[cdmp_20090525220538]
Mon May 25 22:05:42 2009
Errors in file /oracle/app/admin/orcl/bdump/orcl1_lms1_8712.trc:
ORA-600: internal error code, arguments: [kjmpsch:rcvrd], [49], [2], [],
[], [], [], []
Mon May 25 22:05:42 2009
LMS1: terminating instance due to error 484
Mon May 25 22:05:47 2009
Shutting down instance (abort)
=============
lms trace shows
===============
ksfdmp <- kgerinv <- kgeasnmierr <- kjbmpsch <- kjmxmpm <- kjmpmsgi <- kjmsm
==============
WORKAROUND:
-----------
Not any.
RELATED BUGS:
-------------
Bug 5052082
Bug 8593606
REPRODUCIBILITY:
----------------
TEST CASE:
----------
STACK TRACE:
------------
SUPPORTING INFORMATION:
-----------------------
24 HOUR CONTACT INFORMATION FOR P1 BUGS:
----------------------------------------
DIAL-IN INFORMATION:
--------------------
IMPACT DATE:
------------
*** 06/18/09 07:18 am ***
*** 06/18/09 07:22 am ***
*** 06/18/09 10:08 am ***
*** 06/18/09 10:08 am *** (ADD: Impact/Symptom->DATABASE CRASH )
*** 06/18/09 10:08 am *** (ADD: Impact/Symptom->INTERNAL ERROR )
*** 06/18/09 10:08 am ***
*** 06/18/09 10:49 am *** (CHG: Sta->10)
*** 06/18/09 10:49 am ***
*** 06/18/09 10:57 am *** (CHG: Sta->16)
*** 06/18/09 10:57 am ***
*** 06/18/09 02:23 pm *** (CHG: Sta->10)
*** 06/18/09 02:23 pm ***
*** 07/16/09 01:17 pm *** (CHG: Sta->33)
*** 07/16/09 01:17 pm ***
*** 07/16/09 07:43 pm *** (CHG: Sta->16)
*** 07/16/09 07:43 pm ***
*** 07/16/09 07:44 pm ***
*** 07/17/09 07:31 am *** (CHG: Sta->45)
*** 07/17/09 07:31 am ***
*** 10/26/09 05:14 am *** (CHG: Sta->95)