WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192

本文记录了在AIX系统上运行的Oracle 11.2.0.2数据库遇到的ASM读取失败问题,详细展示了报警日志,并提供了解决方案,包括工作绕过方法及合并补丁的应用。
系统平台:AIX  6100-05-05-1112
数据库版本:11.2.0.2.0
 
实例的 alert 报错:
 
Errors in file /oracle/app/oracle/diag/rdbms/cshsc/cshsc/trace/cshsc_ora_50987280.trc:
WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192
WARNING: failed to read mirror side 1 of virtual extent 12324 logical extent 0 of file 263 in group [5.939757579] from disk CSHSCDG_0003  allocation unit 14009 reason error; if possible,will try another mirror side
Errors in file /oracle/app/oracle/diag/rdbms/cshsc/cshsc/trace/cshsc_ora_50987280.trc:
WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192
WARNING: failed to read mirror side 1 of virtual extent 12324 logical extent 0 of file 263 in group [5.939757579] from disk CSHSCDG_0003  allocation unit 14009 reason error; if possible,will try another mirror side
Errors in file /oracle/app/oracle/diag/rdbms/cshsc/cshsc/trace/cshsc_ora_50987280.trc:
WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192
WARNING: failed to read mirror side 1 of virtual extent 12324 logical extent 0 of file 263 in group [5.939757579] from disk CSHSCDG_0003  allocation unit 14009 reason error; if possible,will try another mirror side
Errors in file /oracle/app/oracle/diag/rdbms/cshsc/cshsc/trace/cshsc_ora_50987280.trc:
WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192
WARNING: failed to read mirror side 1 of virtual extent 12324 logical extent 0 of file 263 in group [5.939757579] from disk CSHSCDG_0003  allocation unit 14009 reason error; if possible,will try another mirror side
Errors in file /oracle/app/oracle/diag/rdbms/cshsc/cshsc/trace/cshsc_ora_50987280.trc:
WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192
WARNING: failed to read mirror side 1 of virtual extent 12324 logical extent 0 of file 263 in group [5.939757579] from disk CSHSCDG_0003  allocation unit 14009 reason error; if possible,will try another mirror side
 
 
 
cshsc_ora_50987280.trc 的内容如下:
 
WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192
path:/dev/rhdisk46
         incarnation:0xeb2380e3 synchronous result:'I/O error'
         subsys:System iop:0x110a3ac70 bufp:0x7000002a6b9e000 osderr:0x434c5344 osderr1:0x0
WARNING: failed to read mirror side 1 of virtual extent 12324 logical extent 0 of file 263 in group [5.939757579] from disk CSHSCDG_0003  allocation unit 14009 reason e
rror; if possible,will try another mirror side
WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192
path:/dev/rhdisk46
         incarnation:0xeb2380e3 synchronous result:'I/O error'
         subsys:System iop:0x110a3ac70 bufp:0x7000002a6b9e000 osderr:0x434c5344 osderr1:0x0
WARNING: failed to read mirror side 1 of virtual extent 12324 logical extent 0 of file 263 in group [5.939757579] from disk CSHSCDG_0003  allocation unit 14009 reason e
rror; if possible,will try another mirror side
WARNING: Read Failed. group:5 disk:3 AU:14009 offset:630784 size:8192
path:/dev/rhdisk46
         incarnation:0xeb2380e3 synchronous result:'I/O error'
         subsys:System iop:0x110a3ac70 bufp:0x7000002a6b9e000 osderr:0x434c5344 osderr1:0x0
WARNING: failed to read mirror side 1 of virtual extent 12324 logical extent 0 of file 263 in group [5.939757579] from disk CSHSCDG_0003  allocation unit 14009 reason e
rror; if possible,will try another mirror side
 
 

Cause

Check:

1) ASM side:

* Make sure the ASM instance remains up and running, despite of these entries/messages.
* Verify that all ASM disk groups remain mounted and have no offlined ASM disks.
* Overall, the ASM instance is functional (one can connect to it, run queries on the various v$asm% views, like: v$asm_diskgroup, v$asm_disk)

2) The database remains open and operational (no outage).

3) Storage level:

* The sysadmin, storage admin, and storage vendor has verified no errors in the OS system logs nor any other storage related logs, in regards to any of the disks or devices utilized by the ASM disk groups.

Furthermore, they have ran all due IO and hardware diagnostics on these devices/disks and they found no real IO or hardware related issue.

4) After all above checked okay, then this is related to Bug:10051315 , Bug:10055063 and Bug:10422126 which fix is included in 11.2.0.3

Solution

Either use the work-around or apply the merge patch.

1) Work-around:

Prevent the file system from filling up by a) saving these files to another location with larger storage space or some type of offline storage (i.e., tape, etc.) AND b) either truncate or remove the logs / trc files periodically and systematically (i.e, cron job, etc)

2) Merge patch:

Select proper Oracle Release/version and platform, and apply patch: https://updates.oracle.com/download/10422126.html

来自 “ ITPUB博客 ” ,链接:http://blog.itpub.net/22308399/viewspace-752211/,如需转载,请注明出处,否则将追究法律责任。

转载于:http://blog.itpub.net/22308399/viewspace-752211/

Line 58282: M00DD4C 08-28 09:41:12.701 891 891 I update_engine: [INFO:snapshot.cpp(2718)] Mapped COW device for system_ext_b at /dev/block/dm-38 Line 58283: M00DD4D 08-28 09:41:12.704 891 891 I update_engine: [INFO:writer_base.cpp(83)] COW image /dev/block/dm-38 has size 88068096 Line 58285: M00DD4F 08-28 09:41:12.729 891 891 I update_engine: [INFO:writer_v2.cpp(177)] Batch writes: enabled Line 58286: M00DD50 08-28 09:41:12.732 891 891 I update_engine: [INFO:writer_v2.cpp(182)] Not creating new threads for compression. Line 58287: M00DD51 08-28 09:41:12.733 891 891 I update_engine: [INFO:vabc_partition_writer.cc(254)] VABC XOR enabled for partition system_ext Line 58288: M00DD52 08-28 09:41:12.734 891 891 I update_engine: [INFO:vabc_partition_writer.cc(262)] Snapuserd supports XOR and merge sequence, writing merge sequence and delay writing COPY operations Line 58457: M00DDFB 08-28 09:41:16.188 891 891 W update_engine: [WARNING:verified_source_fd.cc(130)] Source hash from RAW device mismatched: found 784B25221EF7697C385AC7BAA5BCE6E4187FFE34B3A32BA69CC5176FA5CF6EB4, expected DC3041888E44BBDA8F960A514204634C03383A563324C6A165E4D06209C9EEC2 Line 65400: M00F86E 08-28 09:43:18.900 891 891 E update_engine: [ERROR:utils.cc(683)] fd_force_ro >= 0 failed: No such file or directory Line 65401: M00F86F 08-28 09:43:18.904 891 891 E update_engine: [ERROR:utils.cc(190)] rc >= 0 failed: Operation not permitted Line 65402: M00F870 08-28 09:43:18.905 891 891 E update_engine: [ERROR:extent_writer.cc(53)] utils::WriteAll(fd_, c_bytes + bytes_written, bytes_to_write) failed. Line 65403: M00F871 08-28 09:43:18.906 891 891 E update_engine: [ERROR:verified_source_fd.cc(80)] writer.Write(source_data.data(), source_data.size()) failed. Line 68848: E0105C5 08-28 09:43:50.088 1048 1087 I am_cpu : [891,0,update_engine,310785,75300,263960]解析log
最新发布
08-29
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值