asm增加磁盘由于Bug19874632导致磁盘块头丢失ORA-15196

数据库日志，磁盘组突然被dismount掉： Tue Apr 02 10:39:15 2024 Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_lgwr_150319.trc: ORA-00345: redo log write error block 222293 count 1 ORA-00312: online log 5 thread 1: '+DB/orcl/onlinelog/group_5.266.1018653861' ORA-15079: ASM file is closed ORA-15079: ASM file is closed ORA-00345: redo log write error block 222293 count 1 ORA-00312: online log 5 thread 1: '+DB/orcl/onlinelog/group_5.267.1018653861' ORA-15079: ASM file is closed ORA-15079: ASM file is closed SUCCESS: diskgroup DB was dismounted SUCCESS: diskgroup DB was dismounted Tue Apr 02 10:39:16 2024 Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_ckpt_150321.trc: ORA-00206: error in writing (block 3, # blocks 1) of control file ORA-00202: control file: '+DB/orcl/controlfile/current.260.1018653857' ORA-15078: ASM diskgroup was forcibly dismounted ORA-15078: ASM diskgroup was forcibly dismounted ORA-00206: error in writing (block 3, # blocks 1) of control file ORA-00202: control file: '+DB/orcl/controlfile/current.261.1018653857' ORA-15078: ASM diskgroup was forcibly dismounted ORA-15078: ASM diskgroup was forcibly dismounted Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_ckpt_150321.trc: ORA-00221: error on write to control file ORA-00206: error in writing (block 3, # blocks 1) of control file ORA-00202: control file: '+DB/orcl/controlfile/current.260.1018653857' ORA-15078: ASM diskgroup was forcibly dismounted ORA-15078: ASM diskgroup was forcibly dismounted ORA-00206: error in writing (block 3, # blocks 1) of control file ORA-00202: control file: '+DB/orcl/controlfile/current.261.1018653857' ORA-15078: ASM diskgroup was forcibly dismounted ORA-15078: ASM diskgroup was forcibly dismounted CKPT (ospid: 150321): terminating the instance due to error 221 asm alert日志，增加磁盘过程中 cache read  a corrupt block，块损坏：SQL> ALTER DISKGROUP DB ADD  DISK '/dev/asm-diskm' SIZE 819200M /* ASMCA */  NOTE: GroupBlock outside rolling migration privileged region NOTE: Assigning number (3,3) to disk (/dev/asm-diskm) NOTE: requesting all-instance membership refresh for group=3 Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_ora_48089.trc: ....Tue Apr 02 02:06:35 2024 NOTE: membership refresh pending for group 3/0x7a8273b (DB) Tue Apr 02 02:06:38 2024 GMON querying group 3 at 13 for pid 18, osid 608135 SUCCESS: refreshed membership for 3/0x7a8273b (DB) NOTE: Attempting voting file refresh on diskgroup DB NOTE: Refresh completed on diskgroup DB. No voting file found. .....Tue Apr 02 02:39:13 2024 WARNING: cache read  a corrupt block: group=3(DB) dsk=2 blk=4 disk=2 (DB_0002) incarn=99145693 au=0 blk=4 count=1 Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_arb0_49054.trc: ORA-15196: invalid ASM block header [kfc.c:26368] [check_kfbh] [2147483650] [4] [2359874717 != 2235620521] NOTE: a corrupted block from group DB was dumped to /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_arb0_49054.trc WARNING: cache read (retry) a corrupt block: group=3(DB) dsk=2 blk=4 disk=2 (DB_0002) incarn=99145693 au=0 blk=4 count=1 Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_arb0_49054.trc: ORA-15196: invalid ASM block header [kfc.c:26368] [check_kfbh] [2147483650] [4] [2359874717 != 2235620521] ORA-15196: invalid ASM block header [kfc.c:26368] [check_kfbh] [2147483650] [4] [2359874717 != 2235620521] ERROR: cache failed to read group=3(DB) dsk=2 blk=4 from disk(s): 2(DB_0002) ORA-15196: invalid ASM block header [kfc.c:26368] [check_kfbh] [2147483650] [4] [2359874717 != 2235620521] ORA-15196: invalid ASM block header [kfc.c:26368] [check_kfbh] [2147483650] [4] [2359874717 != 2235620521] NOTE: cache initiating offline of disk 2 group DB NOTE: process _arb0_+asm1 (49054) initiating offline of disk 2.99145693 (DB_0002) with mask 0x7e in group 3 NOTE: initiating PST update: grp = 3, dsk = 2/0x5e8d7dd, mask = 0x6a, op = clear Tue Apr 02 02:39:13 2024 GMON updating disk modes for group 3 at 14 for pid 39, osid 49054 ERROR: Disk 2 cannot be offlined, since diskgroup has external redundancy. ERROR: too many offline disks in PST (grp 3) Tue Apr 02 02:39:13 2024 NOTE: cache dismounting (not clean) group 3/0x07A8273B (DB)  NOTE: messaging CKPT to quiesce pins Unix process pid: 231667, image: oracle@database01 (B000) Tue Apr 02 02:39:13 2024 NOTE: halting all I/Os to diskgroup 3 (DB) Tue Apr 02 02:39:13 2024 NOTE: LGWR doing non-clean dismount of group 3 (DB) NOTE: LGWR sync ABA=72.2161 last written ABA 72.2161 WARNING: Offline for disk DB_0002 in mode 0x7f failed. Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_arb0_49054.trc  (incident=660793): ORA-15335: ASM metadata corruption detected in disk group 'DB' ORA-15130: diskgroup "DB" is being dismounted ORA-15066: offlining disk "DB_0002" in group "DB" may result in a data loss ORA-15196: invalid ASM block header [kfc.c:26368] [check_kfbh] [2147483650] [4] [2359874717 != 2235620521] ORA-15196: invalid ASM block header [kfc.c:26368] [check_kfbh] [2147483650] [4] [2359874717 != 2235620521] Incident details in: /u01/app/grid/diag/asm/+asm/+ASM1/incident/incdir_660793/+ASM1_arb0_49054_i660793.trc bug文档参考： Bug 19874632 - ORA-15196: INVALID ASM BLOCK HEADER [KFC.C:26368] [OBJ_KFBL] [8] [529] [3 != 8] (Doc ID 19874632.8)该问题只能重建磁盘组，要解决这个bug升级到12.2以上版本