问题背景： 客户反馈alert日志有异常，协助排查原因
1> alert日志如下
Thu Jan 09 01:11:13 2020 Hex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc Thu Jan 09 01:11:13 2020 Thu Jan 09 01:11:13 2020 Hex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99756.trcHex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99757.trc Corrupt block relative dba: 0x03e21efe (file 15, block 2236158) Corrupt block relative dba: 0x03e21efe (file 15, block 2236158) Bad check value found during backing up datafile Bad check value found during backing up datafile Data in bad block: Data in bad block: type: 0 format: 2 rdba: 0x03e21efe type: 0 format: 2 rdba: 0x03e21efe last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 spare1: 0x0 spare2: 0x0 spare3: 0x0 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001 check value in block header: 0xba1c consistency value in tail: 0x00000001 computed block checksum: 0x7577 check value in block header: 0xba1c computed block checksum: 0x7577 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data Corrupt block relative dba: 0x03e21efe (file 15, block 2236158) Bad check value found during backing up datafile Data in bad block: type: 0 format: 2 rdba: 0x03e21efe last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001 check value in block header: 0xba1c computed block checksum: 0x7577 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data Thu Jan 09 01:12:00 2020 Thu Jan 09 01:12:00 2020 Hex dump of (file 14, block 2402782) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99757.trcHex dump of (file 14, block 2402782) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782)Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782) Bad check value found during backing up datafileBad check value found during backing up datafile Data in bad block: Data in bad block: type: 0 format: 2 rdba: 0x03a4a9de type: 0 format: 2 rdba: 0x03a4a9de last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 spare1: 0x0 spare2: 0x0 spare3: 0x0 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001 consistency value in tail: 0x00000001 check value in block header: 0xd7a check value in block header: 0xd7a computed block checksum: 0x4a00 computed block checksum: 0x4a00 Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data Thu Jan 09 02:00:00 2020 Clearing Resource Manager plan via parameter Thu Jan 09 02:16:06 2020 Thu Jan 09 02:16:06 2020 Hex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_163742.trcHex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_157959.trc Thu Jan 09 02:16:06 2020 Thu Jan 09 02:16:06 2020 Hex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_162096.trcHex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_159129.trc Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522) Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522) Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522) Bad check value found during backing up datafile Data in bad block: Bad check value found during backing up datafile type: 6 format: 2 rdba: 0x017a57a2 Data in bad block: last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 type: 6 format: 2 rdba: 0x017a57a2 spare1: 0x0 spare2: 0x0 spare3: 0x0 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 consistency value in tail: 0x5bf10601 spare1: 0x0 spare2: 0x0 spare3: 0x0 check value in block header: 0xa735 consistency value in tail: 0x5bf10601 computed block checksum: 0x38ea check value in block header: 0xa735 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522) Bad check value found during backing up datafile computed block checksum: 0xdcae Data in bad block: Bad check value found during backing up datafile type: 6 format: 2 rdba: 0x017a57a2 Data in bad block: last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 type: 6 format: 2 rdba: 0x017a57a2 spare1: 0x0 spare2: 0x0 spare3: 0x0 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 consistency value in tail: 0x5bf10601 spare1: 0x0 spare2: 0x0 spare3: 0x0 check value in block header: 0xa735 consistency value in tail: 0x5bf10601 computed block checksum: 0x38ea check value in block header: 0xa735 computed block checksum: 0xdcae Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid dataReread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data Thu Jan 09 02:17:21 2020 Hex dump of (file 10, block 1328161) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_21502.trc Corrupt block relative dba: 0x02944421 (file 10, block 1328161) Bad check value found during backing up datafile Data in bad block: type: 6 format: 2 rdba: 0x02944421 last change scn: 0x0002.1d713b80 seq: 0x1 flg: 0x06 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x3b800601 check value in block header: 0x49bc computed block checksum: 0x1fde Reread of blocknum=1328161, file=/home/oracle/oadata/orcl04.dbf. found valid data Thu Jan 09 02:21:24 2020 Thread 1 advanced to log sequence 1276 (LGWR switch) Current log# 4 seq# 1276 mem# 0: /opt/app/oracle/oradata/orcl/redo04.log
2> 查看trc文件
[oracle@OAapp02 trace]$ more /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc Trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production With the Partitioning, OLAP, Data Mining and Real Application Testing options ORACLE_HOME = /opt/app/oracle/product/11.2.0/dbhome_1 System name: Linux Node name: OAapp02 Release: 2.6.32-642.el6.x86_64 Version: #1 SMP Tue May 10 17:27:01 UTC 2016 Machine: x86_64 Instance name: orcl Redo thread mounted by this instance: 1 Oracle process number: 335 Unix process pid: 99750, image: oracle@OAapp02 (TNS V1-V3) *** 2020-01-09 01:11:13.237 *** SESSION ID:(1897.31151) 2020-01-09 01:11:13.237 *** CLIENT ID:() 2020-01-09 01:11:13.237 *** SERVICE NAME:(SYS$USERS) 2020-01-09 01:11:13.237 *** MODULE NAME:(backup incr datafile) 2020-01-09 01:11:13.237 *** ACTION NAME:(0000020 STARTED16) 2020-01-09 01:11:13.237 Hex dump of (file 15, block 2236158) Dump of memory from 0x00007F8196521000 to 0x00007F8196523000 7F8196521000 0000A200 03E21EFE 00000000 05010000 [................] 7F8196521010 0000BA1C 00000000 00000000 00000000 [................] 7F8196521020 00000000 00000000 00000000 00000000 [................] Repeat 253 times 7F8196522000 0000A23A 00CADEF3 3C094F76 04010002 [:.......vO.<....] 7F8196522010 00007E08 00000000 00000000 00000000 [.~..............] 7F8196522020 00000000 00000000 00000000 00000000 [................] Repeat 252 times 7F8196522FF0 00000000 00000000 00000000 00000001 [................] Corrupt block relative dba: 0x03e21efe (file 15, block 2236158) Bad check value found during backing up datafile Data in bad block: type: 0 format: 2 rdba: 0x03e21efe last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001 check value in block header: 0xba1c computed block checksum: 0x7577 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data *** 2020-01-09 01:12:00.412 Hex dump of (file 14, block 2402782) Dump of memory from 0x00007F81962C1000 to 0x00007F81962C3000 7F81962C1000 0000A200 03A4A9DE 00000000 05010000 [................] 7F81962C1010 00000D7A 00000000 00000000 00000000 [z...............] 7F81962C1020 00000000 00000000 00000000 00000000 [................] Repeat 261 times 7F81962C2080 00000000 34540100 0B959D5B 01FF2C00 [......T4[....,..] 7F81962C2090 002EFF80 02010054 0000800C 00000002 [....T...........] 7F81962C20A0 10000001 00CE2B2E 0000091A 00000000 [.....+..........] 7F81962C20B0 0000000A 00010000 00330032 00320033 [........2.3.3.2.] 7F81962C20C0 00000000 00000000 00000000 00000000 [................] Repeat 19 times 7F81962C2200 00000009 06000000 00000000 4E670100 [..............gN] 7F81962C2210 2C00E151 FF8001FF 00540030 800C0201 [Q..,....0.T.....] 7F81962C2220 00020000 00010000 6A2E1000 091C0044 [...........jD...] 7F81962C2230 00000000 000C0000 00000000 00310001 [..............1.] 7F81962C2240 00000000 00000000 00000000 00000000 [................] Repeat 218 times 7F81962C2FF0 00000000 00000000 00000000 00000001 [................] Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782) Bad check value found during backing up datafile Data in bad block: type: 0 format: 2 rdba: 0x03a4a9de last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001 check value in block header: 0xd7a computed block checksum: 0x4a00 Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data
上述日志为数据库rman备份是检查数据文件是否有坏块的日志，无需担心
更多内容请关注微信公众号：DBA每日记
