Shulou(Shulou.com)06/01 Report--

Previously, the RAC environment failed and the node 2 operating system crashed. After reinstalling the system, CRS was added successfully, but there was a problem with CRS startup. It was found that the + DATA diskgroup of node 2 ASM could not mount, and the following error was reported:

ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DATA"

Check the status of disk groups and disks on the ASM instance and find that 3 of the 6 disks with + DATA diskgroup are MEMBER and 3 are PROVISIONED.

NOMOUNT status, which causes the add operation to fail. When you try to add a disk to the node that is currently working normally, the error is also reported:

SQL > alter diskgroup DATA add disk'/ dev/oracleasm/disks/OADB_DATA_300G_6'

Alter diskgroup DATA add disk'/ dev/oracleasm/disks/OADB_DATA_300G_6'

*

ERROR at line 1:

ORA-15032: not all alterations performed

ORA-15029: the disk'/ dev/oracleasm/disks/OADB_DATA_300G_6' is already mounted by this instance solution is either to rebuild the ASM disk or to modify the ASM disk header information directly. It takes too long to rebuild, because there is a local backup library, which can be switched at any time, and it is finally decided to modify the ASM disk head information directly through the KFED tool.

The steps are as follows:

1. Compile kfed first

# cd $ORACLE_HOME/rdbms/lib

# make-f ins_rdbms.mk ikfed

2. Read the fault ASM disk head information with kfed

$kfed read / dev/oracleasm/disks/OADB_DATA_DISK_1

Kfbh.endian: 1; 0x000: 0x01

Kfbh.hard: 130,130; 0x001: 0x82

Kfbh.type: 1; 0x002: KFBTYP_DISKHEAD

Kfbh.datfmt: 1; 0x003: 0x01

Kfbh.block.blk: 0; 0x004: titled 0 NUMB=0x0

Kfbh.block.obj: 2147483649; 0x008: TYPE=0x8 NUMB=0x1

Kfbh.check: 1802212223; 0x00c: 0x6b6b937f

Kfbh.fcn.base: 0; 0x010: 0x00000000

Kfbh.fcn.wrap: 0; 0x014: 0x00000000

Kfbh.spare1: 0; 0x018: 0x00000000

Kfbh.spare2: 0; 0x01c: 0x00000000

Kfdhdb.driver.provstr: ORCLDISK; 0x000: length=8

Kfdhdb.driver.reserved [0]: 0; 0x008: 0x00000000

Kfdhdb.driver.reserved [1]: 0; 0x00c: 0x00000000

Kfdhdb.driver.reserved [2]: 0; 0x010: 0x00000000

Kfdhdb.driver.reserved [3]: 0; 0x014: 0x00000000

Kfdhdb.driver.reserved [4]: 0; 0x018: 0x00000000

Kfdhdb.driver.reserved [5]: 0; 0x01c: 0x00000000

Kfdhdb.compat: 168820736; 0x020: 0x0a100000

Kfdhdb.dsknum: 1; 0x024: 0x0001

Kfdhdb.grptyp: 1; 0x026: KFDGTP_EXTERNAL

Kfdhdb.hdrsts: 3; 0x027: KFDHDR_MEMBER

Kfdhdb.dskname: DATAG1_0001; 0x028: length=11

Kfdhdb.grpname: DATAG1; 0x048: length=6

Kfdhdb.fgname: DATAG1_0001; 0x068: length=11

Kfdhdb.capname:; 0x088: length=0

Kfdhdb.crestmp.hi: 32928501; 0x0a8: HOUR=0x15 DAYS=0x17 MNTH=0xc YEAR=0x7d9

Kfdhdb.crestmp.lo: 2195144704; 0x0ac: USEC=0x0 MSEC=0x1d0 SECS=0x2d MINS=0x20

Kfdhdb.mntstmp.hi: 32940275; 0x0b0: HOUR=0x13 DAYS=0x7 MNTH=0x8 YEAR=0x7da

Kfdhdb.mntstmp.lo: 3201116160; 0x0b4: USEC=0x0 MSEC=0x34a SECS=0x2c MINS=0x2f

Kfdhdb.secsize: 512; 0x0b8: 0x0200

Kfdhdb.blksize: 4096; 0x0ba: 0x1000

Kfdhdb.ausize: 1048576; 0x0bc: 0x00100000

Kfdhdb.mfact: 113792; 0x0c0: 0x0001bc80

Kfdhdb.dsksize: 512000; 0x0c4: 0x0007d000

Kfdhdb.pmcnt: 6; 0x0c8: 0x00000006

Kfdhdb.fstlocn: 1; 0x0cc: 0x00000001

Kfdhdb.altlocn: 2; 0x0d0: 0x00000002

Kfdhdb.f1b1locn: 0; 0x0d4: 0x00000000

Kfdhdb.redomirrors [0]: 0; 0x0d8: 0x0000

Kfdhdb.redomirrors [1]: 0; 0x0da: 0x0000

Kfdhdb.redomirrors [2]: 0; 0x0dc: 0x0000

Kfdhdb.redomirrors [3]: 0; 0x0de: 0x0000

Kfdhdb.dbcompat: 168820736; 0x0e0: 0x0a100000

Kfdhdb.grpstmp.hi: 32928501; 0x0e4: HOUR=0x15 DAYS=0x17 MNTH=0xc YEAR=0x7d9

Kfdhdb.grpstmp.lo: 2195053568; 0x0e8: USEC=0x0 MSEC=0x177 SECS=0x2d MINS=0x20

Kfdhdb.ub4spare [0]: 0; 0x0ec: 0x00000000

Kfdhdb.ub4spare [1]: 0; 0x0f0: 0x00000000

Kfdhdb.ub4spare [2]: 0; 0x0f4: 0x00000000

Kfdhdb.ub4spare [3]: 0; 0x0f8: 0x00000000

Kfdhdb.ub4spare [4]: 0; 0x0fc: 0x00000000

Kfdhdb.ub4spare [5]: 0; 0x100: 0x00000000

Kfdhdb.ub4spare [6]: 0; 0x104: 0x00000000

Kfdhdb.ub4spare [7]: 0; 0x108: 0x00000000

Kfdhdb.ub4spare [8]: 0; 0x10c: 0x00000000

Kfdhdb.ub4spare [9]: 0; 0x110: 0x00000000

Kfdhdb.ub4spare [10]: 0; 0x114: 0x00000000

Kfdhdb.ub4spare [11]: 0; 0x118: 0x00000000

Kfdhdb.ub4spare [12]: 0; 0x11c: 0x00000000

Kfdhdb.ub4spare [13]: 0; 0x120: 0x00000000

Kfdhdb.ub4spare [14]: 0; 0x124: 0x00000000

Kfdhdb.ub4spare [15]: 0; 0x128: 0x00000000

Kfdhdb.ub4spare [16]: 0; 0x12c: 0x00000000

Kfdhdb.ub4spare [17]: 0; 0x130: 0x00000000

Kfdhdb.ub4spare [18]: 0; 0x134: 0x00000000

Kfdhdb.ub4spare [19]: 0; 0x138: 0x00000000

Kfdhdb.ub4spare [20]: 0; 0x13c: 0x00000000

Kfdhdb.ub4spare [21]: 0; 0x140: 0x00000000

Kfdhdb.ub4spare [22]: 0; 0x144: 0x00000000

Kfdhdb.ub4spare [23]: 0; 0x148: 0x00000000

Kfdhdb.ub4spare [24]: 0; 0x14c: 0x00000000

Kfdhdb.ub4spare [25]: 0; 0x150: 0x00000000

Kfdhdb.ub4spare [26]: 0; 0x154: 0x00000000

Kfdhdb.ub4spare [27]: 0; 0x158: 0x00000000

Kfdhdb.ub4spare [28]: 0; 0x15c: 0x00000000

Kfdhdb.ub4spare [29]: 0; 0x160: 0x00000000

Kfdhdb.ub4spare [30]: 0; 0x164: 0x00000000

Kfdhdb.ub4spare [31]: 0; 0x168: 0x00000000

Kfdhdb.ub4spare [32]: 0; 0x16c: 0x00000000

Kfdhdb.ub4spare [33]: 0; 0x170: 0x00000000

Kfdhdb.ub4spare [34]: 0; 0x174: 0x00000000

Kfdhdb.ub4spare [35]: 0; 0x178: 0x00000000

Kfdhdb.ub4spare [36]: 0; 0x17c: 0x00000000

Kfdhdb.ub4spare [37]: 0; 0x180: 0x00000000

Kfdhdb.ub4spare [38]: 0; 0x184: 0x00000000

Kfdhdb.ub4spare [39]: 104436; 0x198: 0x000197f4

Kfdhdb.ub4spare [40]: 0; 0x18c: 0x00000000

Kfdhdb.ub4spare [41]: 0; 0x190: 0x00000000

Kfdhdb.ub4spare [42]: 0; 0x194: 0x00000000

Kfdhdb.ub4spare [43]: 0; 0x198: 0x00000000

Kfdhdb.ub4spare [44]: 0; 0x19c: 0x00000000

Kfdhdb.ub4spare [45]: 0; 0x1a0: 0x00000000

Kfdhdb.ub4spare [46]: 0; 0x1a4: 0x00000000

Kfdhdb.ub4spare [47]: 0; 0x1a8: 0x00000000

Kfdhdb.ub4spare [48]: 0; 0x1ac: 0x00000000

Kfdhdb.ub4spare [49]: 0; 0x1b0: 0x00000000

Kfdhdb.ub4spare [50]: 0; 0x1b4: 0x00000000

Kfdhdb.ub4spare [51]: 0; 0x1b8: 0x00000000

Kfdhdb.ub4spare [52]: 0; 0x1bc: 0x00000000

Kfdhdb.ub4spare [53]: 0; 0x1c0: 0x00000000

Kfdhdb.ub4spare [54]: 0; 0x1c4: 0x00000000

Kfdhdb.ub4spare [55]: 0; 0x1c8: 0x00000000

Kfdhdb.ub4spare [56]: 0; 0x1cc: 0x00000000

Kfdhdb.ub4spare [57]: 0; 0x1d0: 0x00000000

Kfdhdb.acdb.aba.seq: 0; 0x1d4: 0x00000000

Kfdhdb.acdb.aba.blk: 0; 0x1d8: 0x00000000

Kfdhdb.acdb.ents: 0; 0x1dc: 0x0000

Kfdhdb.acdb.ub2spare: 43605; 0x1de: 0xaa55 reads the fault ASM disk head information and the normal ASM disk head information respectively through kfed, and finds that the red spot of the fault disk head is not consistent with that of the normal ASM disk head. The fault ASM disk information is as follows:

Kfdhdb.ub4spare [39]: 104436; 0x198: 0x000197f4

Kfdhdb.acdb.ub2spare: 43605; 0x1de: 0xaa55

Normal ASM disk head information this item is 0

3. Repair steps:

A. Export disk head information through kfed read / dev/oracleasm/disks/OADB_DATA_DISK_1 > / tmp/disk1.txt

B. Modify kfdhdb.ub4spare [39]: 104436; 0x198: 0x000197f4 to kfdhdb.ub4spare [39]: 0; 0x198: 0x00000000; modify kfdhdb.acdb.ub2spare: 43605; 0x1de: 0xaa55 to kfdhdb.acdb.ub2spare: 0; 0x1de: 0x0000

C. Through kfed merge / dev/oracleasm/disks/OADB_DATA_DISK_1 text=/tmp/disk1.txt

D, the other two disks also perform the same operation

E, sqlplus / as sysasm-- select group_number, disk_number, mount_status, header_status, name, path from vault disk; found that the disk header information has been displayed as MEMBER,+DATA and successfully mount

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.