Shulou(Shulou.com)06/01 Report--

Oracle Study-- Oracle 11gR2 RAC crs startup failure

System environment:

Operating system: RedHat EL5

Cluster: Oracle 11gR2 Grid

Oracle: Oracle 11gR2

In the RAC environment, one of the nodes failed to start the crsd process:

[grid@wyb666 ~] $crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4535: Cannot communicate with Cluster Ready Services

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

1. View the log

[root@wyb666 ~] # cd / u01/11.2.0/grid/log

[root@wyb666 log] # ls

Crs diag wyb666

[root@wyb666 log] # cd wyb666/

[root@wyb666 wyb666] # ls

Admin alertwyb666.log crsd ctssd evmd gnsd mdnsd racg

Agent client cssd diskmon gipcd gpnpd ohasd srvm

[root@wyb666 wyb666] # cd crsd

[root@wyb666 crsd] # ls

Crsd.log crsdOUT.log crsd.trc

[root@wyb666 crsd] # tail crsd.log

2015-06-08 11 asmhandle is NULL 41A proprasmcl 28.430: [OCRASM] [3046103824]

2015-06-08 11 Could not open raw device 41A proprinit 28.430: [OCRRAW] [3046103824]

2015-06-08 11 asmhandle is NULL 41A proprasmcl 28.430: [OCRASM] [3046103824]

2015-06-08 11 Freight 41purl 28.430: [OCRAPI] [3046103824] ahydrous initride 16: Backend init unsuccessful: [26]

2015-06-08 11: 41 CRSOCR 28.430: [CRSOCR] [3046103824] OCR context init failure. Error: PROC-26: Error while accessing the physical storage ASM error [SLOS: cat=7, opn=kgfoAl06, dep=15077, loc=kgfokge

ORA-15077: could not locate ASM instance serving a required diskgroup

] [7]

2015-06-08 11 CRSD exiting 41: 28.430: [CRSD] [3046103824] [PANIC] CRSD exiting: Could not init OCR, code: 26

2015-06-08 11: 41 CRSD 28.430: [CRSD] [3046103824] Done.

As can be seen from the above: when crs service starts, the OCR disk cannot be accessed and access to ASM DISKGROUP failed!

2. View ASM disk group information

[root@wyb666 crsd] # service oracleasm listdisks

ASM_DATA1

ASM_DATA2

ASM_RCY1

ASM_RCY2

OCR_VOTE1

OCR_VOTE2

OCR_VOTE3

[root@wyb666 crsd] # ls-l / dev/oracleasm/disks

Total 0

Brw-rw---- 1 grid asmadmin 8, 21 Jun 8 09:23 ASM_DATA1

Brw-rw---- 1 grid asmadmin 8, 22 Jun 8 09:23 ASM_DATA2

Brw-rw---- 1 grid asmadmin 8, 23 Jun 8 09:23 ASM_RCY1

Brw-rw---- 1 grid asmadmin 8, 24 Jun 8 09:23 ASM_RCY2

Brw-rw---- 1 grid asmadmin 8, 17 Jun 8 11:53 OCR_VOTE1

Brw-rw---- 1 grid asmadmin 8, 18 Jun 8 11:53 OCR_VOTE2

Brw-rw---- 1 grid asmadmin 8, 19 Jun 8 11:53 OCR_VOTE3

Solution:

Restart the CRS service, and then manually start ASM Instance:

Start ASM Instance

[root@wyb666 crsd] # su-grid

[grid@wyb666 ~] $sqlplus'/ as sysasm'

SQL*Plus: Release 11.2.0.1.0 Production on Mon Jun 8 11:59:26 2015

Copyright (c) 1982, 2009, Oracle. All rights reserved.

Connected to an idle instance.

SQL > conn / as sysasm

Connected to an idle instance.

SQL > startup

ASM instance started

Total System Global Area 284565504 bytes

Fixed Size 1336036 bytes

Variable Size 258063644 bytes

ASM Cache 25165824 bytes

ASM diskgroups mounted

ASM diskgroups volume enabled

SQL > select name,state from v$asm_diskgroup

NAME STATE

DATA MOUNTED

DG1 MOUNTED

RCY1 MOUNTED

Started successfully:

[root@wyb666 ~] # crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.