Shulou(Shulou.com)06/01 Report--

Problems in installing rac of oracle 11gR2 rac + dg on RHEL6.5+VMware Workstation 10 step by step (6)

This chapter mainly collects some problems and solutions in the process of installing rac. If there are no problems, then you can skip this chapter.

Directory structure:

Problems with crs installation Oracle 11g RAC CRS-4535/ORA-15077

After newly installing Oracle 11g rac, I don't know what caused crsd on the second node to fail to start? The error message is CRS-4535: Cannot communicate with Cluster Ready Services. You need to check the crsd.log log to know the specific error message.

1. Environment

[root@linux2 ~] # cat / etc/issue

Enterprise Linux Enterprise Linux Server release 5.5 (Carthage)

Kernel\ r on an\ m

[root@linux2 bin] #. / crsctl query crs activeversion

Oracle Clusterware active version on the cluster is [11.2.0.1.0]

# Note that objects that are different from root user operations are used in the following description.

2. Error symptoms

[root@linux2 bin] #. / crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4535: Cannot communicate with Cluster Ready Services # CRS-4535

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

[root@linux2 bin] # ps-ef | there is no crsd.bin in the query below grep d.bin #

Root 3886 11 09:50? 00:00:11 / u01/app/11.2.0/grid/bin/ohasd.bin reboot

Grid 3938 1 0 09:51? 00:00:04 / u01/app/11.2.0/grid/bin/oraagent.bin

Grid 4009 1 009: 51? 00:00:00 / u01/app/11.2.0/grid/bin/gipcd.bin

Grid 4014 1 0 09:51? 00:00:00 / u01/app/11.2.0/grid/bin/mdnsd.bin

Grid 4028 1 0 09:51? 00:00:02 / u01/app/11.2.0/grid/bin/gpnpd.bin

Root 4040 1 0 09:51? 00:00:03 / u01/app/11.2.0/grid/bin/cssdmonitor

Root 4058 1 0 09:51? 00:00:04 / u01/app/11.2.0/grid/bin/cssdagent

Root 4060 1 0 09:51? 00:00:00 / u01/app/11.2.0/grid/bin/orarootagent.bin

Grid 4090 1 2 09:51? 00:00:15 / u01/app/11.2.0/grid/bin/ocssd.bin

Grid 4094 1 0 09:51? 00:00:02 / u01/app/11.2.0/grid/bin/diskmon.bin-d-f

Root 4928 1 0 09:51? 00:00:00 / u01/app/11.2.0/grid/bin/octssd.bin reboot

Grid 4945 1 0 09:51? 00:00:02 / u01/app/11.2.0/grid/bin/evmd.bin

Root 6514 5886 0 10:00 pts/1 00:00:00 grep d.bin

[root@linux2 bin] #. / crsctl stat res-t-init

NAME TARGET STATE SERVER STATE_DETAILS

Cluster Resources

Ora.asm

1 ONLINE ONLINE linux2 Cluster Reconfigura

Tion

Ora.crsd

1 ONLINE OFFLINE # crsd is in offline state

Ora.cssd

1 ONLINE ONLINE linux2

Ora.cssdmonitor

1 ONLINE ONLINE linux2

Ora.ctssd

1 ONLINE ONLINE linux2 OBSERVER

Ora.diskmon

1 ONLINE ONLINE linux2

Ora.drivers.acfs

1 ONLINE OFFLINE # acfs is in offline state

Ora.evmd

1 ONLINE ONLINE linux2

Ora.gipcd

1 ONLINE ONLINE linux2

Ora.gpnpd

1 ONLINE ONLINE linux2

Ora.mdnsd

1 ONLINE ONLINE linux2

# check the log file corresponding to crsd below

[grid@linux2 ~] $view $ORACLE_HOME/log/linux2/crsd/crsd.log

2013-01-05 10 skipping shutdown 28V 27.107: [GIPCXCPT] [1768145488] gipcShutdownF: skipping shutdown, count 1, from [clsgpnp0.c: 1021]

Ret gipcretSuccess (0)

2013-01-05 10 Error in open/create file in dg 28VR 27.107: [OCRASM] [1768145488] proprasmo: Error in open/create file in dg [OCR_VOTE] # Open disk group error

[OCRASM] [1768145488] SLOS: SLOS: cat=7, opn=kgfoAl06, dep=15077, loc=kgfokge

ORA-15077: ORA error occurred in could not locate ASM instance serving a required diskgroup #

2013-01-05 10 kgfoCheckMount returned 28displacement 27.107: [OCRASM] [1768145488] proprasmo: kgfoCheckMount returned [7]

2013-01-05 10 The ASM instance is down 28displacement 27.107: [OCRASM] [1768145488] proprasmo: The ASM instance is down # instance is closed

2013-01-05 10 Failed to open 28V 27.107: [OCRRAW] [1768145488] proprioo: Failed to open [+ OCR_VOTE]. Returned proprasmo () with [26].

Marking location as UNAVAILABLE.

2013-01-05 10 No OCR/OLR devices are usable 28displacement 27.107: [OCRRAW] [1768145488] proprioo: No OCR/OLR devices are usable # OCR/OLR device is not available

2013-01-05 10 2814 27 107: [OCRASM] [1768145488] proprasmcl: asmhandle is NULL

2013-01-05 10 2814 27 107: [OCRRAW] [1768145488] proprinit: Could not open raw device

2013-01-05 10 2814 27 107: [OCRASM] [1768145488] proprasmcl: asmhandle is NULL

2013-01-05 10 2815 27. 107: [OCRAPI] [1768145488] astatinitrio 16 minutes: Backend init unsuccessful: [26]

2013-01-05 10 2814 27. 107: [CRSOCR] [1768145488] OCR context init failure. Error: PROC-26: Error while accessing the

Physical storage ASM error [SLOS: cat=7, opn=kgfoAl06, dep=15077, loc=kgfokge

ORA-15077: could not locate ASM instance serving a required diskgroup

] [7]

2013-01-05 10 CRSD exiting 2815 27.107: [CRSD] [1768145488] [PANIC] CRSD exiting: Could not init OCR, code: 26

2013-01-05 10 2814 27. 107: [CRSD] [1768145488] Done.

[root@linux2 bin] # ps-ef | grep pmon # View the pmon process, which also indicates that the ASM instance has not been started

Root 7447 7184 0 10:48 pts/2 00:00:00 grep pmon

# from the above analysis, we can see that the reason why the ASM instance did not start caused the crsd process to fail to start.

3. Solve

[grid@linux2 ~] $asmcmd

Connected to an idle instance.

ASMCMD > startup # start the asm instance

ASM instance started

Total System Global Area 283930624 bytes

Fixed Size 2212656 bytes

Variable Size 256552144 bytes

ASM Cache 25165824 bytes

ASM diskgroups mounted

ASMCMD > exit

# Author: Robinson

# Blog: http://blog.csdn.net/robinson_0612

# check the status of cluster resources again

[root@linux2 bin] #. / crsctl stat res-t-init

NAME TARGET STATE SERVER STATE_DETAILS

Cluster Resources

Ora.asm

1 ONLINE ONLINE linux2 Started

Ora.crsd

1 ONLINE INTERMEDIATE linux2

Ora.cssd

1 ONLINE ONLINE linux2

Ora.cssdmonitor

1 ONLINE ONLINE linux2

Ora.ctssd

1 ONLINE ONLINE linux2 OBSERVER

Ora.diskmon

1 ONLINE ONLINE linux2

Ora.drivers.acfs

1 ONLINE OFFLINE

Ora.evmd

1 ONLINE ONLINE linux2

Ora.gipcd

1 ONLINE ONLINE linux2

Ora.gpnpd

1 ONLINE ONLINE linux2

Ora.mdnsd

1 ONLINE ONLINE linux2

# start acfs

[root@linux2 bin] #. / crsctl start res ora.drivers.acfs-init

CRS-2672: Attempting to start 'ora.drivers.acfs' on' linux2'

CRS-2676: Start of 'ora.drivers.acfs' on' linux2' succeeded

# all states after # are in online state

[root@linux2 bin] #. / crsctl stat res-t-init

NAME TARGET STATE SERVER STATE_DETAILS

Cluster Resources

Ora.asm

1 ONLINE ONLINE linux2 Started

Ora.crsd

1 ONLINE ONLINE linux2

Ora.cssd

1 ONLINE ONLINE linux2

Ora.cssdmonitor

1 ONLINE ONLINE linux2

Ora.ctssd

1 ONLINE ONLINE linux2 OBSERVER

Ora.diskmon

1 ONLINE ONLINE linux2

Ora.drivers.acfs

1 ONLINE ONLINE linux2

Ora.evmd

1 ONLINE ONLINE linux2

Ora.gipcd

1 ONLINE ONLINE linux2

Ora.gpnpd

1 ONLINE ONLINE linux2

Ora.mdnsd

1 ONLINE ONLINE linux2

Oracle 11gR2 RAC ohasd failed to start solution

CRS-4124: Oracle High Availability Services startup failed.

CRS-4000: Command Start failed, or completed with errors.

Ohasd failed to start: Inappropriate ioctl for device

Ohasd failed to start at/u01/app/11.2.0/grid/crs/install/rootcrs.pl line 443.

I encountered this classic problem of 11.0.2.1 when I installed 11gR2 RAC for the first time. I found out that it was a bug after looking it up on the Internet, and the solution was very simple.

Is to execute the following command before executing root.sh

/ bin/dd if=/var/tmp/.oracle/npohasd of=/dev/null bs=1024 count=1

If it appears

/ bin/dd: opening` / var/tmp/.oracle/npohasd': No such file or directory

Continue to execute the file before it is generated, until it can be executed, and usually execute the dd command when the message Adding daemon to inittab appears.

Another solution is to change file permissions.

Chown root:oinstall / var/tmp/.oracle/npohasd

Don't forget to delete the configuration before re-executing root.sh: / u01/app/11.2.0/grid/crs/install/roothas.pl-deconfig-force-verbose

Necessary conditions for Oracle RAC 11gR2 installation

One of the necessary conditions is that the network card should be consistent, which is shown in these aspects.

1. The names of the network cards should be exactly the same, for example, they are all called eth0,eth2, and one node eth0,eth2, another eth3, eth4 cannot appear.

I made this error during installation, which caused the first node to install normally, but the second one always reported an error Failed to Start CSSD when it executed root.sh.

two。 Not only should the name be the same, but also the corresponding public and private should be the same, that is to say, not one.

Eth0: 192.168.1.2

Eth2: 10.10.1.2

The other one

Eth0: 10.10.1.3

Eth2: 192.168.1.3

3. Not only should the address correspond, but also the subnet mask should be consistent, that is, you cannot have one subnet mask for the same public,private network.

255.255.0.0

The subnet mask of the other one is 255.255.255.0.

When using virtual machine cloning, inconsistent network card names are the most common.

How to change the name of the network card under Redhat Enterprise Linux 6: (for example, eth6 needs to be changed to eth0)

1. Modify the configuration file / etc/udev/rules.d/70-persistent-net.rules to change the name of the network card to the new one

two。 The configuration file / etc/sysconfig/network-script/ifcfg-eth6 also needs to be changed to ifcfg-eth0

3. / etc/rc.d/init.d/network restart restart

The installation of Oracle RAC is really troublesome. Once the setting is wrong, there will be all kinds of errors.

Add: it is recommended to use the same type of network card, but according to the data, at least the MTU (maximum transmission unit) of the network card must be consistent, otherwise it will also lead to errors.

Hang when Oracle RAC 11gR2 is installed at 65%

Phenomenon:

During the installation of Oracle RAC on Redhat Linux 6, there was no response at 65%.

Reason:

Because the firewall is on.

Solution method

Chkconfig iptables off

Service iptables stop

RAC solves the problem of single node reporting CRS-4047: No Oracle Clusterware components configured.

[root@his2 bin] #. / crsctl check crs check service status CRS-4047: No Oracle Clusterware components configured.CRS-4000: Command Check failed, or completed with errors. [root@his2 bin] #. / crsctl stat res-tCRS-4047: No Oracle Clusterware components configured.CRS-4000: Command Status failed, or completed with errors. [root@his2 bin] #. / crs_stat-tCRS-0184: Cannot communicate with the CRS daemon.

/ app/grid/product/11.2.0/grid/crs/install/rootcrs.pl-deconfig-force reset the crs registry Using configuration parameter file: / app/grid/product/11.2.0/grid/crs/install/crsconfig_paramsNetwork exists: 1/192.168.20.0/255.255.255.0/eth0, type staticVIP exists: / his1-vip/192.168.20.6/192.168.20.0/255.255.255.0/eth0 Hosting node his1VIP exists: / his2-vip/192.168.20.7/192.168.20.0/255.255.255.0/eth0, hosting node his2GSD existsONS exists: Local port 6100, remote port 6200 EM port 2016ACFS-9200: SupportedCRS-2673: Attempting to stop 'ora.registry.acfs' on' his2'CRS-2677: Stop of 'ora.registry.acfs' on' his2' succeededCRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'his2'CRS-2673: Attempting to stop' ora.crsd' on 'his2'CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on' his2'CRS-2673: Attempting to stop 'ora.ORACRS.dg' on' his2'CRS-2673: Attempting to stop 'ora. Crds3db.db' on 'his2'CRS-2677: Stop of' ora.ORACRS.dg' on 'his2' succeededCRS-2677: Stop of' ora.crds3db.db' on 'his2' succeededCRS-2673: Attempting to stop' ora.ORAARCH.dg' on 'his2'CRS-2673: Attempting to stop' ora.ORADATA.dg' on 'his2'CRS-2677: Stop of' ora.ORAARCH.dg' on 'his2' succeededCRS-2677: Stop of' ora.ORADATA.dg' on 'his2' succeededCRS-2673: Attempting to stop' Ora.asm' on 'his2'CRS-2677: Stop of' ora.asm' on 'his2' succeededCRS-2792: Shutdown of Cluster Ready Services-managed resources on' his2' has completedCRS-2677: Stop of 'ora.crsd' on' his2' succeededCRS-2673: Attempting to stop 'ora.ctssd' on' his2'CRS-2673: Attempting to stop 'ora.evmd' on' his2'CRS-2673: Attempting to stop 'ora.asm' on' his2'CRS-2673: Attempting to stop 'ora.drivers.acfs' on' his2 'CRS-2673: Attempting to stop' ora.mdnsd' on 'his2'CRS-2677: Stop of' ora.asm' on 'his2' succeededCRS-2673: Attempting to stop' ora.cluster_interconnect.haip' on 'his2'CRS-2677: Stop of' ora.evmd' on 'his2' succeededCRS-2677: Stop of' ora.cluster_interconnect.haip' on 'his2' succeededCRS-2677: Stop of' ora.mdnsd' on 'his2' succeededCRS-2677: Stop of' ora.ctssd' on 'his2' succeededCRS-2673: Attempting to stop 'ora.cssd' on' his2'CRS-2677: Stop of' ora.cssd' on' his2' succeededCRS-2673: Attempting to stop 'ora.diskmon' on' his2'CRS-2673: Attempting to stop' ora.crf' on' his2'CRS-2677: Stop of 'ora.diskmon' on' his2' succeededCRS-2677: Stop of' ora.crf' on' his2' succeededCRS-2673: Attempting to stop 'ora.gipcd' on' his2'CRS-2677: Stop of' ora.drivers.acfs' on' His2' succeededCRS-2677: Stop of 'ora.gipcd' on' his2' succeededCRS-2673: Attempting to stop 'ora.gpnpd' on' his2'CRS-2677: Stop of 'ora.gpnpd' on' his2' succeededCRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'his2' has completedCRS-4133: Oracle High Availability Services has been stopped.Successfully deconfigured Oracle clusterware stack on this node [root@his1 ~] # su-grid [grid@his1 ~] $crs_stat-t can only see nodes above Node 1 1, which means there is a problem with Node 2. Name Type Target State Host-ora....ER.lsnr ora....er.type ONLINE ONLINE his1 ora....N1.lsnr ora....er.type ONLINE ONLINE his1 ora.ORAARCH .dg ora....up.type ONLINE ONLINE his1 ora.ORACRS.dg ora....up.type ONLINE ONLINE his1 ora.ORADATA.dg ora....up.type ONLINE ONLINE his1 ora.asm ora.asm.type ONLINE ONLINE his1 ora.crds3db.db ora....se.type ONLINE ONLINE his1 ora.cvu ora.cvu.type ONLINE ONLINE his1 ora.gsd ora.gsd.type OFFLINE OFFLINE ora....SM1.asm application ONLINE ONLINE his1 ora....S1.lsnr application ONLINE ONLINE his1 ora.his1 .gsd application OFFLINE OFFLINE ora.his1.ons application ONLINE ONLINE his1 ora.his1.vip ora....t1.type ONLINE ONLINE his1 ora....network ora....rk.type ONLINE ONLINE his1 ora.oc4j ora.oc4j.type ONLINE ONLINE his1 ora.ons ora.ons.type ONLINE ONLINE his1 ora....ry.acfs ora....fs.type ONLINE ONLINE his1 ora.scan1.vip ora....ip.type ONLINE ONLINE his1

[grid@his1 ~] $crsctl stat res-t can only see 1 resource above 1 node indicates that there is a problem with node 2-NAME TARGET STATE SERVER STATE_ DETAILS-Local Resources-- -ora.LISTENER.lsnr ONLINE ONLINE his1 ora.ORAARCH.dg ONLINE ONLINE his1 ora.ORACRS.dg ONLINE ONLINE his1 ora.ORADATA.dg ONLINE ONLINE his1 ora.asm ONLINE ONLINE his1 Started ora.gsd OFFLINE OFFLINE his1 ora.net1.network ONLINE ONLINE his1 ora.ons ONLINE ONLINE his1 ora.registry.acfs ONLINE ONLINE his1- -Cluster Resources -- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE his1 ora.crds3db.db 1 ONLINE ONLINE his1 Open 2 ONLINE OFFLINE Instance Shutdown ora.cvu 1 ONLINE ONLINE his1 ora.his1.vip 1 ONLINE ONLINE his1 ora.oc4j 1 ONLINE ONLINE his1 ora.scan1.vip 1 ONLINE ONLINE his1

[root@his2 bin] # / app/grid/product/11.2.0/grid/root.sh execute roo.sh to reconfigure all services in the cluster Running Oracle 11g root script...

The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= / app/grid/product/11.2.0/grid

Enter the full pathname of the local bin directory: [/ usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite.The contents of "oraenv" have not changed. No need to overwrite.The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the / etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of root script.Now product-specific root actions will be performed.Using configuration parameter file: / app/grid/product/11.2.0/grid/crs/install/crsconfig_paramsLOCAL ADD MODE Creating OCR keys for user 'root' Privgrp 'root'..Operation successful.OLR initialization-successfulAdding daemon to inittabACFS-9200: SupportedACFS-9300: ADVM/ACFS distribution files found.ACFS-9307: Installing requested ADVM/ACFS software.ACFS-9308: Loading installed ADVM/ACFS drivers.ACFS-9321: Creating udev for ADVM/ACFS.ACFS-9323: Creating module dependencies-this may take some time.ACFS-9327: Verifying ADVM/ACFS devices.ACFS-9309: ADVM/ACFS installation correctness verified.CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node his1, number 1 And is terminatingAn active cluster was found during exclusive startup, restarting to join the clusterPreparing packages for installation...cvuqdisk-1.0.9-1Configure Oracle Grid Infrastructure for a Cluster... Succeeded

[root@his2 bin] # / crsctl stat res-t look at the result has returned to normal-NAME TARGET STATE SERVER STATE_DETAILS- -Local Resources -- ora.LISTENER.lsnr ONLINE ONLINE his1 ONLINE ONLINE his2 ora.ORAARCH.dg ONLINE ONLINE his1 ONLINE ONLINE his2 ora.ORACRS.dg ONLINE ONLINE his1 ONLINE ONLINE his2 ora.ORADATA.dg ONLINE ONLINE his1 ONLINE ONLINE his2 ora.asm ONLINE ONLINE his1 Started ONLINE ONLINE his2 ora.gsd OFFLINE OFFLINE his1 OFFLINE OFFLINE his2 ora.net1.network ONLINE ONLINE his1 ONLINE ONLINE his2 ora.ons ONLINE ONLINE his1 ONLINE ONLINE his2 ora.registry. Acfs ONLINE ONLINE his1 ONLINE ONLINE his2-Cluster Resources-- -ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE his1 ora.crds3db.db 1 ONLINE ONLINE his1 Open 2 ONLINE ONLINE his2 Open ora.cvu 1 ONLINE ONLINE his1 ora.his1.vip 1 ONLINE ONLINE his1 ora.his2.vip 1 ONLINE ONLINE his2 ora.oc4j 1 ONLINE ONLINE his1 ora.scan1.vip 1 ONLINE ONLINE his1- -

Root script

1. When I run the script at the second node, the error info as below:

[root@rac2 ~] # / oracle/app/grid/product/11.2.0/root.sh

Running Oracle 11g root script...

The following environment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME= / oracle/app/grid/product/11.2.0

Enter the full pathname of the local bin directory: [/ usr/local/bin]:

Copying dbhome to / usr/local/bin...

Copying oraenv to / usr/local/bin...

Copying coraenv to / usr/local/bin...

Creating / etc/oratab file...

Entries will be added to the / etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Using configuration parameter file: / oracle/app/grid/product/11.2.0/crs/install/crsconfig_params

Creating trace directory

LOCAL ADD MODE

Creating OCR keys for user 'root', privgrp' root'..

Operation successful.

OLR initialization-successful

Adding daemon to inittab

ACFS-9200: Supported

ACFS-9300: ADVM/ACFS distribution files found.

ACFS-9307: Installing requested ADVM/ACFS software.

ACFS-9308: Loading installed ADVM/ACFS drivers.

ACFS-9321: Creating udev for ADVM/ACFS.

ACFS-9323: Creating module dependencies-this may take some time.

ACFS-9327: Verifying ADVM/ACFS devices.

ACFS-9309: ADVM/ACFS installation correctness verified.

CRS-2672: Attempting to start 'ora.mdnsd' on' rac2'

CRS-2676: Start of 'ora.mdnsd' on' rac2' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on' rac2'

CRS-2676: Start of 'ora.gpnpd' on' rac2' succeeded

CRS-2672: Attempting to start 'ora.cssdmonitor' on' rac2'

CRS-2672: Attempting to start 'ora.gipcd' on' rac2'

CRS-2676: Start of 'ora.gipcd' on' rac2' succeeded

CRS-2676: Start of 'ora.cssdmonitor' on' rac2' succeeded

CRS-2672: Attempting to start 'ora.cssd' on' rac2'

CRS-2672: Attempting to start 'ora.diskmon' on' rac2'

CRS-2676: Start of 'ora.diskmon' on' rac2' succeeded

CRS-2676: Start of 'ora.cssd' on' rac2' succeeded

Disk Group CRS creation failed with the following message:

ORA-15018: diskgroup cannot be created

ORA-15031: disk specification'/ dev/oracleasm/disks/CRS3' matches no disks

ORA-15025: could not open disk "/ dev/oracleasm/disks/CRS3"

ORA-15056: additional error message

Configuration of ASM... Failed

See asmca logs at / oracle/app/oracle/cfgtoollogs/asmca for details

Did not succssfully configure and start ASM at/oracle/app/grid/product/11.2.0/crs/install/crsconfig_lib.pm line 6464.

/ oracle/app/grid/product/11.2.0/perl/bin/perl-I/oracle/app/grid/product/11.2.0/perl/lib-I/oracle/app/grid/product/11.2.0/crs/install / oracle/app/grid/product/11.2.0/crs/install/rootcrs.pl execution failed

[grid@rac2 ~] $vi oracle/app/oracle/cfgtoollogs/asmca/asmca-110428PM061902.log

. .

[main] [2011-04-28 1815 19buret 38.135 CST] [UsmcaLogger.logInfo:142] Diskstring in createDG to be updated:'/ dev/oracleasm/disks/*'

[main] [2011-04-28 1815 19buret 38.136 CST] [UsmcaLogger.logInfo:142] update param sql ALTER SYSTEM SET asm_diskstring='/dev/oracleasm/disks/*' SID='*'

[main] [2011-04-28 1815 19pura 38.262 CST] [InitParamAttributes.loadDBParams:4450] Checking if SPFILE is used

[main] [2011-04-28 1815 19buret 38.276 CST] [InitParamAttributes.loadDBParams:4461] spParams = [Ljava.lang.String;@1a001ff

[main] [2011-04-28 1815 19buret 38.277 CST] [ASMParameters.loadASMParameters:459] useSPFile=false

[main] [2011-04-28 18 SQLEngine.doSQLSubstitution:2392 19V 38.277 CST] [SQLEngine.doSQLSubstitution:2392] The substituted sql statement:=select count (*) from v$ASM_DISKGROUP where name=upper ('CRS')

[main] [2011-04-28 1815 19buret 38.423 CST] [UsmcaLogger.logInfo:142] CREATE DISKGROUP SQL: CREATE DISKGROUP CRS EXTERNAL REDUNDANCY DISK'/ dev/oracleasm/disks/CRS1'

'/ dev/oracleasm/disks/CRS2'

'/ dev/oracleasm/disks/CRS3' ATTRIBUTE' compatible.asm'='11.2.0.0.0'

[main] [2011-04-28 1815! 1915! 38.724 CST] [SQLEngine.done:2167] Done called

[main] [2011-04-28 1815! 1915! 38.731 CST] [UsmcaLogger.logException:172] SEVERE:method oracle.sysman.assistants.usmca.backend.USMDiskGroupManager:createDiskGroups

[main] [2011-04-28 1815 19buret 38.731 CST] [UsmcaLogger.logException:173] ORA-15018: diskgroup cannot be created

ORA-15031: disk specification'/ dev/oracleasm/disks/CRS3' matches no disks

ORA-15025: could not open disk "/ dev/oracleasm/disks/CRS3"

ORA-15056: additional error message

[main] [2011-04-28 1815 19buret 38.731 CST] [UsmcaLogger.logException:174] oracle.sysman.assistants.util.sqlEngine.SQLFatalErrorException: ORA-15018: diskgroup cannot be created

ORA-15031: disk specification'/ dev/oracleasm/disks/CRS3' matches no disks

ORA-15025: could not open disk "/ dev/oracleasm/disks/CRS3"

ORA-15056: additional error message

Oracle.sysman.assistants.util.sqlEngine.SQLEngine.executeImpl (SQLEngine.java:1655)

Oracle.sysman.assistants.util.sqlEngine.SQLEngine.executeSql (SQLEngine.java:1903)

Oracle.sysman.assistants.usmca.backend.USMDiskGroupManager.createDiskGroups (USMDiskGroupManager.java:236)

Oracle.sysman.assistants.usmca.backend.USMDiskGroupManager.createDiskGroups (USMDiskGroupManager.java:121)

Oracle.sysman.assistants.usmca.backend.USMDiskGroupManager.createDiskGroupsLocal (USMDiskGroupManager.java:2209)

Oracle.sysman.assistants.usmca.backend.USMInstance.configureLocalASM (USMInstance.java:3093)

Oracle.sysman.assistants.usmca.service.UsmcaService.configureLocalASM (UsmcaService.java:1047)

Oracle.sysman.assistants.usmca.model.UsmcaModel.performConfigureLocalASM (UsmcaModel.java:903)

Oracle.sysman.assistants.usmca.model.UsmcaModel.performOperation (UsmcaModel.java:779)

Oracle.sysman.assistants.usmca.Usmca.execute (Usmca.java:171)

Oracle.sysman.assistants.usmca.Usmca.main (Usmca.java:366)

[main] [2011-04-28 1815 19buret 38.732 CST] [UsmcaLogger.logExit:123] Exiting oracle.sysman.assistants.usmca.backend.USMDiskGroupManager Method: createDiskGroups

[main] [2011-04-28 1815! 1915! 38.732 CST] [UsmcaLogger.logInfo:142] Diskgroups created

[main] [2011-04-28 1818 Vol 38.733 CST] [UsmcaLogger.logInfo:142] Diskgroup creation is not successful.

[main] [2011-04-28 18V 19V 38.733 CST] [UsmcaLogger.logExit:123] Exiting oracle.sysman.assistants.usmca.model.UsmcaModel Method: performConfigureLocalASM

[main] [2011-04-28 18V 19V 38.733 CST] [UsmcaLogger.logExit:123] Exiting oracle.sysman.assistants.usmca.model.UsmcaModel Method: performOperation

Solution:

Add permission to the / dev/oraclease for user grid:

[root@rac2] # chown-R grid.oinstall / dev/oracleasm

[root@rac2] # chmod-R 775 / dev/oracleasm

2. The ora.asm cannot run at rac2

[grid@rac2] $crsctl status resource-t

NAME TARGET STATE SERVER STATE_DETAILS

Local Resources

Ora.CRS.dg

ONLINE ONLINE rac1

ONLINE ONLINE rac2

Ora.asm

ONLINE ONLINE rac1 Started

ONLINE ONLINE rac2

Ora.gsd

OFFLINE OFFLINE rac1

OFFLINE OFFLINE rac2

Ora.net1.network

ONLINE ONLINE rac1

ONLINE ONLINE rac2

Ora.ons

ONLINE ONLINE rac1

ONLINE ONLINE rac2

Ora.registry.acfs

ONLINE ONLINE rac1

ONLINE ONLINE rac2

Cluster Resources

Ora.LISTENER_SCAN1.lsnr

1 ONLINE ONLINE rac1

Ora.cvu

1 ONLINE ONLINE rac1

Ora.oc4j

1 ONLINE ONLINE rac1

Ora.rac1.vip

1 ONLINE ONLINE rac1

Ora.rac2.vip

1 ONLINE ONLINE rac2

Ora.scan1.vip

1 ONLINE ONLINE rac1

[root@rac2] # / oracle/app/grid/product/11.2.0/crs/install/rootcrs.pl-verbose-deconfig-force-lastnode

Using configuration parameter file: / oracle/app/grid/product/11.2.0/crs/install/crsconfig_params

Network exists: 1/10.157.45.0/255.255.255.0/eth0, type static

VIP exists: / rac1vip/10.157.45.174/10.157.45.0/255.255.255.0/eth0, hosting node rac1

VIP exists: / rac2vip/10.157.45.157/10.157.45.0/255.255.255.0/eth0, hosting node rac2

GSD exists

ONS exists: Local port 6100, remote port 6200, EM port 2016

ACFS-9200: Supported

CRS-2673: Attempting to stop 'ora.registry.acfs' on' rac2'

CRS-2677: Stop of 'ora.registry.acfs' on' rac2' succeeded

CRS-2673: Attempting to stop 'ora.crsd' on' rac2'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac2'

CRS-2673: Attempting to stop 'ora.CRS.dg' on' rac2'

CRS-2677: Stop of 'ora.CRS.dg' on' rac2' succeeded

CRS-2673: Attempting to stop 'ora.asm' on' rac2'

CRS-2677: Stop of 'ora.asm' on' rac2' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac2' has completed

CRS-2677: Stop of 'ora.crsd' on' rac2' succeeded

CRS-2673: Attempting to stop 'ora.ctssd' on' rac2'

CRS-2673: Attempting to stop 'ora.evmd' on' rac2'

CRS-2673: Attempting to stop 'ora.asm' on' rac2'

CRS-2677: Stop of 'ora.asm' on' rac2' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on' rac2'

CRS-2677: Stop of 'ora.evmd' on' rac2' succeeded

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on' rac2' succeeded

CRS-2677: Stop of 'ora.ctssd' on' rac2' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on' rac2'

CRS-2677: Stop of 'ora.cssd' on' rac2' succeeded

CRS-2673: Attempting to stop 'ora.diskmon' on' rac2'

CRS-2677: Stop of 'ora.diskmon' on' rac2' succeeded

CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating

Unable to communicate with the Cluster Synchronization Services daemon.

CRS-4000: Command Delete failed, or completed with errors.

Crsctl delete for vds in CRS... Failed

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac2'

CRS-2673: Attempting to stop 'ora.mdnsd' on' rac2'

CRS-2673: Attempting to stop 'ora.crf' on' rac2'

CRS-2677: Stop of 'ora.mdnsd' on' rac2' succeeded

CRS-2677: Stop of 'ora.crf' on' rac2' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on' rac2'

CRS-2677: Stop of 'ora.gipcd' on' rac2' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on' rac2'

CRS-2677: Stop of 'ora.gpnpd' on' rac2' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2' has completed

CRS-4133: Oracle High Availability Services has been stopped.

Successfully deconfigured Oracle clusterware stack on this node

[root@rac2 ~] # / oracle/app/grid/product/11.2.0/root.sh

Running Oracle 11g root script...

The following environment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME= / oracle/app/grid/product/11.2.0

Enter the full pathname of the local bin directory: [/ usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The contents of "oraenv" have not changed. No need to overwrite.

The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the / etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Using configuration parameter file: / oracle/app/grid/product/11.2.0/crs/install/crsconfig_params

LOCAL ADD MODE

Creating OCR keys for user 'root', privgrp' root'..

Operation successful.

OLR initialization-successful

Adding daemon to inittab

ACFS-9200: Supported

ACFS-9300: ADVM/ACFS distribution files found.

ACFS-9307: Installing requested ADVM/ACFS software.

ACFS-9308: Loading installed ADVM/ACFS drivers.

ACFS-9321: Creating udev for ADVM/ACFS.

ACFS-9323: Creating module dependencies-this may take some time.

ACFS-9327: Verifying ADVM/ACFS devices.

ACFS-9309: ADVM/ACFS installation correctness verified.

CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating

An active cluster was found during exclusive startup, restarting to join the cluster

Preparing packages for installation...

Cvuqdisk-1.0.9-1

Configure Oracle Grid Infrastructure for a Cluster... Succeeded

3. The service ora.rac1.LISTENER_RAC1.lsnr cannot online

NAME=ora.rac1.LISTENER_RAC1.lsnr

TYPE=application

TARGET=ONLINE

STATE=OFFLINE

[grid@rac1 ~] $crs_start ora.rac1.LISTENER_RAC1.lsnr

CRS-2805: Unable to start 'ora.LISTENER.lsnr' because it has a' hard' dependency on resource type' ora.cluster_vip_net1.type' and no resource of that type can satisfy the dependency

CRS-2525: All instances of the resource 'ora.rac2.vip' are already running; relocate is not allowed because the force option was not specified

CRS-0222: Resource 'ora.rac1.LISTENER_RAC1.lsnr' has dependency error.

4. [INS-20802] Oracle Cluster Verification Utility failed.

Cause? "he plug-in failed in its perform method Action? Efer to the logs or contact Oracle Support Services. Log File Location

/ oracle/app/oraInventory/logs/installActions2011-04-28005-32-48PM.log

Tail-n 6000 / oracle/app/oraInventory/logs/installActions2011-04-280532-48PM.log

INFO: Checking VIP reachability

INFO: Check for VIP reachability passed.

INFO: Post-check for cluster services setup was unsuccessful.

INFO: Checks did not pass for the following node (s):

INFO: rac-cluster,rac1

INFO:

WARNING:

INFO: Completed Plugin named: Oracle Cluster Verification Utility

Using UDEV Service to solve RAC ASM Storage device name

We introduce the advantages and disadvantages of using ASMLIB as a kernel support library (kernel support library) specially designed for Oracle Automatic Storage Management features, and suggest using a mature UDEV scheme to replace ASMLIB.

Here we give the specific steps to configure UDEV, which is relatively simple:

1. Verify that the necessary UDEV packages are installed on all RAC nodes

[root@rh3 ~] # rpm-qa | grep udev udev-095-14.21.el5

two。 Obtain the unique identification name of the block device of the device through scsi_id, assuming that there is already a LUN sdc-sdp on the system

Fori in c d e f g h i j k l m n o p

Do

Echo "sd$i"`scsi_id-g-u-s / block/sd$ i`"

Done

Sdc 1IET_00010001

Sdd 1IET_00010002

Sde 1IET_00010003

Sdf 1IET_00010004

Sdg 1IET_00010005

Sdh 1IET_00010006

Sdi 1IET_00010007

Sdj 1IET_00010008

Sdk 1IET_00010009

Sdl 1IET_0001000a

Sdm 1IET_0001000b

Sdn 1IET_0001000c

Sdo 1IET_0001000d

Sdp 1IET_0001000e

The unique identification name corresponding to the block device name is listed above

3. Create the necessary UDEV configuration files

First change to the configuration file directory

[root@rh3 ~] # cd / etc/udev/rules.d

Define the necessary rule profiles

[root@rh3 rules.d] # touch 99-oracle-asmdevices.rules

[root@rh3 rules.d] # cat 99-oracle-asmdevices.rules

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010001", NAME= "ocr1", WNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010002", NAME= "ocr2", WNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010003", NAME= "asm-disk1", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010004", NAME= "asm-disk2", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010005", NAME= "asm-disk3", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010006", NAME= "asm-disk4", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010007", NAME= "asm-disk5", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010008", NAME= "asm-disk6", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_00010009", NAME= "asm-disk7", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_0001000a", NAME= "asm-disk8", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_0001000b", NAME= "asm-disk9", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_0001000c", NAME= "asm-disk10", WNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_0001000d", NAME= "asm-disk11", WNER= "grid", GROUP= "asmadmin", MODE= "0660"

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-g-u-s% p", RESULT== "1IET_0001000e", NAME= "asm-disk12", WNER= "grid", GROUP= "asmadmin", MODE= "0660"

Result is the output of / sbin/scsi_id-g-u-s% p-Match the returned string of the last PROGRAM call. This key may be used in any following rule after a PROGRAM call.

Just fill in the unique identification name you just obtained in order.

OWNER is the user who installs Grid Infrastructure. In 11gr2, you can use 0660 for grid,GROUP and asmadmin,MODE.

NAME is the device name mapped by UDEV

It is recommended to create a separate DISKGROUP for OCR and VOTE DISK, and to easily distinguish the form of naming the device dedicated to the DISKGROUP as ocr1..ocrn

The rest of the disks can be named according to their actual use or disk group name

4. Copy the rule file to another node

[root@rh3 rules.d] # scp 99-oracle-asmdevices.rules Other_node:/etc/udev/rules.d

5. Start the udev service on all nodes, or restart the server

[root@rh3 rules.d] # / sbin/udevcontrol reload_rules

[root@rh3 rules.d] # / sbin/start_udev Starting udev: [OK]

6. Check that the equipment is in place.

[root@rh3 rules.d] # cd / dev [root@rh3 dev] # ls-l ocr* brw-rw---- 1 grid asmadmin 8, 32 Jul 10 17:31 ocr1 brw-rw---- 1 grid asmadmin 8, 48 Jul 10 17:31 ocr2

[root@rh3 dev] # ls-l asm-disk*

Brw-rw---- 1 grid asmadmin 8, 64 Jul 10 17:31 asm-disk1

Brw-rw---- 1 grid asmadmin 8, 208 Jul 10 17:31 asm-disk10

Brw-rw---- 1 grid asmadmin 8, 224 Jul 10 17:31 asm-disk11

Brw-rw---- 1 grid asmadmin 8, 240 Jul 10 17:31 asm-disk12

Brw-rw---- 1 grid asmadmin 8, 80 Jul 10 17:31 asm-disk2

Brw-rw---- 1 grid asmadmin 8, 96 Jul 10 17:31 asm-disk3

Brw-rw---- 1 grid asmadmin 8, 112 Jul 10 17:31 asm-disk4

Brw-rw---- 1 grid asmadmin 8, 128 Jul 10 17:31 asm-disk5

Brw-rw---- 1 grid asmadmin 8, 144 Jul 10 17:31 asm-disk6

Brw-rw---- 1 grid asmadmin 8, 160 Jul 10 17:31 asm-disk7

Brw-rw---- 1 grid asmadmin 8, 176 Jul 10 17:31 asm-disk8

Brw-rw---- 1 grid asmadmin 8, 192 Jul 10 17:31 asm-disk9

Think twice about sharing

Since the release of the article "hand-in-hand to teach you to install oracle10g RAC with VMware under linux", my personal vanity has once again been greatly satisfied, because I have friends who continue to express their gratitude to me (that is, very few people invited me to dinner, 5555, these guys with false lip service), saying that my document is well written, not only the steps are clear and clear, but also pictures are used as references.

However, many of my friends contacted me about problems encountered during installation, most of which were caused by the fact that the shared disk could not be detected when Node 2 was performing oracleasm listdisks.

For configuring RAC database under vmware, there are usually two reasons for this problem, which are described below.

1. Add disk sharing parameters to VMWARE

Use VMWARE to configure RAC database, be sure to choose server VMWARE (VMWARE is divided into server and workstation two types), this point is specially emphasized in the document, some friends may not pay attention; another is each vmware node * .vmx configuration file, add the relevant disk sharing parameters, otherwise it may not be able to properly identify the shared disk.

Here is an example of disk sharing parameters in the vmx file when you think twice about configuring the environment, as follows:

Disk.locking = "false"

DiskLib.dataCacheMaxSize = "0"

DiskLib.dataCacheMaxReadAheadSize = "0"

DiskLib.DataCacheMinReadAheadSize = "0"

DiskLib.dataCachePageSize = "4096"

DiskLib.maxUnsyncedWrites = "0"

Scsi1.sharedBus = "virtual"

2. Shared disks are not shared

The second reason is even more BT, but it is not uncommon for such problems to cause disks not to be shared, mainly due to a lack of in-depth understanding of the Oracle RAC architecture.

Before I elaborate on the topic, I would like to clarify a related concept: what exactly is shared storage. The so-called shared storage, as the name implies, means that the disk space should be shared and accessed by the relevant nodes. More bluntly, the nodes access the same (or several) disks, and for virtual machine environments, they access the same disk files.

ORACLE database is composed of instance + database, and the instance is composed of a set of operating system processes + a memory area of the operating system. Database is a collection of various types of feature files (such as data files, temporary files, redo log files, control files, etc.), RAC environment ORACLE database, is actually multiple instances (each instance running on a different node-in general, it should also be feasible for you to let it run on the same node) to access and read and write a database. Where is the database placed, that is, on shared storage, that is, the files accessed by several instances of RAC should be on the same disk.

Ok, back to the topic, when some friends create a second node and add a disk for voting disk,ocr to asm, they do not select the file created in the first node (Use an existing virtual disk), but re-create a new disk file (Create a new virtual disk). In this case, there is no concept of sharing, and it is naturally impossible to achieve shared storage of disks.

Node2 root.sh failed when 11gr2 installed Grid Start of resource "ora.asm-init" failed

When installing GI, the root.sh of the first node is generally error-prone, but the second node encounters the following error Start of resource "ora.asm-init" failedFailed to start ASMFailed to start Oracle Clusterware stack

Check the error log grid@znode2 crsconfig] $pwd/u01/app/11.2.0/grid/cfgtoollogs/crsconfig [grid@znode2 crsconfig] $vi + rootcrs_znode2.log

... 2012-06-28 17:53:50: Starting CSS in clustered mode2012-06-28 17:54:42: CRS-2672: Attempting to start 'ora.cssdmonitor' on' znode2'2012-06-28 17:54:42: CRS-2676: Start of' ora.cssdmonitor' on' znode2' succeeded2012-06-28 17:54:42: CRS-2672: Attempting to start 'ora.cssd' on' znode2'2012-06-28 17:54:42: CRS-2672: Attempting to start' ora.diskmon' on' Znode2'2012-06-28 17:54:42: CRS-2676: Start of 'ora.diskmon' on' znode2' succeeded2012-06-28 17:54:42: CRS-2676: Start of' ora.cssd' on' znode2' succeeded- Note: 10 minutes 2012-06-28 18:04:47: Start of resource "ora.ctssd-init-env USR_ORA_ENV=CTSS_REBOOT=TRUE" Succeeded2012-06-28 18:04:47: Command return code of 1 (256) from command: / U01/app/11.2.0/grid/bin/crsctl start resource ora.asm-init2012-06-28 18:04:47: Start of resource "ora.asm-init" failed2012-06-28 18:04:47: Failed to start ASM2012-06-28 18:04:47: Failed to start Oracle Clusterware stack …

/ log/znode2/alert/znodename.log

CRS-5818:Aborted command 'start for resource: ora.ctssd 1 1' for resource 'ora.ctssd'. Details at..

There are a variety of reasons for this problem: 1, the public,private network card is not configured correctly, 2, the firewall is not closed, 3 the firewall hostname appears on line 127.0.0.1 of / etc/hosts

I checked / etc/hosts127.0.0.1 znode1 localhost.localdomain localhost and changed the line 127.0.0.1 of all nodes to 127.0.0.1 localhost.localdomain localhost.

Turn off OUI,deinstall and reinstall the installation smoothly.

Without oui, it should also be possible to re-execute root.sh on the failed node / app/product/grid/11.2.0/crs/install/roothas.pl-delete-force-verbose. / app/product/grid/11.2.0/root.sh

Problems with shared disk setting in vmware server2 RAC

1. Set the second disk to scsi1 control, set the hard disk to independent-persistent, and do the same addition on both nodes.

two。 Add or modify the following parameters:

Scsi1:0.mode = "independent-persistent" scsi1.present = "TRUE" # scsi1.sharedBus = "none" scsi1.virtualDev = "lsilogic" scsi1:0.present = "TRUE" scsi1:0.fileName = "D:\ VM RAC\ vm_rac1\ vm_shared_disk.vmdk" scsi1:0.writeThrough = "TRUE" disk.locking = "FALSE" diskLib.dataCacheMaxSize = "0" diskLib.dataCacheMaxReadAheadSize = "0" diskLib.DataCacheMinReadAheadSize = "0" diskLib.dataCachePageSize = "4096" diskLib.maxUnsyncedWrites = "0" scsi1.sharedBus = "virtual" scsi1.shared = "TRUE"

3. Then, start the two vm, on the first node, do the fdisk shared disk, and then partprobe the device. Check the node, and then check node 2 to see if it is synchronized:

[root@rac1] # fdisk-lDisk / dev/sda: 10.7 GB, 10737418240 bytes255 heads, 63 sectors/track, 1305 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sda1 * 1 13 104391 83 Linux/dev/sda2 14 1177 9349830 83 Linux/dev/sda3 1178 1305 102828 160 82 Linux swap / SolarisDisk / dev/sdb: 5368 MB, 5368709120 bytes255 heads, 63 sectors/track, 652 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesDisk / dev/sdb doesn't contain a valid partition table

[root@rac1 ~] # fdisk / dev/sdb

.

.

Command (m for help): P Disk / dev/sdb: 5368 MB, 5368709120 bytes255 heads, 63 sectors/track, 652 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdb1 1 13 104391 83 LinuxCommand (m for help): wThe partition table has been altered calling ioctl () to re-read partition table.WARNING: Re-reading the partition table failed with error 16: Device or resource busy.The kernel still uses the old table.The new table will be used at the next reboot.Syncing disks.

[root@rac1] # partprobe / dev/sdb [root@rac1] # fdisk-lDisk / dev/sda: 10.7 GB, 10737418240 bytes255 heads, 63 sectors/track, 1305 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sda1 * 1 13 104391 83 Linux/dev/sda2 14 1177 9349830 83 Linux/dev/sda3 1178 1305 1028160 82 Linux swap / SolarisDisk / dev/sdb: 5368 MB, 5368709120 bytes255 heads, 63 sectors/track CylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdb1 1 13 104391 83 Linux

Node 2:

[root@rac2] # fdisk-lDisk / dev/sda: 10.7 GB, 10737418240 bytes255 heads, 63 sectors/track, 1305 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sda1 * 1 13 104391 83 Linux/dev/sda2 14 1177 9349830 83 Linux/dev/sda3 1178 1305 102828 160 82 Linux swap / SolarisDisk / dev/sdb: 5368 MB, 5368709120 bytes255 heads, 63 sectors/track, 652 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdb1 1 13 104391 Linux

Solution to termination of 11G GRID installation missing to libcap.so.1 2013-10-11 10:28:26

A 11G RAC test environment was built on OEL 6.3.The libcap.so.1: cannot open shared object file: No such file or directory error was encountered when the root.sh script was finally executed. As follows: [root@rac1 11.2.0] # / g01/oraInventory/orainstRoot.shChanging permissions of / g01/oraInventory.Adding read,write permissions for group.Removing read,write Execute permissions for world.Changing groupname of / g01/oraInventory to oinstall.The execution of the script is complete. [root@rac1 11.2.0] # / g01/app/11.2.0/grid/root.shRunning Oracle 11g root.sh script...The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= / g01/app/11.2.0/gridEnter the full pathname of the local bin directory: [/ usr/local/bin]: Copying dbhome to / usr/local/bin... Copying oraenv to / usr/local/bin... Copying coraenv to / usr/local/bin... Creating / etc/oratab file...Entries will be added to the / etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of root.sh script.Now product-specific root actions will be performed.2013-10-10 03:41:35: Parsing the host name2013-10-10 03:41:35: Checking for super user privileges2013-10-10 03:41:35: User has super user privilegesUsing configuration parameter file: / g01/app/11.2. 0/grid/crs/install/crsconfig_paramsCreating trace directory/g01/app/11.2.0/grid/bin/clscfg.bin: error while loading shared libraries: libcap.so.1: cannot open shared object file: No such file or directoryFailed to create keys in the OLR Rc = 127. 32512OLR configuration failed queried it. The discovery was caused by a lack of packages. Reinstall this package on 2 nodes. [root@rac1 Packages] # rpm-ivh compat-libcap1-1.10-1.x86_64.rpmwarning: compat-libcap1-1.10-1.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEYPreparing... # [100%] 1:compat-libcap1 # delete the previous CRS configuration. [root@rac1] # perl $GRID_HOME/crs/install/rootcrs.pl-verbose-deconfig-force2013-10-10 04:01:41: Parsing the host name2013-10-10 04:01:41: Checking for super user privileges2013-10-10 04:01:41: User has super user privilegesUsing configuration parameter file: / g01/app/11.2.0/grid/crs/install/crsconfig_paramsPRCR-1035: Failed to look up CRS resource ora.cluster_vip.type for 1PRCR-1068: Failed to query resourcesCannot communicate With crsdPRCR-1070: Failed to check if resource ora.gsd is registeredCannot communicate with crsdPRCR-1070: Failed to check if resource ora.ons is registeredCannot communicate with crsdPRCR-1070: Failed to check if resource ora.eons is registeredCannot communicate with crsdADVM/ACFS is not supported on oraclelinux-release-6Server-3.0.2.x86_64ACFS-9201: Not SupportedFailure at scls_scr_setval with code 8Internal Error Information: Category:-2 Operation: failed Location: scrsearch4 Other: id doesnt exist scls_scr_setval System Dependent Information: 2CRS-4544: Unable to connect to OHASCRS-4000: Command Stop failed Or completed with errors.error: package cvuqdisk is not installedSuccessfully deconfigured Oracle clusterware stack on this node executes the root.sh script again Another ohasd failed to start at / g01/app/11.2.0/grid/crs/install/rootcrs.pl line 443 error was encountered. [root@rac1 ~] # / g01/app/11.2.0/grid/root.shRunning Oracle 11g root.sh script...The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= / g01/app/11.2.0/gridEnter the full pathname of the local bin directory: [/ usr/local/bin]: Copying dbhome to / usr/local/bin. Copying oraenv to / usr/local/bin... Copying coraenv to / usr/local/bin... Entries will be added to the / etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of root.sh script.Now product-specific root actions will be performed.2013-10-10 04:02:57: Parsing the host name2013-10-10 04:02:57: Checking for super user privileges2013-10-10 04:02:57: User has super user privilegesUsing configuration parameter file: / g01/app/11.2.0/grid/crs/install/crsconfig _ paramsLOCAL ADD MODE Creating OCR keys for user 'root' Privgrp 'root'..Operation successful. Root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user certAdding daemon to inittabCRS-4124: Oracle High Availability Services startup failed.CRS-4000: Command Start failed, or completed with errors.ohasd failed to start: Inappropriate ioctl for deviceohasd failed to start at / g01/app/11.2.0/grid/crs/install/rootcrs.pl line 443. After searching on the Internet, it turned out to be ORACLE's BUG. The solution is to keep executing the following command in another window when pa user cert appears, until the command is executed successfully, which is really abnormal. / bin/dd if=/var/tmp/.oracle/npohasd of=/dev/null bs=1024 count=1 can be found in: https://forums.oracle.com/thread/2352285

Oracle cluster utility failed

When the grid infrastructure of Oracle 11gR2 is installed under linux, the last step of verification occurs after the execution of root.sh.

The following error is "oracle cluster utility failed".

Everything was good before.

Check crs_stat-t and find that the gsd resource is the target and the status value is offline.

Official Oracle sources explain. This GSD is used on the 9.2 library, if there is no 9.2 library, the service can be OFFLINE.

5.3.4 Enabling The Global Services Daemon (GSD) for Oracle Database Release 9.2By default, the Global Services daemon (GSD) is disabled. If you install Oracle Database 9i release 2 on Oracle Grid Infrastructure for a Cluster 11g release 2, then you must enable the GSD. Use the following commands to enable the GSD before you install Oracle Database release 9.2:

Srvctl enable nodeapps-gsrvctl start nodeapps

Therefore, this issue can not be considered.

The error message of NTPD was found in the installation log file. I recalled that I did not start the NTPD background service before, ignoring the error past.

Therefore, start the NTPD service manually.

[bash] # chkconfig-- level 2345 ntpd on [bash] # / etc/init.d/ntpd restart

Reinstall it again, and everything is fine this time.

During 11g installation, all check items are the most successful.

Postscript:

In fact, the error can be ignored. NTPD may not be used. It's just a time synchronization.

Gsd's resource offline doesn't matter either. The goal of the initial setting is offline, which is no longer needed in 11g.

11gR2 grid installation final error [INS-20802] Oracle Cluster Verification Utility failed

The reason is that scan ip is specified in the hosts file.

An error is also reported in the log:

INFO: Checking Single Client Access Name (SCAN)... INFO: Checking name resolution setup for "rac-scan"... INFO: ERROR: INFO: PRVF-4664: Found inconsistent name resolution entries for SCAN name "rac-scan" INFO: ERROR: INFO: PRVF-4657: Name resolution setup check for "rac-scan" (IP address: 192.168.0.20) failedINFO: ERROR: INFO: PRVF-4664: Found inconsistent name resolution entries for SCAN name "rac-scan" INFO: Verification of SCAN VIP and Listener setup failed

A search found that Lao Yang (yangtingkun) also mentioned this error in his article:

F:RHEL5.532oracle_patchyangtingkun installs Oracle11_2 RAC for Solaris10 sparc64 (II). Mht

Lao Yang mentioned at the end of the article:

The reason for this error is that the address of SCAN is configured in / etc/hosts. Try to ping the address information. If it is successful, this error can be ignored.

I tried to ping ping scan ip, so I ignored this error for the time being.

Problems in database installation an example of 11gr2 RAC installation INS-35354

There was a problem with INS-35354 when installing a set of 11.2.0.2 RAC databases today:

Because GI of 11.2.0.2 has been successfully installed before, and all the states of Cluster are normal, this error is rarely surprising:

[grid@vrh2 ~] $crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

I searched MOS and found that it may be caused by incorrect inventory.xml updates in oraInventory:

Applies to:

Oracle Server-Enterprise Edition-Version: 11.2.0.1 to 11.2.0.2-Release: 11.2 to 11.2

Information in this document applies to any platform.

Symptoms

Installing 11gR2 database software in a Grid Infrastrsucture environment fails with the error INS-35354:

The system on which you are attempting to install Oracle RAC is not part of a valid cluster.

Grid Infrastructure (Oracle Clusterware) is running on all nodes in the cluster which can be verified with:

Crsctl check crs

Changes

This is a new install.

Cause

As per 11gR2 documentation the error description is:

INS-35354: The system on which you are attempting to install Oracle RAC is not part of a valid cluster.

Cause: Prior to installing Oracle RAC, you must create a valid cluster.

This is done by deploying Grid Infrastructure software

Which will allow configuration of Oracle Clusterware and Automatic Storage Management.

However, the problem at hand may be that the central inventory is missing the "CRS=true" flag

(for the Grid Infrastructure Home).

-

-

From the inventory.xml, we see that the HOME NAME line is missing the CRS= "true" flag.

The error INS-35354 will occur when the central inventory entry for the Grid Infrastructure

Home is missing the flag that identifies it as CRS-type home.

Solution

Use the-updateNodeList option for the installer command to fix the the inventory.

The full syntax is:

. / runInstaller-updateNodeList "CLUSTER_NODES= {node1,node2}"

ORACLE_HOME= "" ORACLE_HOME_NAME= "" LOCAL_NODE= "Node_Name" CRS= [true | false]

Execute the command on any node in the cluster.

Examples:

For a two-node RAC cluster on UNIX:

Node1:

Cd / u01/grid/oui/bin

. / runInstaller-updateNodeList "CLUSTER_NODES= {node1,node2}" ORACLE_HOME= "/ u01/crs"

ORACLE_HOME_NAME= "GI_11201" LOCAL_NODE= "node1" CRS=true

For a 2-node RAC cluster on Windows:

Node 1:

Cd e:\ app\ 11.2.0\ grid\ oui\ bin

E:\ app\ 11.2.0\ grid\ oui\ bin\ setup-updateNodeList "CLUSTER_NODES= {RACNODE1,RACNODE2}"

ORACLE_HOME= "e:\ app\ 11.2.0\ grid" ORACLE_HOME_NAME= "OraCrs11g_home1" LOCAL_NODE= "RACNODE1" CRS=true

The inventory.xml in my environment is as follows:

[grid@vrh2 ContentsXML] $cat inventory.xml

11.2.0.2.0

2.1.0.6.0

Apparently in

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.