Shulou(Shulou.com)06/01 Report--

Oracle Study-Oracle 11g RAC add Node error

System environment:

Operating system: RedHat EL5

Cluster: Oracle 11gR2 Grid

Oracle: Oracle 11gR2

Failure 1: the time of the new node is out of sync with the original node, and failed to add the node.

1. Execute "root.sh" on the new node

[root@wqy3 install] # / u01/11.2.0/grid/root.sh

Running Oracle 11g root.sh script... The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= / u01/11.2.0/grid Enter the full pathname of the local bin directory: [/ usr/local/bin]: The file "dbhome" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying dbhome to / usr/local/bin... The file "oraenv" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying oraenv to / usr/local/bin... The file "coraenv" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying coraenv to / usr/local/bin... Entries will be added to the / etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. 2015-06-03 14:05:38: Parsing the host name 2015-06-03 14:05:38: Checking for super user privileges 2015-06-03 14:05:38: User has super user privileges Using configuration parameter file: / u01/11.2.0/grid/crs/install/crsconfig_params LOCAL ADD MODE Creating OCR keys for user 'root', privgrp' root'.. Operation successful. Adding daemon to inittab CRS-4123: Oracle High Availability Services has been started. Ohasd is starting CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node wqy2, number 2, and is terminating An active cluster was found during exclusive startup Restarting to join the cluster CRS-2672: Attempting to start 'ora.mdnsd' on' wqy3' CRS-2676: Start of 'ora.mdnsd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.gipcd' on' wqy3' CRS-2676: Start of 'ora.gipcd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on' wqy3' CRS-2676: Start of 'ora.gpnpd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on' wqy3' CRS-2676: Start of 'ora.cssdmonitor' on' wqy3' succeeded CRS-2672: Attempting to start' ora.cssd' on' wqy3' CRS-2672: Attempting to start 'ora.diskmon' on' wqy3' CRS-2676: Start of' ora.diskmon' on' wqy3' succeeded CRS-2676: Start of 'ora.cssd' on' wqy3' succeeded CRS-2672: Attempting to start' ora.ctssd' on' wqy3' CRS-2674: Start of 'ora.ctssd' on' wqy3' failed CRS-4000: Command Start failed Or completed with errors. Command return code of 1,256 from command: / u01/11.2.0/grid/bin/crsctl start resource ora.ctssd-init-env USR_ORA_ENV=CTSS_REBOOT=TRUE Start of resource "ora.ctssd-init-env USR_ORA_ENV=CTSS_REBOOT=TRUE" failed Failed to start CTSS Failed to start Oracle Clusterware stack

-failed to start the ctssd process

View the alarm log:

[root@wqy3 ctssd] # tail-f octssd.log

2015-06-03 12 Master private node name Master private node name [wqy1] 2015-06-03 12 CTSS] ctssslave_msh: Connect String is (ADDRESS= (PROTOCOL=tcp) (HOST=wqy1) (PORT=14631)): [CTSS] [2988764048] ctssslave_msh: Forming connection with CTSS master node [1] 50.645: [CTSS] [2988764048] ctssslave_msh: Successfully connected to master [1] 2015-06-03 12 Successfully connected to master CTSS: [2988764048] ctssslave_swm: The magnitude [7198995297417 usec] of the offset [7198995297417 usec] is larger than [86400000000 usec] sec which is the CTSS limit. 2015-06-03 12 CTSS: [2988764048] ctsselect_mmg9_3: Failed in clsctsselect_select_mode [12]: Time offset is too much to be corrected 2015-06-03 12 CTSS: [2978274192] ctss_checkcb: clsdm requested check alive. Returns [40000050] 2015-06-03 12 ctsselect_mmg: [CTSS] [2988764048] CTSS daemon exiting [12]. 2015-06-03 12 ctss_init 51.552: [CTSS] [2988764048] CTSS daemon aborting 2015-06-03 12 CTSS: [3046532800] ctss_init: Spawn completed. Waiting for threads to join 2015-06-03 14 Oracle Database CTSS Release 07 Oracle Database CTSS Release 28.085: [CTSS] [3046586048] Oracle Database CTSS Release 11.2.0.1.0 Production Copyright 2006, 2007 Oracle. All rights reserved. 2015-06-03 14 SCLs Context is 0x99bd618 07MAV 28.085: [CTSS] [3046586048] ctss_scls_init: SCLs Context is 0x99bd618 2015-06-03 1407MAV 28.098: [CTSS] [3046586048] ctss_css_init: CSS Context is 0x99bd6c0 2015-06-03 147MAV 28.099: [CTSS] [3046586048] ctss_clsc_init: CLSC Context is 0x99be000 2015-06-03 1407MAV 28.099: [CTSS] [3046586048] ctss_ Init: CTSS production mode 2015-06-03 14 07VR 28.099: [CTSS] [3046586048] ctss_init: CTSS_REBOOT=TRUE. Overriding 'reboot' argument as if' octssd reboot' is executed. Turn on start up step sync. 2015-06-03 14 NTP default pid file not found 07 sclsctss_gvss8 28.099: [CTSS] [3046586048] sclsctss_gvss2: NTP default pid file not found 2015-06-03 14 purge 07V 28.099: [CTSS] [3046586048] sclsctss_gvss8: Return [0] and NTP status [1]. 2015-06-03 14 Vendor time sync software is not detected 07VR 28.099: [CTSS] [3046586048] Vendor time sync software is not detected. Status [1]. 2015-06-03 14 The Socket name is 07VR 28.099: [CTSS] [3046586048] ctsscomm_init: The Socket name is [(ADDRESS= (PROTOCOL=tcp) (HOST=wqy3))] 2015-06-03 1414 The Socket name is 07VR 28.101: [CTSS] [3046586048] ctsscomm_init: Successful completion. 2015-06-03 14 CTSS [CTSS] [3009797008] clsctsselect_mm: Master Monitor thread started [CTSS] [2999307152] ctsselect_msm: Slave Monitor thread started 2015-06-03 14 PORT 0728.102: [CTSS] [2988817296] ctsselect_mmg: The local nodenum is 4 2015-06-03 14 Pub data for member 07VR 28.103: [CTSS] [2988817296] ctsselect_mmg2_5: Pub data for member. {Version [1] Node [1] Priv node name [wqy1] Port num [14631] SW version [186646784] Mode [0x40]} 2015-06-03 14 purge 07MAV 28.104: [CTSS] [2988817296] ctsselect_mmg2_5: Pub data for member [2]. {Version [1] Node [2] Priv node name [wqy2] Port num [42486] SW version [186646784] Mode [0x40]} 2015-06-03 14 purge 07 CTSSMASTER 28.106: [CTSS] [2988817296] ctsselect_mmg4: Successfully registered with [CTSSMASTER] 2015-06-03 14 purge 07MAV 28.107: [CTSS] [2988817296] ctsselect_mmg6: Receive reconfig event. Inc num [9] New master [3] members count [1] 2015-06-03 14 members count 07V 28.107: [CTSS] [2988817296] ctsselect_mmg8: Host [wqy1] Node num [1] is the master 2015-06-03 14V 07V 28.107: [CTSS] [2988817296] ctsselect_sm2: Node [1] is the CTSS master 2015-06-03 14R 07V 28.107: [CTSS] [2988817296] ctssslave_meh2: Master private node name [wqy1 [CTSS] [2988817296] ctssslave_msh: Connect String is (ADDRESS= (PROTOCOL=tcp) (HOST=wqy1) (PORT=14631)) [clsdmt] [2978327440] Listening to (ADDRESS= (PROTOCOL=ipc) (KEY=wqy3DBG_CTSSD)) 2015-06-03 14 Connect String is 07V 28.108: [clsdmt] [2978327440] PID for the Process [4654] Connkey 11 2015-06-03 14 purge 07vir 28.108: [clsdmt] [2978327440] Creating PID [4654] file for home / u01/11.2.0/grid host wqy3 bin ctss to / u01/11.2.0/grid/ctss/init/ 2015-06-03 14purl 07vir 28.108: [clsdmt] [2978327440] Writing PID [4654] to the file [/ u01/11.2.0/grid/ctss/init/wqy3.pid] 2015-06-03 14: 07 Forming connection with CTSS master node 28.109: [CTSS] [2988817296] ctssslave_msh: Forming connection with CTSS master node [1] 2015-06-03 14 purge 07lav 28.110: [CTSS] [2988817296] ctssslave_msh: Successfully connected to master [1] 2015-06-03 14 14 purge 07lav 28.110: [CTSS] [2988817296] ctssslave_swm: The magnitude [7198995304656 usec] of the offset [7198995304656 usec] is larger than [86400000000 usec] sec which is the CTSS limit. 2015-06-03 14 Failed in clsctsselect_select_mode 07 Failed in clsctsselect_select_mode 28.110: [CTSS] [2988817296] ctsselect_mmg9_3: Failed in clsctsselect_select_mode [12]: Time offset is too much to be corrected 2015-06-03 14 purge 07V 29.019: [CTSS] [2978327440] ctss_checkcb: clsdm requested check alive. Returns [40000050] 2015-06-03 147 ctsselect_mmg 29.019: [CTSS] [2988817296] ctsselect_mmg: CTSS daemon exiting [12]. 2015-06-03 14 CTSS 07 ctss_init 29.019: [CTSS] [2988817296] CTSS daemon aborting 2015-06-03 14 purge 07V 29.020: [CTSS] [3046586048] ctss_init: Spawn completed Waiting for threads to join

View new node time:

[root@wqy3 install] # date

Wed Jun 3 14:09:38 CST 2015

Other node time:

[root@wqy1 ~] # date

Thu Mar 12 06:28:57 CST 2015

[root@wqy2 ~] # date

Thu Mar 12 06:29:31 CST 2015

-the time of the new node is seriously out of sync with the original node

2. Adjust the time of the new node

[root@wqy3 install] # date 031206292015

Thu Mar 12 06:29:00 CST 2015

[root@wqy3 install] # date

Thu Mar 12 06:29:01 CST 2015

[root@wqy3 install] #

[root@wqy1 ~] # date

Thu Mar 12 06:28:57 CST 2015

[root@wqy2 ~] # date

Thu Mar 12 06:29:31 CST 2015

4. Clear the CRS configuration and rerun root.sh

[root@wqy3 install] # perl rootcrs.pl-deconfig-force

2015-06-03 14:08:35: Parsing the host name 2015-06-03 14:08:35: Checking for super user privileges 2015-06-03 14:08:35: User has super user privileges Using configuration parameter file:. / crsconfig_params PRCR-1035: Failed to look up CRS resource ora.cluster_vip.type for 1 PRCR-1068: Failed to query resources Cannot communicate with crsd PRCR-1070: Failed to check if resource ora.gsd is registered Cannot communicate with crsd PRCR-1070: Failed to check if resource ora.ons is Registered Cannot communicate with crsd PRCR-1070: Failed to check if resource ora.eons is registered Cannot communicate with crsd ACFS-9200: Supported CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Stop failed Or completed with errors. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'wqy3' CRS-2673: Attempting to stop' ora.mdnsd' on 'wqy3' CRS-2673: Attempting to stop' ora.cssdmonitor' on 'wqy3' CRS-2677: Stop of' ora.cssdmonitor' on 'wqy3' succeeded CRS-2673: Attempting to stop' ora.cssd' on 'wqy3' CRS-2677: Stop of' ora.cssd' on 'wqy3' succeeded CRS-2673: Attempting to stop' ora.gpnpd' on 'wqy3' CRS -2673: Attempting to stop 'ora.diskmon' on' wqy3' CRS-2677: Stop of' ora.mdnsd' on' wqy3' succeeded CRS-2677: Stop of 'ora.gpnpd' on' wqy3' succeeded CRS-2673: Attempting to stop' ora.gipcd' on' wqy3' CRS-2677: Stop of 'ora.gipcd' on' wqy3' succeeded CRS-2677: Stop of' ora.diskmon' on' wqy3' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on' wqy3' has completed CRS-4133: Oracle High Availability Services has been stopped. Error: package cvuqdisk is not installed Successfully deconfigured Oracle clusterware stack on this node

Rerun root.sh

[root@wqy3 install] # / u01/11.2.0/grid/root.sh

Running Oracle 11g root.sh script... The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= / u01/11.2.0/grid Enter the full pathname of the local bin directory: [/ usr/local/bin]: The file "dbhome" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying dbhome to / usr/local/bin... The file "oraenv" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying oraenv to / usr/local/bin... The file "coraenv" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying coraenv to / usr/local/bin... Entries will be added to the / etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. 2015-03-12 06:30:01: Parsing the host name 2015-03-12 06:30:01: Checking for super user privileges 2015-03-12 06:30:01: User has super user privileges Using configuration parameter file: / u01/11.2.0/grid/crs/install/crsconfig_params LOCAL ADD MODE Creating OCR keys for user 'root', privgrp' root'.. Operation successful. Adding daemon to inittab CRS-4123: Oracle High Availability Services has been started. Ohasd is starting CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node wqy1, number 1, and is terminating An active cluster was found during exclusive startup Restarting to join the cluster CRS-2672: Attempting to start 'ora.mdnsd' on' wqy3' CRS-2676: Start of 'ora.mdnsd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.gipcd' on' wqy3' CRS-2676: Start of 'ora.gipcd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on' wqy3' CRS-2676: Start of 'ora.gpnpd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on' wqy3' CRS-2676: Start of 'ora.cssdmonitor' on' wqy3' succeeded CRS-2672: Attempting to start' ora.cssd' on' wqy3' CRS-2672: Attempting to start 'ora.diskmon' on' wqy3' CRS-2676: Start of' ora.diskmon' on' wqy3' succeeded CRS-2676: Start of 'ora.cssd' on' wqy3' succeeded CRS-2672: Attempting to start' ora.ctssd' on' wqy3' CRS-2676: Start of 'ora.ctssd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.drivers.acfs' on' wqy3' CRS-2676: Start of 'ora.drivers.acfs' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.asm' on' wqy3' CRS-2676: Start of 'ora.asm' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.crsd' on' wqy3' CRS-2676: Start of 'ora.crsd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.evmd' on' wqy3' CRS-2676: Start of 'ora.evmd' on' wqy3' succeeded clscfg: EXISTING configuration version 5 detected. Clscfg: version 5 is 11g Release 2. Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp' root'.. Operation successful. PRKC-1024: Invalid netmask: eth0 add nodeapps on node=wqy3... Failed Preparing packages for installation... Cvuqdisk-1.0.7-1 Configure Oracle Grid Infrastructure for a Cluster... Failed Updating inventory properties for clusterware Error in writing to directory / u01/tmp. Oracle Universal Installer needs you to have permission in this area to install. Installation cannot continue. Please make sure TEMP is set to a valid writable directory. : Permission denied Starting Oracle Universal Installer...

-- failed to run, prompting to establish a tmp directory under "/ U01"

Failure 2: the environment variable of the new node is different from that of the original node. It failed to run "root.sh".

1. View the environment variables of the original node

[grid@wqy1 ~] $env | grep tmp

TMPDIR=/u01/tmp

TMP=/u01/tmp

[root@wqy3 install] # mkdir / u01/tmp

[root@wqy3 install] # chmod 1777 / u01/tmp

[root@wqy3 install] # ls-l / U01

Total 28

Drwxr-xr-x 3 grid oinstall 4096 Jun 3 2015 11.2.0

Drwxr-xr-x 4 root root 4096 Jun 3 2015 app

Drwx- 2 root root 16384 Jun 3 2015 lost+found

Drwxrwxrwt 2 root root 4096 Mar 12 06:37 tmp

2. Clear CRS configuration

[root@wqy3 install] # perl rootcrs.pl-deconfig-force

2015-03-12 06:34:59: Parsing the host name 2015-03-12 06:34:59: Checking for super user privileges 2015-03-12 06:34:59: User has super user privileges Using configuration parameter file:. / crsconfig_params VIP exists.:wqy1 VIP exists.: / wqy1-vip/192.168.8.23/255.255.255.0/eth0 VIP exists.:wqy2 VIP exists.: / wqy2-vip/192.168.8.24/255.255.255.0/eth0 GSD exists. ONS daemon exists. Local port 6100, remote port 6200 eONS daemon exists. Multicast port 18447, multicast IP address 234.140.234.80, listening port 2016 PRKO-2439: VIP does not exist. PRKO-2313: VIP wqy3 does not exist. ACFS-9200: Supported CRS-2673: Attempting to stop 'ora.registry.acfs' on' wqy3' CRS-2677: Stop of 'ora.registry.acfs' on' wqy3' succeeded CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'wqy3' CRS-2673: Attempting to stop' ora.crsd' on 'wqy3' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on' wqy3' CRS-2673: Attempting to stop 'ora.OCR_VOTE.dg' on' wqy3' CRS-2677 : Stop of 'ora.OCR_VOTE.dg' on' wqy3' succeeded CRS-2673: Attempting to stop 'ora.asm' on' wqy3' CRS-2677: Stop of 'ora.asm' on' wqy3' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'wqy3' has completed CRS-2677: Stop of' ora.crsd' on 'wqy3' succeeded CRS-2673: Attempting to stop' ora.cssdmonitor' on 'wqy3' CRS-2673: Attempting to stop' ora.ctssd' on 'wqy3' CRS- 2673: Attempting to stop 'ora.evmd' on' wqy3' CRS-2673: Attempting to stop 'ora.asm' on' wqy3' CRS-2673: Attempting to stop 'ora.drivers.acfs' on' wqy3' CRS-2673: Attempting to stop 'ora.mdnsd' on' wqy3' CRS-2677: Stop of 'ora.cssdmonitor' on' wqy3' succeeded CRS-2677: Stop of 'ora.evmd' on' wqy3' succeeded CRS-2677: Stop of 'ora.mdnsd' on' wqy3' succeeded CRS-2677: Stop of 'ora.asm' on' wqy3' succeeded CRS-2677: Stop of' ora.drivers.acfs' on' wqy3' succeeded CRS-2677: Stop of 'ora.ctssd' on' wqy3' succeeded CRS-2673: Attempting to stop' ora.cssd' on' wqy3' CRS-2677: Stop of 'ora.cssd' on' wqy3' succeeded CRS-2673: Attempting to stop' ora.gpnpd' on' wqy3' CRS-2673: Attempting to stop 'ora.diskmon' on' wqy3' CRS-2677: Stop of' Ora.gpnpd' on' wqy3' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on' wqy3' CRS-2677: Stop of' ora.gipcd' on' wqy3' succeeded CRS-2677: Stop of 'ora.diskmon' on' wqy3' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on' wqy3' has completed CRS-4133: Oracle High Availability Services has been stopped. Successfully deconfigured Oracle clusterware stack on this node

3. Rerun root.sh script

[root@wqy3 install] # / u01/11.2.0/grid/root.sh

Running Oracle 11g root.sh script... The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= / u01/11.2.0/grid Enter the full pathname of the local bin directory: [/ usr/local/bin]: The file "dbhome" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying dbhome to / usr/local/bin... The file "oraenv" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying oraenv to / usr/local/bin... The file "coraenv" already exists in / usr/local/bin. Overwrite it? (YBO) [n]: y Copying coraenv to / usr/local/bin... Entries will be added to the / etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. 2015-03-12 06:38:57: Parsing the host name 2015-03-12 06:38:57: Checking for super user privileges 2015-03-12 06:38:57: User has super user privileges Using configuration parameter file: / u01/11.2.0/grid/crs/install/crsconfig_params LOCAL ADD MODE Creating OCR keys for user 'root', privgrp' root'.. Operation successful. Adding daemon to inittab CRS-4123: Oracle High Availability Services has been started. Ohasd is starting CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node wqy1, number 1, and is terminating An active cluster was found during exclusive startup Restarting to join the cluster CRS-2672: Attempting to start 'ora.mdnsd' on' wqy3' CRS-2676: Start of 'ora.mdnsd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.gipcd' on' wqy3' CRS-2676: Start of 'ora.gipcd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on' wqy3' CRS-2676: Start of 'ora.gpnpd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on' wqy3' CRS-2676: Start of 'ora.cssdmonitor' on' wqy3' succeeded CRS-2672: Attempting to start' ora.cssd' on' wqy3' CRS-2672: Attempting to start 'ora.diskmon' on' wqy3' CRS-2676: Start of' ora.diskmon' on' wqy3' succeeded CRS-2676: Start of 'ora.cssd' on' wqy3' succeeded CRS-2672: Attempting to start' ora.ctssd' on' wqy3' CRS-2676: Start of 'ora.ctssd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.drivers.acfs' on' wqy3' CRS-2676: Start of 'ora.drivers.acfs' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.asm' on' wqy3' CRS-2676: Start of 'ora.asm' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.crsd' on' wqy3' CRS-2676: Start of 'ora.crsd' on' wqy3' succeeded CRS-2672: Attempting to start 'ora.evmd' on' wqy3' CRS-2676: Start of 'ora.evmd' on' wqy3' succeeded clscfg: EXISTING configuration version 5 detected. Clscfg: version 5 is 11g Release 2. Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp' root'.. Operation successful. PRKC-1024: Invalid netmask: eth0 add nodeapps on node=wqy3... Failed Preparing packages for installation... Cvuqdisk-1.0.7-1 Configure Oracle Grid Infrastructure for a Cluster... Failed Updating inventory properties for clusterware Starting Oracle Universal Installer... Checking swap space: must be greater than 500 MB. Actual 2047 MB Passed The inventory pointer is located at / etc/oraInst.loc The inventory is located at / u01/app/oraInventory 'UpdateNodeList' was successful.

-the script runs successfully!

4. Verification

[root@wqy3 install] # crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

[root@wqy3 install] # crs_stat-t

Name Type Target State Host-ora.DATA.dg ora....up.type ONLINE ONLINE wqy1 ora....ER.lsnr ora.... Er.type ONLINE ONLINE wqy1 ora....N1.lsnr ora....er.type ONLINE ONLINE wqy1 ora....VOTE.dg ora....up.type ONLINE ONLINE wqy1 ora.RCV.dg ora....up.type ONLINE ONLINE wqy1 ora.asm ora.asm.type ONLINE ONLINE wqy1 ora.eons ora.eons.type ONLINE ONLINE wqy1 ora.gsd ora.gsd.type OFFLINE OFFLINE ora....network ora....rk.type ONLINE ONLINE wqy1 ora.oc4j ora.oc4j.type OFFLINE OFFLINE ora.ons ora.ons.type ONLINE ONLINE wqy1 ora.racdb.db ora....se.type ONLINE ONLINE wqy1 ora .... ry.acfs ora....fs.type ONLINE ONLINE wqy1 ora.scan1.vip ora....ip.type ONLINE ONLINE wqy1 ora....SM1.asm application ONLINE ONLINE wqy1 ora....Y1.lsnr application ONLINE ONLINE wqy1 ora.wqy1.gsd application OFFLINE OFFLINE ora.wqy1.ons application ONLINE ONLINE wqy1 Ora.wqy1.vip ora....t1.type ONLINE ONLINE wqy1 ora....SM2.asm application ONLINE ONLINE wqy2 ora....Y2.lsnr application ONLINE ONLINE wqy2 ora.wqy2.gsd application OFFLINE OFFLINE ora.wqy2.ons application ONLINE ONLINE wqy2 ora.wqy2.vip ora....t1.type ONLINE ONLINE wqy2 Ora....SM4.asm application ONLINE ONLINE wqy3 ora....Y3.lsnr application OFFLINE OFFLINE ora.wqy3.gsd application OFFLINE OFFLINE ora.wqy3.ons application ONLINE ONLINE wqy3

Fault 3: new node missing vip service

1. View the new node Service

[root@wqy3 install] # crs_stat-t

Name Type Target State Host

-ora.DATA.dg ora....up.type ONLINE ONLINE wqy1 ora....ER.lsnr ora....er.type ONLINE ONLINE wqy1 ora....N1.lsnr ora.. .. er.type ONLINE ONLINE wqy1 ora....VOTE.dg ora....up.type ONLINE ONLINE wqy1 ora.RCV.dg ora....up.type ONLINE ONLINE wqy1 ora.asm ora.asm.type ONLINE ONLINE wqy1 ora.eons ora.eons.type ONLINE ONLINE wqy1 ora.gsd ora.gsd.type OFFLINE OFFLINE Ora....network ora....rk.type ONLINE ONLINE wqy1 ora.oc4j ora.oc4j.type OFFLINE OFFLINE ora.ons ora.ons.type ONLINE ONLINE wqy1 ora.racdb.db ora....se.type ONLINE ONLINE wqy1 ora....ry.acfs ora....fs.type ONLINE ONLINE wqy1 Ora.scan1.vip ora....ip.type ONLINE ONLINE wqy1 ora....SM1.asm application ONLINE ONLINE wqy1 ora....Y1.lsnr application ONLINE ONLINE wqy1 ora.wqy1.gsd application OFFLINE OFFLINE ora.wqy1.ons application ONLINE ONLINE wqy1 ora.wqy1.vip ora....t1.type ONLINE ONLINE wqy1 Ora....SM2.asm application ONLINE ONLINE wqy2 ora....Y2.lsnr application ONLINE ONLINE wqy2 ora.wqy2.gsd application OFFLINE OFFLINE ora.wqy2.ons application ONLINE ONLINE wqy2 ora.wqy2.vip ora....t1.type ONLINE ONLINE wqy2 ora....SM4.asm application ONLINE ONLINE wqy3 ora... .Y3.lsnr application OFFLINE OFFLINE ora.wqy3.gsd application OFFLINE OFFLINE ora.wqy3.ons application ONLINE ONLINE wqy3

[root@wqy3 install] # crs_stat | grep vip

NAME=ora.scan1.vip

TYPE=ora.scan_vip.type

NAME=ora.wqy1.vip

TYPE=ora.cluster_vip_net1.type

NAME=ora.wqy2.vip

TYPE=ora.cluster_vip_net1.type

-vip service with missing node3

2. Add vip service of a new node

[root@wqy3 install] # srvctl add nodeapps-h

Adds node application configuration to the specified node. Usage: srvctl add nodeapps {{- n-A / / [if1 [| if2...]]} | {- S / / [if1 [| if2...]]} [- p] [- m] [- e] [- l] [- r] [- t [:] [, [:]...] [- v]-n Node name-A / / [if1 [| if2...]] VIP address spec for node applications-S / / [if1 [| if2...]] NET address spec for network-m The multicast IP address for eONS-p The port number for eONS-e Local listen port for eONS daemon (Default port number is 2016)-l ONS listening port for local client connections-r ONS listening port for connections from remote hosts-t [:] [, [:]...] List of remote host/port pairs for ONS daemons outside this cluster-h Print usage-v Verbose output

[root@wqy3 install] # srvctl add nodeapps-A 192.168.8.27/255.255.255.0/eth0-n wqy3

[root@wqy3 install] # crs_stat | grep vip

NAME=ora.scan1.vip

TYPE=ora.scan_vip.type

NAME=ora.wqy1.vip

TYPE=ora.cluster_vip_net1.type

NAME=ora.wqy2.vip

TYPE=ora.cluster_vip_net1.type

NAME=ora.wqy3.vip

TYPE=ora.cluster_vip_net1.type

Start vip service:

[root@wqy3 install] # crs_start-f ora.wqy3.vip

Attempting to start `ora.wqy3.vip` on member `wqy3`

Start of `ora.wqy3.vip` on member `wqy3` succeeded.

[root@wqy3 install] # ip ad sh

1: lo: mtu 16436 qdisc noqueue link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo inet6:: 1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast qlen 1000 link/ether 08:00:27:70:1d:15 brd ff:ff:ff:ff:ff:ff inet 192 .168.8.26 / 24 brd 192.168.8.255 scope global eth0 inet 192.168.8.27/24 brd 192.168.8.255 scope global secondary eth0:1 inet6 fe80::a00:27ff:fe70:1d15/64 scope link valid_lft forever preferred_lft forever 3: eth2: mtu 1500 qdisc pfifo_fast qlen 1000 link/ether 08:00:27:60:ee:a3 brd ff:ff:ff:ff:ff:ff inet 10. 10.10.103/24 brd 10.10.10.255 scope global eth2 inet6 fe80::a00:27ff:fe60:eea3/64 scope link valid_lft forever preferred_lft forever 4: sit0: mtu 1480 qdisc noop link/sit 0.0.0.0 brd 0.0.0.0

Start the new node Listener:

[root@wqy3 install] # crs_stat | grep lsn

NAME=ora.LISTENER.lsnr

NAME=ora.LISTENER_SCAN1.lsnr

NAME=ora.wqy1.LISTENER_WQY1.lsnr

NAME=ora.wqy2.LISTENER_WQY2.lsnr

NAME=ora.wqy3.LISTENER_WQY3.lsnr

[root@wqy3 install] # crs_start-f ora.wqy3.LISTENER_WQY3.lsnr

Attempting to start `ora.LISTENER.lsnr` on member `wqy3`

Start of `ora.LISTENER.lsnr` on member `wqy3` succeeded.

[root@wqy3 install] # crs_stat-t

Name Type Target State Host-ora.DATA.dg ora....up.type ONLINE ONLINE wqy1 ora....ER.lsnr ora.... Er.type ONLINE ONLINE wqy1 ora....N1.lsnr ora....er.type ONLINE ONLINE wqy1 ora....VOTE.dg ora....up.type ONLINE ONLINE wqy1 ora.RCV.dg ora....up.type ONLINE ONLINE wqy1 ora.asm ora.asm.type ONLINE ONLINE wqy1 ora.eons ora.eons.type ONLINE ONLINE wqy1 ora.gsd ora.gsd.type OFFLINE OFFLINE ora....network ora....rk.type ONLINE ONLINE wqy1 ora.oc4j ora.oc4j.type OFFLINE OFFLINE ora.ons ora.ons.type ONLINE ONLINE wqy1 ora.racdb.db ora....se.type ONLINE ONLINE wqy1 ora .... ry.acfs ora....fs.type ONLINE ONLINE wqy1 ora.scan1.vip ora....ip.type ONLINE ONLINE wqy1 ora....SM1.asm application ONLINE ONLINE wqy1 ora....Y1.lsnr application ONLINE ONLINE wqy1 ora.wqy1.gsd application OFFLINE OFFLINE ora.wqy1.ons application ONLINE ONLINE wqy1 Ora.wqy1.vip ora....t1.type ONLINE ONLINE wqy1 ora....SM2.asm application ONLINE ONLINE wqy2 ora....Y2.lsnr application ONLINE ONLINE wqy2 ora.wqy2.gsd application OFFLINE OFFLINE ora.wqy2.ons application ONLINE ONLINE wqy2 ora.wqy2.vip ora....t1.type ONLINE ONLINE wqy2 Ora....SM4.asm application ONLINE ONLINE wqy3 ora....Y3.lsnr application ONLINE ONLINE wqy3 ora.wqy3.gsd application OFFLINE OFFLINE ora.wqy3.ons application ONLINE ONLINE wqy3 ora.wqy3.vip ora....t1.type ONLINE ONLINE wqy3

-at this point, the new node has been added successfully!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.