Shulou(Shulou.com)06/01 Report--

A production environment Oracle Linux 7.1 Oracle 12C RAC shows that the cluster resources of node 1 are not started. The information is as follows:

[grid@cs2] $crsctl stat res-t----Name Target State Server State details-- -Local Resources-- -- ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE cs2 STABLEora.CRS.dg ONLINE ONLINE cs2 STABLEora.DATA.dg ONLINE ONLINE cs2 STABLEora.LISTENER.lsnr ONLINE ONLINE cs2 STABLEora.chad ONLINE OFFLINE cs2 STABLEora.net1.network ONLINE ONLINE cs2 STABLEora.ons ONLINE OFFLINE cs2 STABLEora.proxy_advm OFFLINE OFFLINE cs2 STABLE----Cluster Resources- -ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE cs2 STABLEora.LISTENER_SCAN2.lsnr 1 ONLINE ONLINE cs2 STABLEora.LISTENER_SCAN3.lsnr 1 ONLINE ONLINE cs2 STABLEora.MGMTLSNR 1 ONLINE ONLINE cs2 169.254.255.92 88.88. 88.191 STABLEora.asm 1 ONLINE OFFLINE STABLE 2 ONLINE ONLINE cs2 Started,STABLE 3 OFFLINE OFFLINE STABLEora.cs.db 1 ONLINE OFFLINE STABLE 2 ONLINE OFFLINE Instance Shutdown ST ABLEora.cs1.vip 1 ONLINE INTERMEDIATE cs2 FAILED OVER STABLEora.cs2.vip 1 ONLINE ONLINE cs2 STABLEora.cvu 1 ONLINE ONLINE cs2 STABLEora.gns 1 ONLINE OFFLINE STABLEora.gns.vip 1 ONLINE OFFLINE STABLEora.mgmtdb 1 ONLINE OFFLINE Instance Shutdown ST ABLEora.qosmserver 1 ONLINE ONLINE cs2 STABLEora.scan1.vip 1 ONLINE ONLINE cs2 STABLEora.scan2.vip 1 ONLINE ONLINE cs2 STABLEora.scan3.vip 1 ONLINE ONLINE cs2 STABLE

If you view the alert.log file on node 1, the information is as follows:

[root@cs1 soft] # tail-100 / u01/app/grid/diag/crs/cs1/crs/trace/alert.log2020-01-14 20 CVUD (2366CRS-10051: CVU found following errors with Clusterware setup: PRVE-3191: (DESCRIPTION = (LOAD_BALANCE=on) (ADDRESS = (PROTOCOL = TCP) (HOST = cs-cluster-scan.cs-cluster.jy.net) (PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = cs)) Listener refused the connection with the following error:ORA-12514 TNS:listener does not currently know of service requested in connect descriptor 2020-02-17 14 CRS-5822 49V 28.563 [ORAROOTAGENT (15500)] CRS-5822: Agent'/ u01 apprenticeship produce disconnected from server 12.2.0 CRS Greater than orarootagent trees root.' Details at (: CRSAGF00117:) {0in/ u01/app/grid/diag/crs/cs1/crs/trace/crsd_orarootagent_root.trc.2020 5lav 63832} in/ u01/app/grid/diag/crs/cs1/crs/trace/crsd_orarootagent_root.trc.2020-02-17 1414RV 49 ORAAGENT 28.584 [ORAAGENT (15466)] CRS-5822: Agent'/ u01qappable productCPT 12.2.0GRABINGUBINGRABING gridding. Details at (: CRSAGF00117:) {0:1:36} in / u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid.trc.2020-02-17 14 in 49 u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid.trc.2020 29.607 [GPNPD (3293)] CRS-2329: GPNPD on node cs1 shut down. 2020-02-17 14 Oracle Clusterware OSYSMOND process with operating system process ID 4930. 123 [OSYSMOND (6077)] CRS-8504: Oracle Clusterware OSYSMOND process with operating system process ID 6077 is exiting2020-02-17 14 14 V 4931.377 [MDNSD (3254)] CRS-5602: mDNS service stopping by request.2020-02-17 14 14 V 49 31.747 [MDNSD (3254)] CRS-8504: Oracle Clusterware MDNSD process with operating system process ID 3254 is exiting2020-02-17 14 V 49 49 46 [OCTSSD (5883)] CRS-2405: The Cluster Time Synchronization Service on host cs1 is shutdown by user2020-02-17 14 CRS-8504 46.651 [OCTSSD (5883)] CRS-8504: Oracle Clusterware OCTSSD process with operating system process ID 5883 is exiting2020-02-17 1449 Oracle Clusterware OCTSSD process with operating system process ID 47.651 [OCSSD (3616)] CRS-1603: CSSD on node cs1 has been shut down.2020-02-17 14V Oracle Clusterware OCTSSD process with operating system process ID 4947.958 [OCSSD (3616)] CRS-1660: The CSS daemon shutdown has completed2020-02-17 14V 4947.959 [OCSSD (3616)] CRS-8504: Oracle Clusterware OCSSD process with operating system process ID 3616 is exiting2020-02-17 14 ORAAGENT 49.726 [ORAAGENT (3235)] CRS-5822: Agent'/ u01 * Details at (: CRSAGF00117:) {0in/ u01/app/grid/diag/crs/cs1/crs/trace/ohasd_oraagent_grid.trc.2020 9lav 818} in/ u01/app/grid/diag/crs/cs1/crs/trace/ohasd_oraagent_grid.trc.2020-02-17 1414 ORAROOTAGENT 49.727 [ORAROOTAGENT (3029)] CRS-5822: Agent'/ u01qappable produce disconnected from server 12.2.0qqqr _ r _ r Details at (: CRSAGF00117:) {0:1:21} in / u01/app/grid/diag/crs/cs1/crs/trace/ohasd_orarootagent_root.trc.

Follow the error message above to view the crsd_oraagent_grid.trc trace file:

[root@cs1] # more / u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid.trcTrace file / u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid.trcOracle Database 12c Clusterware Release 12.2.0.1.0-Production Copyright 1996, 2016 Oracle. All rights reserved.*** TRACE CONTINUED FROM FILE / u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid_910.trc * * 2020-02-17 14 ora.ASMNET1LSNR_ASM.lsnr 39 22.129: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] LsnrAgent::regEndpoint 110 reset regEndPointDone:02020-02-17 1415 39 22. 129: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] generateEndPointStrings:generate endpoints2020-02-17 1414 check 3922.129: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] VendorType=02020-02-17 1414 ora.ASMNET1LSNR_ASM.lsnr 3922.129: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] VendorType=02020-02-17 1414 CLSDYNAM:2462013184 3922.129: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check ] VendorType=02020-02-17 14 ora.ASMNET1LSNR_ASM.lsnr 39 22.129: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] VendorType=02020-02-17 14 14 ora.ASMNET1LSNR_ASM.lsnr 39 22.129: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] generateEndPointStrings:No IP matching the subnet 88.88.02020-02-17 1439 ora.ASMNET1LSNR_ASM.lsnr 22.130: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0: 1:18} [check] Ocr Context init default level 18146295362020-02-17 1414 ora.ASMNET1LSNR_ASM.lsnr 3922.133: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] Agent::getDeploymentPlatformId return 2020-02-17 1414 ora.ASMNET1LSNR_ASM.lsnr 3922.133: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] LsnrAgent::generateEndPoints 000000 entry {nonPriv2020-02-17 14V 3922.133: CLSDYNAM:2462013184: [ Ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] LsnrAgent::generateEndPoints 000000 entry {lsnrResName: endpAttr:TCP:1526 type:42020-02-17 14 14 entry 39 22. 133: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] LsnrAgent::generateEndPoints 040 Listener ResName:2020-02-17 14 14 15 39 Listener ResName:2020-02-17 14 14 15 39 22. 133 CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] LsnrAgent :: removeDuplicates 2020-02-17 14 ora.ASMNET1LSNR_ASM.lsnr 3922. 133: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] LsnrAgent::generateEndPoints 999 exit nonPriv} 2020-02-17 14 ora.ASMNET1LSNR_ASM.lsnr 39 22. 133: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] LsnrAgent::regEndpoint 200 endpStrings empty2020-02-17 14 ora.ASMNET1LSNR_ASM.lsnr 39 22. 134: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] AsmLsnrAgent::init2020-02-17 14 ora.ASMNET1LSNR_ASM.lsnr 39 22.154: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] VendorType=02020-02-17 14 14 Swiss 3922.154: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] VendorType=02020-02-17 1439 Switzerland 22.154: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0: 1:18} [check] VendorType=02020-02-17 14 ora.ASMNET1LSNR_ASM.lsnr 39 22.154: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] VendorType=02020-02-17 14 14 purge 3922.154: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] Cannot find an IP address matching the subnet 88.88.02020-02-17 14 CLSDYNAM:2462013184 3922.154: CLSDYNAM:2462013184: [ora.ASMNET1LSNR _ ASM.lsnr] {0:1:18} [check] Ocr Context init default level 18146295362020-02-17 14Ocr Context init default level 3922.157: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check] Agent::getDeploymentPlatformId return 2020-02-17 1414140 3922.158: CLSCEVT:2462013184: (: CLSCE0028:) clsce_unsubscribe 0x7f725c004510 successfully unsubscribed: 9748332020-02-171414143922.158: USRTHRD:2462013184: {0:1:18} WorkerThread :: removeWorker total workers: 22020-02-17 14 Worker::schedule adding worker 'ReconnSub-LsnrAgentSub-ASMNET1LSNR_ASM' to thread' ReconnectingSubscribers'2020-02-17 14 Worker::schedule adding worker 3922.158: USRTHRD:2462013184: {0:1:18} Worker::schedule adding worker 'ReconnSub-LsnrAgentSub-ASMNET1LSNR_ASM' to thread' ReconnectingSubscribers'2020-02-17 14 Worker::schedule adding worker 3922.158: USRTHRD:2462013184: {0:1:18} WorkerThread::addWorker total workers: 32020-02-17 14 Worker::schedule adding worker 3922.158: CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr] {0:1:18} [check ] Skipping CSS Initialization for rebootless recovery2020-02-17 14 clsce_subscribe 0x7f72600d06b0 filter=' 39 RESOURCE_PROFILE_CHANGE.*RESOURCE_CLASS=' 22.159: clsce_subscribe 0x7f72600d06b0 filter=' (^ CRS _ RESOURCE_PROFILE_CHANGE.*RESOURCE_CLASS=' (scan_vip | vip)') | (^ CRS _ RESOURCE_PROFILE_CHANGE.*TYPE='ora\ .network\ .type')' Flags=1, handler=0xc6ad0c, arg=0x7f726016de10

From the error message above, you can find Cannot find an IP address matching the subnet 88.88.88.0, which indicates that the private IP is missing.

To check the network IP address

Node 2 private IP is normal

[grid@cs2] $ifconfig-aens160: flags=4163 mtu 1500 inet 10.13.13.191 netmask 255.255.255.0 broadcast 10.13.255 inet6 fe80::250:56ff:fea0:92af prefixlen 64 scopeid 0x20 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet) RX packets 127560233 bytes 10186683662 (9.4 GiB) RX errors 0 dropped 353 overruns 0 frame 0 TX packets 18954431 bytes 1554204413 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0ens160:1: flags=4163 mtu 1500 inet 10.13.13.130 netmask 255.255.255.0 broadcast 10.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet) ens160:2: flags=4163 mtu 1500 inet 10.13.13.147 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af Txqueuelen 1000 (Ethernet) ens160:3: flags=4163 mtu 1500 inet 10.13.13.141 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet) ens160:4: flags=4163 mtu 1500 inet 10.13.13.138 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet) ens160:5: Flags=4163 mtu 1500 inet 10.13.137 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet) ens160:6: flags=4163 mtu 1500 inet 10.13.136 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet) ens192: flags=4163 mtu 1500 inet 88.88 .191 netmask 255.255.255.0 broadcast 88.88.88.255 inet6 fe80::250:56ff:fea0:a05c prefixlen 64 scopeid 0x20 ether 00:50:56:a0:a0:5c txqueuelen 1000 (Ethernet) RX packets 294716840 bytes 215309349272 (200.5 GiB) RX errors 0 dropped 355 overruns 0 frame 0 TX packets 63703465 bytes 363393728693 (338.4 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0ens192:1: flags=4163 mtu 1500 Inet 169.254.255.92 netmask 255.255.0.0 broadcast 169.254.255.255 ether 00:50:56:a0:a0:5c txqueuelen 1000 (Ethernet) lo: flags=73 mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6:: 1 prefixlen 128 scopeid 0x10 loop txqueuelen 0 (Local Loopback) RX packets 90029207 bytes 223833448058 (208.4 GiB) RX errors 0 dropped 0 overruns 0 Frame 0 TX packets 90029207 bytes 223833448058 (208.4 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0: flags=4099 mtu 1500 inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255 ether 52:54:00:d0:6e:0b txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 ( 0.0B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0-nic: flags=4098 mtu 1500 ether 52:54:00:d0:6e:0b txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 [grid@cs2 ~] $cat / etc/hosts127.0.0 . 1 localhost10.13.13.190 cs110.13.13.191 cs2#10.13.13.192 cs1-vip.jy.net cs1-vip#10.13.13.193 cs2-vip.jy.net cs2-vip88.88.88.190 cs1-priv.jy.net cs1-priv88.88.88.191 cs2-priv.jy.net cs2-priv10.13.13.141 cs-cluster-scan 10.13.13.142 cs-cluster-scan 10.13.13.143 cs-cluster-scan

Loss of private IP for Node 1

[root@cs1] # ifconfig-aens160: flags=4163 mtu 1500 inet 10.13.13.190 netmask 255.255.255.0 broadcast 10.13.255 inet6 fe80::250:56ff:fea0:4e69 prefixlen 64 scopeid 0x20 inet6 2018 Groupe 2 prefixlen 64 scopeid 0x0 ether 00:50:56:a0:4e:69 txqueuelen 1000 (Ethernet) RX packets 53266410 bytes 3937179306 (3.6GiB) RX errors 0 dropped 143overruns 0 frame 0 TX packets 2988621 bytes 284679938 (271.4 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0ens192: flags=4163 mtu 1500 inet6 fe80::250:56ff:fea0:17dc prefixlen 64 scopeid 0x20 ether 00:50:56:a0:17:dc txqueuelen 1000 (Ethernet) RX packets 70361859 bytes 5602168856 (5.2GiB) RX errors 0 dropped 0frame 0 TX packets 24902418 bytes 195063342601 (181.6 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0lo: flags=73 mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6:: 1 prefixlen 128 scopeid 0x10 loop txqueuelen 0 (Local Loopback) RX packets 30235303 bytes 10958756943 (10.2 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 30235303 bytes 10958756943 (10.2 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0: flags=4099 mtu 1500 inet 192 .168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255 ether 52:54:00:d0:6e:0b txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0b ytes 0 (0.0B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0-nic: flags=4098 mtu 1500 ether 52:54:00:d0:6e: 0b txqueuelen 500 (Ethernet) RX packets 0 bytes 0 (0.0B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

Set private IP

[root@cs1 network-scripts] # cat ifcfg-Ethernet_connection_ens192TYPE=EthernetBOOTPROTO=noneDEFROUTE=yesIPV4_FAILURE_FATAL=noIPV6INIT=noNAME=ens192UUID=8ec45d90-c1fb-4924-84a0-72f58fc9b82fDEVICE=ens192ONBOOT=yesIPADDR=88.88.88.190PREFIX=24NETMASK=255.255.255.0 [root@cs1 network-scripts] # ifconfig-aens160: flags=4163 mtu 1500 inet 10.138.130.190 netmask 255.255.255.0 broadcast 10.138.130.255 inet6 fe80::250:56ff:fea0:4e69 prefixlen 64 scopeid 0x20 inet6 2018 prefixlen 64 scopeid 0x0 ether 00: 50:56:a0:4e:69 txqueuelen 1000 (Ethernet) RX packets 53277081 bytes 3937945677 (3.6GiB) RX errors 0 dropped 143overruns 0 frame 0 TX packets 2989099 bytes 284806540 (271.6 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0ens192: flags=4163 mtu 1500 inet 88.88.190 netmask 255.255.255.0 broadcast 88.88.255 inet6 fe80::250:56ff:fea0:17dc prefixlen 64 scopeid 0x20 ether 00:50:56:a0:17:dc txqueuelen 1000 (Ethernet) RX packets 70371906 bytes 5602881459 (5.2GiB) RX errors 0 dropped 1000 overruns 0 TX packets 24902428 bytes 195063343317 (181.6 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0lo: flags=73 mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6:: 1 prefixlen 128 scopeid 0x10 loop txqueuelen 0 (Local Loopback) RX packets 30236949 bytes 10959017396 RX errors 0 dropped 0 overruns 0 frame 0 TX packets 30236949 bytes 10959017396 (10.2 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0: flags=4099 mtu 1500 inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255 ether 52:54:00:d0:6e:0b txqueuelen 0 (Ethernet) RX packets 0 Bytes 0 (0.0B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0-nic: flags=4098 mtu 1500 ether 52:54:00:d0:6e:0b txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

[root@cs1] # crsctl stop crs-f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2'

CRS-2673: Attempting to stop 'ora.mdnsd' on' cs2'

CRS-2673: Attempting to stop 'ora.gpnpd' on' cs2'

CRS-2673: Attempting to stop 'ora.crf' on' cs2'

CRS-2673: Attempting to stop 'ora.ctssd' on' cs2'

CRS-2673: Attempting to stop 'ora.evmd' on' cs2'

CRS-2673: Attempting to stop 'ora.asm' on' cs2'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on' cs2'

CRS-2677: Stop of 'ora.drivers.acfs' on' cs2' succeeded

CRS-2677: Stop of 'ora.ctssd' on' cs2' succeeded

CRS-2677: Stop of 'ora.crf' on' cs2' succeeded

CRS-2677: Stop of 'ora.gpnpd' on' cs2' succeeded

CRS-2677: Stop of 'ora.evmd' on' cs2' succeeded

CRS-2677: Stop of 'ora.mdnsd' on' cs2' succeeded

CRS-2677: Stop of 'ora.asm' on' cs2' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on' cs2'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on' cs2' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on' cs2'

CRS-2677: Stop of 'ora.cssd' on' cs2' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on' cs2'

CRS-2673: Attempting to stop 'ora.driver.afd' on' cs2'

CRS-2677: Stop of 'ora.driver.afd' on' cs2' succeeded

CRS-2677: Stop of 'ora.gipcd' on' cs2' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[root@cs1 ~] # crsctl start crs

CRS-4123: Oracle High Availability Services has been started.

Manually start the cluster software for node 1

[root@cs1] # crsctl stat res-t----Name Target State Server State details-- -Local Resources-- -- ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.CRS.dg ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.DATA.dg ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.DN.dg OFFLINE OFFLINE cs1 STABLE OFFLINE OFFLINE cs2 STABLEora.LISTENER.lsnr ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.chad ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.net1.network ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.ons ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.proxy_advm OFFLINE OFFLINE cs1 STABLE OFFLINE OFFLINE cs2 STABLE----Cluster Resources- -ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE cs1 STABLEora.LISTENER_SCAN2.lsnr 1 ONLINE ONLINE cs2 STABLEora.LISTENER_SCAN3.lsnr 1 ONLINE ONLINE cs1 STABLEora.MGMTLSNR 1 ONLINE ONLINE cs1 169.254.207.24 88.88. 88.190 STABLEora.asm 1 ONLINE ONLINE cs1 Started,STABLE 2 ONLINE ONLINE cs2 Started,STABLE 3 OFFLINE OFFLINE STABLEora.cs.db 1 ONLINE ONLINE cs1 Open HOME=/u01/app/o racle/product/12.2.0 / db,STABLE 2 ONLINE ONLINE cs2 Open HOME=/u01/app/o racle/product/12.2.0 / db STABLEora.cs1.vip 1 ONLINE ONLINE cs1 STABLEora.cs2.vip 1 ONLINE ONLINE cs2 STABLEora.cvu 1 ONLINE ONLINE cs1 STABLEora.gns 1 ONLINE ONLINE cs2 STABLEora.gns.vip 1 ONLINE ONLINE Cs2 STABLEora.mgmtdb 1 ONLINE OFFLINE cs1 Open STABLEora.qosmserver 1 ONLINE ONLINE cs1 STABLEora.scan1.vip 1 ONLINE ONLINE cs1 STABLEora.scan2.vip 1 ONLINE ONLINE cs2 STABLEora.scan3.vip 1 ONLINE ONLINE cs1 STABLE- -

Back to normal at this point.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.