Linux+Oracle+12c+RAC+ installation configuration details-GI installation 03/29 Update SLTechnology News&Howtos

Linux+Oracle+12c+RAC+ installation configuration details-GI installation

2025-03-29 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Database >

Shulou(Shulou.com)06/01 Report--

IP address

Hostnam

Use

Instance name

192.168.12.58

Oracle-rac03-db03

Public ip (Node 1)

192.168.12.59

Oracle-rac04-db04

Public ip (Node 2)

192.168.12.73

Rac03-db03-vip

Vip (Node 1)

Racdb3 asm1

192.168.12.74

Rac04-db04-vip

Vip (Node 2)

Racdb4 asm2

192.168.12.75

SCANIP

Scan ip

Shncdb

172.168.12.58

Rac03-db03-priv

Private ip (Node 1)

172.168.12.59

Rac04-db04-priv

Private ip (Node 2)

172.168.12.76

Ip-san

Storage ip

# Public ip

192.168.12.58 oracle-rac03-db03

192.168.12.59 oracle-rac04-db04

# vip

192.168.12.73 rac03-db03-vip

192.168.12.74 rac04-db04-vip

# private-vip

172.168.12.58 rac03-db03-priv

172.168.12.59 rac04-db04-priv

# Scan ip

192.168.12.75 racscan

The cvuqdisk package is part of CVU and can be downloaded from OTN, while GI also has CVU in its package. It is usually the cv directory.

Chkconfigntpd off

Mv/etc/ntp.conf / etc/ntp.conf.orig

Rm/var/run/ntpd.pid

Yum install glibc.i686-y

Yum install glibc-devel-y

Yum install glibc-devel.i686-y

Yum install ksh-y

Yum install libgcc-y

Yum install libgcc.i686-y

Yum install libstdc++-y

Yum install libstdc++.i686-y

Yum install libstdc++-devel-y

Yum install libstdc++-devel.i686-y

Yum install libaio-y

Yum install libaio.i686-y

Yum install libaio-devel-y

Yum install libaio-devel.i686-y

Yum install libXext-y

Yum install libXext.i686-y

Yum install libXtst-y

Yum install libXtst.i686-y

Yum install libX11-y

Yum install libX11.i686-y

Yum install libXau-y

Yum install libXau.i686-y

Yum install libxcb-y

Yum install libxcb.i686-y

Yum install libXi-y

Yum install libXi.i686-y

Yum install make-y

Yum install sysstat-y

Yum install unixODBC-y

Yum install unixODBC-devel-y

Yum install binutils-y

Yum install compat-libcap1-y

Yum install compat-libstdc++-33-y

Yum install compat-libstdc++-33.i686-y

Yum install gcc-y

Yum install gcc-c++-y

Yum install glibc-y

Yum install smartmontools-y

Yum install python*-y

Yum install gcc*-y

Rpm-ivh cvuqdisk*.rpm

Root@ora ~] # vi / etc/sysconfig/selinux

SELINUX=disabled

[root@ora ~] # / usr/sbin/getenforce

Disabled

[root@rac1 ~] # service iptables stop

[root@oracle-rac03-db03 ~] # chkconfig-- list | grep ip

Ip6tables 0:off 1:off 2:off 3:off 4:off 5:off 6:off

Iptables 0:off 1:off 2:off 3:off 4:off 5:off 6:off

[root@rac1] # chkconfig-- level 123456 iptables off

A. Make sure that Linux has installed vnc-server

B. The server needs to enable vnc users (note that each user should run vncpasswd)

[root@bogon ~] # vncpasswd

[root@bogon ~] # vi/etc/sysconfig/vncservers---- (set password in advance, otherwise an error will be reported)

VNCSERVERS= "1:root 2:test"

VNCSERVERARGS [3] = "- geometry 800x600-nolisten tcp-localhost"

If you enable more users, you can directly space and continue to add users in the same format

For example, VNCSERVERS= "1:root 2:test 3:user"

C. Modify the user file ~ / .vnc / xstartup and comment out the last line:

# twm& changed to gnome-session &

d. Restart the vnc service

Servicevncserver restart

e. Set VNCServer to start automatically

1)。 Edit the / etc/sysconfig/vncservers configuration file:

Uncomment the line on VNCSERVERS, for example: VNCSERVERS= "1:root"

Where 1 represents the desktop number and root indicates the startup user

If you want to start multiple VNCServer, separate them with a space, for example:

VNCSERVERS= "1:root2:oracle 3:grid"

F. Start the vncserver service automatically

a)。 Execute the following command to view the status of the vncserver service:

Chkconfig--list vncserver

b)。 Modify vncserver service to start automatically:

Chkconfig--level 345 vncserver on

Client connection

Ip: Port number (5900 + desktop number, password sets password for vncpasswd)

Vncserver-kill: 2

Description

OS group name

Assigned to this group of OS users

Oracle permission

Oracle inventory and software owner

Oinstall

Grid 、 oracle

Oracle automatic Storage Management Group

Asmadmin

Grid

SYSASM

ASM Database administrators Group

Asmdba

Grid 、 oracle

SYSDBA of ASM

ASM operator Group

Asmoper

Grid

SYSOPER of ASM

Database administrator

Dba

Grid,oracle

SYSDBA

Database operator

Oper

Oracle

SYSOPER

Create a new group

/ usr/sbin/groupadd-g 60001 oinstall

/ usr/sbin/groupadd-g 60002 dba

/ usr/sbin/groupadd-g 60003 oper

/ usr/sbin/groupadd-g 60004 backupdba

/ usr/sbin/groupadd-g 60005 dgdba

/ usr/sbin/groupadd-g 60006 kmdba

/ usr/sbin/groupadd-g 60007 asmdba

/ usr/sbin/groupadd-g 60008 asmoper

/ usr/sbin/groupadd-g 60009 asmadmin

New user

/ usr/sbin/useradd-g oinstall-G dba,asmdba,operoracle

Usr/sbin/useradd-g oinstall-G asmadmin,asmdba,asmoper,oper,dba grid

Create a directory

Mkdir-p / oracle/app/grid

Mkdir-p / oracle/app/12.1.0.1/grid

Chown-R grid:oinstall / oracle

Mkdir-p / oracle/app/oraInventory

Chown-R grid:oinstall/oracle/app/oraInventory

Mkdir-p/oracle / app/oracle

Chown-R oracle:oinstall / oracle/app/oracle

Chmod-R 775 / oracle

1. Use udev binding method. See the document for the configuration file.

File path / etc/udev/rule.d/99-oracle-asmdevices.rules

/ sbin/scsi_id-- whitelisted--replace-whitespace-- device=/dev/sdb- drive letter name gets uuid

[root@rac01 rules.d] # / sbin/scsi_id--whitelisted-- replace-whitespace-- device=/dev/sdb

14f504e46494c450031556d7232542d4b416e362d4e624553

Binding format

KERNEL== "sd*", BUS== "scsi", PROGRAM== "/ sbin/scsi_id-whitelisted--replace-whitespace-device=/dev/$name", RESULT== "14f504e46494c45004272785573692d476441622d66676939", NAME= "asm-diskdata1", OWNER= "grid", GROUP= "asmadmin", MODE= "0660"

[root@rac01 rules.d] # ll / dev/sd*- View device

[root@rac01 ~] # ll / dev/sd*

Brw-rw----. 1 root disk 8, 0 May 30 08:13/dev/sda

Brw-rw----. 1 root disk 8, 1 May 30 08:13/dev/sda1

Brw-rw----. 1 root disk 8, 2 May 30 08:13/dev/sda2

Brw-rw----. 1 root disk 8, 3 May 30 08:13/dev/sda3

[root@rac01 rules.d] # ll / dev/asm*- View bindings

Brw-rw----. 1 grid asmadmin 8, 48 May 3008:13 / dev/asm-diskdata1

Brw-rw----. 1 grid asmadmin 8, 80 May 3008:13 / dev/asm-diskdata3

Brw-rw----. 1 grid asmadmin 8, 96 May 3008:13 / dev/asm-diskdata4

Brw-rw----. 1 grid asmadmin 8, 64 May 3008:13 / dev/asm-diskdatar2

Brw-rw----. 1 grid asmadmin 8, 32 May 3008:13 / dev/asm-fl

Brw-rw----. 1 grid asmadmin 8, 16 May 3008:13 / dev/asm-ocr

Scp root@192.168.12.54:/etc/udev/rule.d/99-oracle-asmdevices.rules

/ etc/udev/rule.d/99-oracle-asmdevices.rules

Modify environment variabl

Root

Vi / etc/profile

# ORACLE SETTING

If [$USER = "oracle"] | | [$USER = "grid"]; then

If [$SHELL = "/ bin/ksh"]; then

Ulimit-p 16384

Ulimit-n 65536

Else

Ulimit-u 16384-n 65536

Umask 022

[root@rac02~] # source / etc/profile

Node one:

Modify grid user login script

Vi .bash _ profile

Export TMP=/tmp

Export

Export TMPDIR=$TMP

ORACLE_SID=+ASM1; export ORACLE_SID

ORACLE_TERM=xterm; export ORACLE_TERM

ORACLE_BASE=/oracle/app/grid; exportORACLE_BASE

ORACLE_HOME=/oracle/app/12.1.0.1/grid;export ORACLE_HOME

NLS_DATE_FORMAT= "yyyy-mm-ddHH24:MI:SS"; export NLS_DATE_FORMAT

PATH=.:$PATH:$HOME/bin:$ORACLE_HOME/bin;export PATH

THREADS_FLAG=native; export THREADS_FLAG

If [$USER = "oracle"] | | [$USER = "grid"]; then

If [$SHELL = "/ bin/ksh"]; then

Ulimit-p 16384

Ulimit-n 65536

Else

Ulimit-u 16384-n 65536

Umask 022

Modify oracle user login script

Export TMP=/tmp

Export

Export TMPDIR=$TMP

Export ORACLE_UNQNAME= racdb3

ORACLE_BASE=/oracle/app/oracle; exportORACLE_BASE

ORACLE_HOME=$ORACLE_BASE/product/12.1.0.1/db_1;export ORACLE_HOME

ORACLE_SID= racdb3; export ORACLE_SID

ORACLE_TERM=xterm; export ORACLE_TERM

NLS_DATE_FORMAT= "yyyy-mm-ddHH24:MI:SS"; export NLS_DATE_FORMAT

NLS_LANG=AMERICAN_AMERICA.ZHS16GBK;exportNLS_LANG

PATH=.:$PATH:$HOME/bin:$ORACLE_BASE/product/12.1.0.1/db_1/bin:$ORACLE_HOME/bin

Export PATH

THREADS_FLAG=native; export THREADS_FLAG

If [$USER = "oracle"] | | [$USER = "grid"]; then

If [$SHELL = "/ bin/ksh"]; then

Ulimit-p 16384

Ulimit-n 65536

Else

Ulimit-u 16384-n 65536

Umask 022

Node two

Grid user

Export TMP=/tmp

Export

Export TMPDIR=$TMP

ORACLE_SID=+ASM2; export ORACLE_SID

ORACLE_TERM=xterm; export ORACLE_TERM

ORACLE_BASE=/oracle/app/grid; exportORACLE_BASE

ORACLE_HOME=/oracle/app/12.1.0.1/grid;export ORACLE_HOME

NLS_DATE_FORMAT= "yyyy-mm-ddHH24:MI:SS"; export NLS_DATE_FORMAT

PATH=.:$PATH:$HOME/bin:$ORACLE_HOME/bin;export PATH

THREADS_FLAG=native; export THREADS_FLAG

If [$USER = "oracle"] | | [$USER = "grid"]; then

If [$SHELL = "/ bin/ksh"]; then

Ulimit-p 16384

Ulimit-n 65536

Else

Ulimit-u 16384-n 65536

Umask 022

Oracle

Export

Export TMPDIR=$TMP

Export ORACLE_UNQNAME= racdb4

ORACLE_BASE=/oracle/app/oracle; exportORACLE_BASE

ORACLE_HOME=$ORACLE_BASE/product/12.1.0.1/db_1;export ORACLE_HOME

ORACLE_SID= racdb4; export ORACLE_SID

ORACLE_TERM=xterm; export ORACLE_TERM

NLS_DATE_FORMAT= "yyyy-mm-ddHH24:MI:SS"; export NLS_DATE_FORMAT

NLS_LANG=AMERICAN_AMERICA.ZHS16GBK;exportNLS_LANG

PATH=.:$PATH:$HOME/bin:$ORACLE_BASE/product/12.1.0.1/db_1/bin:$ORACLE_HOME/bin

Export PATH

THREADS_FLAG=native; export THREADS_FLAG

If [$USER = "oracle"] | | [$USER = "grid"]; then

If [$SHELL = "/ bin/ksh"]; then

Ulimit-p 16384

Ulimit-n 65536

Else

Ulimit-u 16384-n 65536

Umask 022

Modify kernel parameters

Fs.aio-max-nr = 1048576

Fs.file-max = 6815744

Kernel.shmmax = 68719476736

Kernel.shmall = 4294967296

Kernel.shmmni = 4096

Kernel.sem = 250 32000 100 128

Net.ipv4.ip_local_port_range = 9000 65500

Net.core.rmem_default = 262144

Net.core.rmem_max = 4194304

Net.core.wmem_default = 262144

Net.core.wmem_max = 1048586

After you have modified the kernel parameters, be sure to run the following command so that the changes take effect immediately, otherwise the check may fail when checking the availability of CRS.

# / sbin/sysctl-p

Configure shell limit

Vi / etc/security/limits.conf

Add the following

# ORACLE SETTING

Grid soft nproc 2047

Grid hard nproc 16384

Grid soft nofile 1024

Grid hard nofile 65536

Oracle soft nproc 2047

Oracle hard nproc 16384

Oracle soft nofile 1024

Oracle hard nofile 65536

Vi / etc/pam.d/login

Add the following

# ORACLE SETTING

Session required pam_limits.so

Execute as oracle and grid users on both machines

[oracle@node1] $mkdir ~ / .ssh

[oracle@node1] $chmod 700 ~ / .ssh

[oracle@node1] $ssh-keygen-t rsa

[oracle@node1] $ssh-keygen-t dsa

Execute with oracle on node one.

[oracle@node1~] $cat ~ / .ssh/id_rsa.pub > > ~ / .ssh/authorized_keys

[oracle@node1~] $cat ~ / .ssh/id_dsa.pub > > ~ / .ssh/authorized_keys

[oracle@node1~] $ssh oracle-rac04-db04 cat ~ / .ssh/id_rsa.pub > > ~ / .ssh/authorized_keys

[oracle@node1~] $ssh oracle-rac04-db04 cat ~ / .ssh/id_dsa.pub > > ~ / .ssh/authorized_keys

[oracle@node1] $scp ~ / .ssh/authorized_keys oracle-rac04-db04:~/.ssh/authorized_keys

Check if a password is required to log in (execute as oracle respectively)

[oracle@node1~] $ssh oracle-rac04-db04 date

[oracle@node1~] $ssh oracle-rac03-db03 date

[oracle@node1~] $ssh rac03-db03-priv date

[oracle@node1~] $ssh rac04-db04-priv date

Switch to node2 execution (execute as oracle respectively)

[oracle@node2~] $ssh node1 date

[oracle@node2~] $ssh node2 date

[oracle@node2~] $ssh node1-priv date

Method: use sshUserSetup.sh to quickly create mutual trust

SshUserSetup.sh is in the oui/prov/resources/scripts directory after the GI installation media is unzipped.

The following two commands can be executed on one node (can be executed under the root user):

/ home/grid/oui/prov/resources/scripts

#. / sshUserSetup.sh-user grid-hosts "rac2 rac1"-advanced-exverify-confirm

#. / sshUserSetup.sh-user oracle-hosts "rac2 rac1"-advanced-exverify-confirm

Use udev binding. See the documentation for the configuration file.

File path / etc/udev/rule.d/99-oracle-asmdevices.rules

/ sbin/scsi_id-- whitelisted--replace-whitespace-- device=/dev/sdb- drive letter name gets uuid

Binding format

1. IP configuration (please do not capitalize the machine name)

[root@iap-gz-rac05~] # cat / etc/hosts

2. Memory space size

[root@iap-gz-rac05~] # free-m

3. Operating system users, oracle and grid environment variables

4. Password-free login authentication (oracle and grid users)

5. Other (grid users)

. / runcluvfy.sh stage-pre crsinst-n oracle-rac03-db03,oracle-rac04-db04-verbose

Common error problem solving

Oracle Database 12c Release 1

OCR adjudication requires 5G

Oracle Database 12c Release 2 cluster installation

A. Note that the file decompression should be placed under the ORALCE_HOME defined by the environment variable, otherwise an error will be reported.

B. two asm disk groups will be established during installation

Here to talk about the configuration of disks, in Oracle12c introduced the concept of MGMTDB, this in 12.1 RAC is in the same disk group with OCR, and the space occupied is about several G, but in 12cR2, MGMT and OCR can be in the same disk group or a separate disk group can be used, Oracle is used alone by default, but in 12cR2 MGMTDB occupies a particularly large space, requiring disk space of more than 38g. So the space capacity I allocate here is the disk for sdb and sdc to do OCR, each 2G for MGMT and sde for MGMT, and each 20G for DATA for SDF and sdg. If the space will not be installed, the error shown below will be reported:

C. Modify disk properties-which disks need to be checked to create disks for disk groups

# echo deadline > / sys/block/sdb/queue/scheduler

# echo deadline > / sys/block/sdd/queue/scheduler

Verify the result of property modification:

[root@rac1 dev] # more/sys/block/sdb/queue/scheduler

Noop anticipatory [deadline] cfq

D. after the installation and execution of the script, the machine was restarted for no reason, and the reason was not found.

Grid installation is different between Oracle Database 12cRelease 1 and Oracle Database 12cRelease 2

(1) the difference of software directory structure

(2) differences between ASM disks

(3) the difference between Oracle Database 12c and Release 2 disks

[root@oracle-rac03-db03 grid] #. / root.sh

Performing root user operation.

The following environment variables are setas:

ORACLE_OWNER= grid

ORACLE_HOME= / oracle/app/12.1.0.1/grid

Enter the full pathname of the local bindirectory: [/ usr/local/bin]:

Copying dbhome to / usr/local/bin...

Copying oraenv to / usr/local/bin...

Copyingcoraenv to / usr/local/bin...

Creating / etc/oratab file...

Entries will be added to the / etc/oratabfile as needed by

Database Configuration Assistant when adatabase is created

Finished running generic part of rootscript.

Now product-specific root actions will beperformed.

Relinking oracle with rac_on option

Using configuration parameter file:/oracle/app/12.1.0.1/grid/crs/install/crsconfig_params

The log of current session can be found at:

/ oracle/app/grid/crsdata/oracle-rac03-db03/crsconfig/rootcrs_oracle-rac03-db03_2017-08-18 12-47-54AM.log

12:48:01 on 2017-08-18 CLSRSC-594: Executinginstallation step 1 of 19: 'SetupTFA'.

12:48:01 on 2017-08-18 CLSRSC-4001: InstallingOracle Trace File Analyzer (TFA) Collector.

12:49:26 on 2017-08-18 CLSRSC-4002:Successfully installed Oracle Trace File Analyzer (TFA) Collector.

12:49:26 on 2017-08-18 CLSRSC-594: Executinginstallation step 2 of 19: 'ValidateEnv'.

2017-08-18 12:49:36 CLSRSC-363: Userignored prerequisites during installation

12:49:36 on 2017-08-18 CLSRSC-594: Executinginstallation step 3 of 19: 'CheckFirstNode'.

12:49:38 on 2017-08-18 CLSRSC-594: Executinginstallation step 4 of 19: 'GenSiteGUIDs'.

12:49:39 on 2017-08-18 CLSRSC-594: Executinginstallation step 5 of 19: 'SaveParamFile'.

12:49:45 on 2017-08-18 CLSRSC-594: Executinginstallation step 6 of 19: 'SetupOSD'.

12:49:46 on 2017-08-18 CLSRSC-594: Executinginstallation step 7 of 19: 'CheckCRSConfig'.

12:49:46 on 2017-08-18 CLSRSC-594: Executinginstallation step 8 of 19: 'SetupLocalGPNP'.

12:50:08 on 2017-08-18 CLSRSC-594: Executinginstallation step 9 of 19: 'ConfigOLR'.

12:50:17 on 2017-08-18 CLSRSC-594: Executinginstallation step 10 of 19: 'ConfigCHMOS'.

12:50:17 on 2017-08-18 CLSRSC-594: Executinginstallation step 11 of 19: 'CreateOHASD'.

12:50:22 on 2017-08-18 CLSRSC-594: Executinginstallation step 12 of 19: 'ConfigOHASD'.

12:50:50 on 2017-08-18 CLSRSC-330: AddingClusterware entries to file 'oracle-ohasd.conf'

12:51:31 on 2017-08-18 CLSRSC-594: Executinginstallation step 13 of 19: 'InstallAFD'.

12:51:34 on 2017-08-18 CLSRSC-594: Executinginstallation step 14 of 19: 'InstallACFS'.

CRS-2791: Starting shutdown of Oracle HighAvailability Services-managed resources on 'oracle-rac03-db03'

CRS-2793: Shutdown of Oracle HighAvailability Services-managed resources on 'oracle-rac03-db03' has completed

CRS-4133: Oracle High Availability Serviceshas been stopped.

CRS-4123: Oracle High Availability Serviceshas been started.

12:52:43 on 2017-08-18 CLSRSC-594: Executinginstallation step 15 of 19: 'InstallKA'.

12:52:47 on 2017-08-18 CLSRSC-594: Executinginstallation step 16 of 19: 'InitConfig'.

CRS-2791: Starting shutdown of Oracle HighAvailability Services-managed resources on 'oracle-rac03-db03'

CRS-2793: Shutdown of Oracle HighAvailability Services-managed resources on 'oracle-rac03-db03' has completed

CRS-4133: Oracle High Availability Serviceshas been stopped.

CRS-4123: Oracle High Availability Serviceshas been started.

CRS-2672: Attempting to start 'ora.evmd' on'oracle-rac03-db03'

CRS-2672: Attempting to start 'ora.mdnsd'on' oracle-rac03-db03'

CRS-2676: Start of 'ora.evmd' on'oracle-rac03-db03' succeeded

CRS-2676: Start of 'ora.mdnsd' on'oracle-rac03-db03' succeeded

CRS-2672: Attempting to start 'ora.gpnpd'on' oracle-rac03-db03'

CRS-2676: Start of 'ora.gpnpd' on'oracle-rac03-db03' succeeded

CRS-2672: Attempting to start'ora.cssdmonitor' on 'oracle-rac03-db03'

CRS-2672: Attempting to start 'ora.gipcd'on' oracle-rac03-db03'

CRS-2676: Start of 'ora.cssdmonitor' on'oracle-rac03-db03' succeeded

CRS-2676: Start of 'ora.gipcd' on'oracle-rac03-db03' succeeded

CRS-2672: Attempting to start 'ora.cssd' on'oracle-rac03-db03'

CRS-2672: Attempting to start 'ora.diskmon'on' oracle-rac03-db03'

CRS-2676: Start of 'ora.diskmon' on'oracle-rac03-db03' succeeded

CRS-2676: Start of 'ora.cssd' on'oracle-rac03-db03' succeeded

Disk groups created successfully. Check/oracle/app/grid/cfgtoollogs/asmca/asmca-170818PM125352.log for details.

12:55:22 on 2017-08-18 CLSRSC-482: Runningcommand:'/ oracle/app/12.1.0.1/grid/bin/ocrconfig-upgrade grid oinstall'

CRS-2672: Attempting to start 'ora.crf' on'oracle-rac03-db03'

CRS-2672: Attempting to start 'ora.storage'on' oracle-rac03-db03'

CRS-2676: Start of 'ora.storage' on'oracle-rac03-db03' succeeded

CRS-2676: Start of 'ora.crf' on'oracle-rac03-db03' succeeded

CRS-2672: Attempting to start 'ora.crsd' on'oracle-rac03-db03'

CRS-2676: Start of 'ora.crsd' on'oracle-rac03-db03' succeeded

CRS-4256: Updating the profile

Successful addition of voting disk0af75e811a324f4abfd98f859a8b6b79.

Successfully replaced voting disk groupwith + DATA.

CRS-4256: Updating the profile

CRS-4266: Voting file (s) successfullyreplaced

# # STATE File Universal Id File Name Disk group

1.ONLINE 0af75e811a324f4abfd98f859a8b6b79 (/ dev/asmdocr) [DATA]

Located 1 voting disk (s).

CRS-2791: Starting shutdown of Oracle HighAvailability Services-managed resources on 'oracle-rac03-db03'

CRS-2673: Attempting to stop 'ora.crsd' on'oracle-rac03-db03'

CRS-2677: Stop of 'ora.crsd' on'oracle-rac03-db03' succeeded

CRS-2673: Attempting to stop 'ora.storage'on' oracle-rac03-db03'

CRS-2673: Attempting to stop 'ora.crf' on'oracle-rac03-db03'

CRS-2673: Attempting to stop 'ora.gpnpd' on'oracle-rac03-db03'

CRS-2673: Attempting to stop 'ora.mdnsd' on'oracle-rac03-db03'

CRS-2677: Stop of 'ora.crf' on'oracle-rac03-db03' succeeded

CRS-2677: Stop of 'ora.storage' on'oracle-rac03-db03' succeeded

CRS-2673: Attempting to stop 'ora.asm' on'oracle-rac03-db03'

CRS-2677: Stop of 'ora.gpnpd' on'oracle-rac03-db03' succeeded

CRS-2677: Stop of 'ora.mdnsd' on'oracle-rac03-db03' succeeded

CRS-2677: Stop of 'ora.asm' on'oracle-rac03-db03' succeeded

CRS-2673: Attempting to stop'ora.cluster_interconnect.haip' on 'oracle-rac03-db03'

CRS-2677: Stop of'ora.cluster_interconnect.haip' on 'oracle-rac03-db03' succeeded

CRS-2673: Attempting to stop 'ora.ctssd' on'oracle-rac03-db03'

CRS-2673: Attempting to stop 'ora.evmd' on'oracle-rac03-db03'

CRS-2677: Stop of 'ora.ctssd' on'oracle-rac03-db03' succeeded

CRS-2677: Stop of 'ora.evmd' on'oracle-rac03-db03' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on'oracle-rac03-db03'

CRS-2677: Stop of 'ora.cssd' on'oracle-rac03-db03' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on'oracle-rac03-db03'

CRS-2677: Stop of 'ora.gipcd' on'oracle-rac03-db03' succeeded

CRS-2793: Shutdown of Oracle HighAvailability Services-managed resources on 'oracle-rac03-db03' has completed

CRS-4133: Oracle High Availability Serviceshas been stopped.

12:57:29 on 2017-08-18 CLSRSC-594: Executinginstallation step 17 of 19: 'StartCluster'.

CRS-4123: Starting Oracle High AvailabilityServices-managed resources