Shulou(Shulou.com)06/01 Report--

I. Installation environment

1. Experimental environment

Virtual machine: VMware Workstation 8.0.3_64bit

ORACLE：Oracle Database11g11.2.0.3.0-64bit

Operating System: Red Hat Enterprise Linux 6.5

2. Node configuration

described

Node 1 Node 2 Node 3 ISCSI Storage Host Name note1note2note3iscsi-asmPublic IP172.16.1.7(vlan 3) 172.16.1.8(vlan3) 172.16.1.9(vlan3)172.16.1.20(vlan3)Private IP192.168.1.11 (vlan 5) 192.168.1.12(vlan5) 192.168.1.13(vlan5)

Virtual IP172.16.1.17172.16.1.18172.16.1.19

Scan IP172.16.1.10、172.16.1.11、172.16.1.12

Example name racdb1racdb2racdb3

/etc/hosts

127.0.0.1 localhost.localdomain localhost

#Public IP

172.16.1.7 note1

172.16.1.8 note2

172.16.1.9 note3

#Virtual IP

172.16.1.17 note1-vip

172.16.1.18 note2-vip

172.16.1.19 note3-vip

#Private IP

192.168.1.11 note1-priv

192.168.1.12 note2-priv

192.168.1.13 note3-priv

#Scan IP (scan ip is odd, 3 are recommended)

172.16.1.10 cluster-scan

172.16.1.11 cluster-scan

172.16.1.12 cluster-scan

172.16.1.20 iscis-asm

The above environment configuration process is omitted. You can change the IP and host name after cloning multiple machines through the Clone function of VM.

II. Basic system configuration

1. Build a storage server

A. Add disk creation software RAID5

Create software RAID5, a total of 3 disks, no hot standby, please refer to the relevant information

[root@iscsi-asm ~] # mdadm -Cv /dev/md0 -l5 -n3/dev/sd[bcd]1

B. Configure ISCSI disk

Install the sis-target-utils package used by the server. Before installation, confirm that the following installation packages are installed: kernel-source, kernel, gcc, perl

[root@iscsi-asm~] # rpm -ivh scsi-target-utils*.rpm

// RedHat 6 is in the Packages directory on CD

// RedHat 5 on CD under ClusterStorage directory

Configure the server side/etc/tgt/targets.conf file

[root@iscsi-asm ~] # cat >> /etc/tgt/targets.conf

> backing-store /dev/md0

>

> EOF

start the iSCSI service

[root@iscsi-asm ~] # service tgtd restart //restart iscsi service

[root@iscsi-asm ~] # chkconfig --level 2345 tgtd on //Set boot auto-boot

[root@iscsi-asm ~] # chkconfig --list tgtd //View self-startup items

[root@iscsi-asm ~] # tgt-admin --show target1 //Check if tgtd is configured successfully

2. Mount ISCSI disk

A, node 1 Note1:

[root@note1 ~] # rpm -ivh iscsi-initiator-utils*.rpm

[root@note1 ~] # service iscsid restart //restart iscsi service

[root@note1 ~] # chkconfig --level 2345 iscsid on //Set boot autostart

[root@note1 ~] # chkconfig --list iscsid //View self-startup items

[root@note1 ~] # iscsiadm -m node -p 172.16.1.20-l //login iscsi storage

B. On node 2 note2:

[root@note2 ~] # rpm -ivh iscsi-initiator-utils*.rpm

[root@note2 ~] # service iscsid restart //restart iscsi service

[root@note2 ~] # chkconfig --level 2345 iscsid on //Set boot auto-boot

[root@note2 ~] # chkconfig --list iscsid //View self-startup items

[root@note2 ~] # iscsiadm -m node -p 172.16.1.20-l //login iscsi storage

C. On node 3 note3:

[root@note3 ~] # rpm -ivh iscsi-initiator-utils*.rpm

[root@note3 ~] # service iscsid restart //restart iscsi service

[root@note3 ~] # chkconfig --level 2345 iscsid on //Set boot autostart

[root@note3 ~] # chkconfig --list iscsid //View self-startup items

[root@note3 ~] # iscsiadm -m node -p 172.16.1.20-l //login iscsi storage

D. Divide ISCSI disk

[root@note1 ~] # fdisk /dev/sdb //mount iscsi stored disk, do not format

2. UDEV configuration ASM

A. ASM disk planning

ASM disk groups

Disk Group Size ASM Redundant ASM Disk ISCSI Disk Path Storage Rule +CRS20G

EXTERN

/dev/asm-crs1

/dev/sdb1OCR, voting disk +DATA60GEXTERN/dev/asm-db1/dev/sdb2 data file

+ARCH40GEXTERN/dev/asm-db2/dev/sdb3 Archive

If the attribute of the disk group where the voting disk is located is EXTERNAL, it is one block; if it is NORMAL, it needs three blocks; if it is HIGH, it needs five blocks, and it needs to be odd. This is used for voting when brain splitting occurs.

B. Configure UDEV

[root@note1 ~] # scsi_id -g -u -d /dev/sdb //get disk UUID

1IET_00010001

[root@note1 ~] #vim /etc/udev/rules.d/99-oracle-asmdevices.rules

KERNEL=="sdb1", BUS=="scsi",PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent",RESULT==" 1IET_00010001",NAME="asm-crs″, OWNER="grid", GROUP="asmadmin", MODE="0660″

KERNEL=="sdb2", BUS=="scsi", PROGRAM=="/sbin/scsi_id-g -u -d /dev/$parent",RESULT==" 1IET_00010001", NAME="asm-db1", OWNER="grid",GROUP="asmadmin", MODE="0660″

KERNEL=="sd? 1″, BUS=="scsi",PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent",RESULT==" 1IET_00010001",NAME="asm-db2″, OWNER="grid", GROUP="asmadmin", MODE="0660″

Transfer UDEV configuration files to other nodes

[root@note1 ~] # rsync -r /etc/udev/rules.d/99-oracle-asmdevices.rules 172.16.1.8: /etc/udev/rules.d/

[root@note1 ~] # rsync -r /etc/udev/rules.d/99-oracle-asmdevices.rules 172.16.1.9: /etc/udev/rules.d/

C. Start UDEV

[root@note1 ~] #start_udev

[root@note2 ~] #start_udev

[root@note3 ~] #start_udev

3. Configure ORACLE software installation environment

1. Linux packages required to install oracle RAC

[root@note1~] # yum -y install binutils* compat-libstdc++* elfutils-libelf* elfutils-libelf-devel* compat-libcap1 * elfutils-libelf-devel-static* gcc* gcc-c++* glibc* glibc-common* glibc-devel* glibc-headers* ksh* libaio* libaio-devel* libgcc*libgomp* libstdc++* libstdc++-devel* make* sysstat* unixODBC * unixODBC-devel*

Execute the same command on nodes 2 and 3 to install the required packages.

2. Configure cluster time synchronization service

Cluster Time Synchronization Service (CTSS) is used here and Network Time Protocol (NTP) needs to be uninstalled.

[root@note1 ~] #service ntpd stop

[root@note1 ~] #chkconfig -level 2345 ntpd off

[root@note1 ~] #rm -rf /etc/ntp.conf

Execute the same command on Node 2 and Node 3 to uninstall NTP

After cluster installation, verify that ctssd is active

[grid@note1 ~] #crsctl check ctss

1. Configure kernel parameters

Three nodes execute the following script:

#!/ bin/bashprepareSystem(){# Set SElinux to disabled mode regardless of its initial value sed -i -e's/^SELINUX=.*/ SELINUX=disabled/' /etc/selinux/config setenforce 0# stop iptables /etc/init.d/iptables stop chkconfig --level 0123456 iptables off chkconfig --level 0123456 ip6tablesoff} Configure1(){ cat >> /etc/sysctl.conf/etc/security/limits.conf /etc/pam.d/login

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.