In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-01-31 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Database >
Share
Shulou(Shulou.com)05/31 Report--
This article introduces the relevant knowledge of "what are the installation steps of GREENPLUM 5.17 centos 6.10". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!
Installation media:
Greenplum-db-5.17.0-rhel6-x86_64.zip
There are binary installation package and RPM installation package. I choose binary installation package here to install.
Machine planning (one master node, three data nodes):
192.168.11.210 mdw192.168.11.211 sdw1192.168.11.212 sdw2192.168.11.213 sdw3
1, disable firewall and selinux
Service iptables stopchkconfig iptables offvi / etc/selinux/configselinux=disabled
2. Configure kernel parameters
Configure the kernel parameter file:
Vi / etc/sysctl.confkernel.shmmax = 500000000kernel.shmmni = 4096kernel.shmall = 4000000000kernel.sem = 1024000 200 4096kernel.sysrq = 1kernel.core_uses_pid = 1kernel.msgmnb = 65536kernel.msgmax = 65536kernel.msgmni = 2048net.ipv4.tcp_syncookies = 1net.ipv4.conf.default.accept_source_route = 0net.ipv4.tcp_tw_recycle = 1net.ipv4.tcp_max_syn_backlog = 4096net.ipv4.conf.all.arp_filter = 1net.ipv4.ip_local_port_range = 10000 65535net. Core.netdev_max_backlog = 10000net.core.rmem_max = 2097152net.core.wmem_max = 2097152vm.overcommit_memory = 2vm.swappiness = 10vm.dirty_expire_centisecs = 500vm.dirty_writeback_centisecs = 100vm.dirty_background_ratio = 0vm.dirty_ratio=0vm.dirty_background_bytes = 1610612736vm.dirty_bytes = 4294967296
Execute sysctl-p to make kernel parameters take effect
3. Configure resource limit parameters
Vi / etc/security/limits.conf* soft nofile 65536 * hard nofile 65536 * soft nproc 131072 * hard nproc 131072
4, file system format
XFS is recommended for file system format
5. Configure disk file read-ahead parameters
Recommended configuration is 16384
Get the current value: / sbin/blockdev-- getra / dev/sda
Set the new value: / sbin/blockdev-- setra 16384 / dev/sda
6. Configure disk Ihop O scheduling policy
It is recommended to set it to deadline mode. There are two ways to set it.
Method 1:
Echo deadline / sys/block/sda/queue/scheduler
If it fails after restart, you can configure the above command into the environment variable or rc.local to make it take effect.
Method 2 (permanent):
Configure elevator=deadline in grub.conf:
Vi / etc/grub.confkernel / vmlinuz-2.6.32-754.11.1.el6.x86_64 ro root=UUID=39773d5f-aa30-4e9c-aca4-b8f41a865397 elevator=deadline rd_NO_LUKS rd_NO_LVM.UTF-8 rd_NO_MD SYSFONT=latarcyrheb-sun16 crashkernel=auto KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rhgb quiet
7, disable THP (transparent large pages)
Add transparent_hugepage=never to grub.conf:
Vi / etc/grub.confkernel / vmlinuz-2.6.32-754.11.1.el6.x86_64 ro root=UUID=707d5027-2cc0-4111-9efc-bddc1cc4fe5d elevator=deadline rd_NO_LUKS rd_NO_LVM.UTF-8 rd_NO_MD SYSFONT=latarcyrheb-sun16 crashkernel=auto KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rhgb quiet transparent_hugepage=never
Restart is required to take effect.
8, create users and groups
Groupadd gpadminuseradd gpadmin-g gpadminNew password: Retype new password:
9, install GPDB
Unzip greenplum-db-5.17.0-rhel6-x86_64.zip. / greenplum-db-5.17.0-rhel6-x86_64.bin
In interactive mode, you need to accept license, set the installation path, etc. The installation path of this article is / home/gpadmin/greenplum
10, create the hostlist file
Create two hostlist files that list the hostnames of each node (host lists all machine hostnames, seg_host lists only segment hostnames)
Vi hostmdwsdw1sdw2sdw3vi seg_hostsdw1sdw2sdw3
11, configure each node to trust each other
Gpssh-exkeys-f / home/gpadmin/greenplum/host
12. Other nodes install GPDB in batch
Gpseginstall-f / home/gpadmin/greenplum/host
-confirm the installation of other nodes
Gpssh-f / home/gpadmin/greenplum/host-e ls-l $GPHOME
13, create a data storage directory
The master node creates a data directory:
Mkdir-p / home/gpadmin/gpdata/master
Segment nodes create directories in batch
Gpssh-f seg_host-e'mkdir-p / home/gpadmin/gpdata/primary'gpssh-f seg_host-e'mkdir-p / home/gpadmin/gpdata/mirror'
Since this article is installed directly under the home directory, it will not involve permission issues. If you install other directories, you need to configure the appropriate permissions.
14, configure NTP synchronization
Slightly
15. Configure initialization gpdb parameters
Copy the initialization parameter file to the gpdb installation directory
Cp / home/gpadmin/greenplum/docs/cli_help/gpconfigs/gpinitsystem_config / home/gpadmin/greenplum
Modify gpdb initialization parameter file
Vi gpinitsystem_config ARRAY_NAME= "Greenplum Data Platform" SEG_PREFIX=gpsegPORT_BASE=6000declare-a DATA_DIRECTORY= (/ home/gpadmin/gpdata/primary / home/gpadmin/gpdata/primary / home/gpadmin/gpdata/primary) MASTER_HOSTNAME=mdwMASTER_DIRECTORY=/home/gpadmin/gpdata/masterMASTER_PORT=5432TRUSTED_SHELL=sshCHECK_POINT_SEGMENTS=8ENCODING=UNICODEMIRROR_PORT_BASE=7000REPLICATION_PORT_BASE=8000MIRROR_REPLICATION_PORT_BASE=9000declare-a MIRROR_DATA_DIRECTORY= (/ home/gpadmin/gpdata/mirror / home/gpadmin/gpdata/mirror / home/gpadmin/gpdata/mirror) DATABASE_NAME=devinMACHINE _ LIST_FILE=/home/gpadmin/greenplum/seg_host
15, initialize gpdb
Gpinitsystem-c gpinitsystem_config-h seg_host
Other commonly used parameters
-s configure standby master
-S spread mirror (default grouped mirror mode)
16, check gpdb status
[gpadmin@mdw ~] $gpstate20190422:16:26:09:015110 gpstate:mdw:gpadmin- [INFO]:-Starting gpstate with args: 20190422 gpstate:mdw:gpadmin- 0915110 gpstate:mdw:gpadmin- [INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 5.17.0 build commit:fc9a9d4cad8dd4037b9bc07bf837c0b958726103'20190422:16:26:09:015110 gpstate:mdw:gpadmin- [INFO]:-master Greenplum Version:' PostgreSQL 8.3.23 (Greenplum Database 5.17.0 build commit:fc9a9d4cad8dd4037b9bc07bf837c0b958726103) on x86_64-pc-linux-gnu Compiled by GCC gcc (GCC) 6.2.0, 64-bit compiled on Feb 13 2019 15 INFO 26 INFO:-Obtaining Segment details from master...20190422:16:26:09:015110 gpstate:mdw:gpadmin- [INFO]:-Gathering data from segments. 20190422 gpstate:mdw:gpadmin- 16 26 gpstate:mdw:gpadmin- 13 015110 gpstate:mdw:gpadmin- [INFO]:-Greenplum instance status summary20190422:16:26:13:015110 gpstate:mdw:gpadmin- [INFO]:-20190422 15 gpstate:mdw:gpadmin- [INFO]:-Master instance = Active20190422:16:26:13:015110 gpstate:mdw:gpadmin- [INFO]:-Master standby = No master standby configured20190422:16:26:13:015110 gpstate:mdw:gpadmin- [INFO]:-Total segment instance count from metadata = 1820190422 INFO 1614 1313 015110 gpstate:mdw:gpadmin- [INFO ]:-20190422 gpstate:mdw:gpadmin- 16190422 INFO 1615110mm [INFO]:-Primary Segment Status20190422:16:26:13:015110 gpstate:mdw:gpadmin- [INFO]:-- -- 20190422 gpstate:mdw:gpadmin- 16 gpstate:mdw:gpadmin- 26 gpstate:mdw:gpadmin- [INFO]:-Total primary segment valid (at master) = 920190422 gpstate:mdw:gpadmin- 1326 gpstate:mdw:gpadmin- [INFO]:-Total primary segment valid (at master) = 920190422 gpstate:mdw:gpadmin- 1626 1904 22 gpstate:mdw:gpadmin- [INFO]:-1901 015110 Gpstate:mdw:gpadmin- [INFO]:-Total primary segment failures (at master) = 020190422 gpstate:mdw:gpadmin- 1614 gpstate:mdw:gpadmin- [INFO]:-Total number of postmaster.pid files missing = 020190422 22 gpstate:mdw:gpadmin- 015110 gpstate:mdw:gpadmin-:-Total number of postmaster.pid files found = 920190422 at master 015110 gpstate:mdw:gpadmin- [INFO] :-Total number of postmaster.pid PIDs missing = 020190422 gpstate:mdw:gpadmin- 16 Total number of postmaster.pid PIDs found = 020190422 gpstate:mdw:gpadmin- [INFO]:-Total number of postmaster.pid PIDs found = 920190422 gpstate:mdw:gpadmin- [INFO]:-Total number of / tmp lock files missing = 020190422 gpstate:mdw:gpadmin- [INFO]:-Total number of / tmp lock files found = 920190422 gpstate:mdw:gpadmin- 16 Total number postmaster processes missing = 920190422 gpstate:mdw:gpadmin- [INFO]:-Total number postmaster processes missing = 020190422 gpstate:mdw:gpadmin- [INFO]:-Total number postmaster processes found = 920190422 gpstate:mdw:gpadmin-:- -- 20190422 gpstate:mdw:gpadmin- 16190422 INFO:-- 20190422 INFO:-- -20190422 gpstate:mdw:gpadmin- 1626 gpstate:mdw:gpadmin- [INFO]:-Total mirror segments = 920190422 gpstate:mdw:gpadmin- 1326 gpstate:mdw:gpadmin- [INFO]:-Total mirror segment valid (at master) = 920190422 gpstate:mdw:gpadmin- 1626 INFO:-Total mirror Segment failures (at master) = 020190422 gpstate:mdw:gpadmin- 1615110 gpstate:mdw:gpadmin- [INFO]:-Total number of postmaster.pid files missing = 020190422 gpstate:mdw:gpadmin- [INFO]:-Total number of postmaster.pid files missing = 020190422 gpstate:mdw:gpadmin- [INFO]:-Total number of postmaster.pid PIDs missing = 020190422 gpstate:mdw:gpadmin- 16 gpstate:mdw:gpadmin- 26 gpstate:mdw:gpadmin- [INFO]:-Total number of postmaster.pid PIDs found = 920190422 gpstate:mdw:gpadmin- 1326 gpstate:mdw:gpadmin- [INFO]:-Total number of / tmp lock files missing = 020190422 INFO 1614: 015110 gpstate:mdw:gpadmin- [INFO]:-Total number of / tmp lock files found = 920190422 gpstate:mdw:gpadmin- 1626 gpstate:mdw:gpadmin- [INFO]:-Total number postmaster processes missing = 020190422 gpstate:mdw:gpadmin- 1326 gpstate:mdw:gpadmin- [INFO]:-Total number postmaster processes found = 920190422 gpstate:mdw:gpadmin- 1626 INFO:-Total number postmaster processes found = 920190422 gpstate:mdw:gpadmin-:-Total number mirror segments acting as primary segments = 020190422 INFO]:-Total number mirror segments acting as mirror segments = 920190422 gpstate:mdw:gpadmin- 16INFO = 920190422 INFO:-"what are the installation steps for GREENPLUM 5.17 centos 6.10?" Thank you for your reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 0
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
"Every 5-10 years, there's a rare product, a really special, very unusual product that's the most un
© 2024 shulou.com SLNews company. All rights reserved.