In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-04-01 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >
Share
Shulou(Shulou.com)06/02 Report--
A database host / var directory is very high
[biprd1] root#df-g
Filesystem GB blocks Free Used Iused Iused Mounted on
/ dev/hd4 0.50 0.26 49% 10920 15%
/ dev/hd2 7.00 3.17 55% 56403 8% / usr
/ dev/hd9var 5.00 0.31 94% 7284 8% / var
/ dev/hd3 1.50 0.88 42% 20596 9% / tmp
/ dev/hd1 0.12 0.07 42% 187 2% / home
/ dev/hd11admin 0.12 0.12% 51% / admin
/ proc-/ proc
/ dev/hd10opt 6.00 3.09 49% 22598 4% / opt
/ dev/livedump 0.25.1% 51% / var/adm/ras/livedump
/ dev/u01_fs 30.00 11.93 61% 235400 8% / U01
/ dev/tsmlog 0.25.1% 91 1% / tsmlog
/ dev/fslv00 60.00 44.19 27% 121% / bibak
/ dev/nmonlv 0.50 0.31 38% 39 1% / nmon
/ dev/backup_fs 40.00 13.00 68% 761% / backup
/ dev/u02_fs 409.00 167.11 398.1% / U02
There are mainly two top processes, cpu IDLE 7%:
Topas Monitor for host: biprd1 EVENTS/QUEUES FILE/TTY
Tue Mar 26 15:29:49 2019 Interval: 2 Cswitch 912 Readch 1750.2K
Syscall 494.2K Writech 2225.9K
CPU User% Kern% Wait% Idle% Physc Entc Reads 481 Rawin 0
ALL 45.4 47.7 0.0 6.8 0.50 99.8 Writes 80508 Ttyout 576
Forks 4 Igets 0
Network KBPS I-Pack O-Pack KB-In KB-Out Execs 4 Namei 14864
Total 2.5 20.0 5.6 1.4 1.2 Runqueue 7.2 Dirblk 0
Waitqueue 0.0
Disk Busy% KBPS TPS KB-Read KB-Writ MEMORY
Total 0.4 1024.0 8.0 0.0 1024.0 PAGING Real,MB 12544
Faults 2558 Comp 77
FileSystem KBPS TPS KB-Read KB-Writ Steals 0 Noncomp 5
Total 2.7K 8.3K 1.7K 1.0K PgspIn 0% Client 5
PgspOut 0
Name PID CPU% PgSp Owner PageIn 0 PAGING SPACE
Slp_srvr 3735686 50.0 128.6 root PageOut 256 Size,MB 8192
Syslogd 4718742 50.05.4 root Sios 256% Used 13
Topas 29294718 0.04.6 root% Free 87
Sleep 31719550 0.00.2 root NFS (calls/sec)
Sshd 36831360 0.0 4.1 root SerV2 0 WPAR Activ 0
Oracle 19136702 0.0 15.7 oracle CliV2 0 WPAR Total 0
Oracle 44433504 0.013.7 oracle SerV3 0 Press: "h"-help
Oracle 27721982 0.013.7 oracle CliV3 0 "Q"-quit
Oracle 14745714 0.0 13.9 oracle
Vmmd 458766 0.0 1.2 root
Oracle 10682470 0.0 18.3 oracle
Lrud 262152 0.0 0.5 root
Oracle 11337728 0.0 20.1 oracle
Oracle 8978578 0.0 13.9 oracle
Oracle 8192170 0.0 13.8 oracle
Syncd 2228416 0.0 0.6 root
Clcomd 8519684 0.0 4.9 root
EvMgrC 5570622 0.0 10.0 root
Nfsd 2949318 0.0 1.8 root
Ksh 7012396 0.0 0.5 root
The error message is as follows:
[biprd1] root#cat / var/hacmp/adm/cluster.log
.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Mar 26 15:19:41 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
.
The problem remains by restarting the service, and the log file grows by 100m every three minutes.
Stopsrc-s syslogd
Startsrc-s syslogd
So the kill slp_srvr process
[biprd1] root#ps-ef | grep slp
Root 2818092 1 0 Sep 24-0:52 / opt/ibm/director/cimom/bin/tier1slp
Root 3735686 1 66 Sep 24-2136 slp_srvreg-D
Root 16646316 16253072 0 16:40:51 pts/0 0:00 grep slp
[biprd1] root#kill-9 3735686
[biprd1] root#
Immediately stop generating logs, cpu is also down, and then start the slp_srvr process.
Cd / usr/sbin
. / slp_srvreg-D
[biprd1] root#df-g
Filesystem GB blocks Free Used Iused Iused Mounted on
/ dev/hd4 0.50 0.26 49% 10921 15%
/ dev/hd2 7.00 3.17 55% 56403 8% / usr
/ dev/hd9var 5.00 1.58 69% 7296 2% / var
/ dev/hd3 1.50 0.88 42% 20596 9% / tmp
/ dev/hd1 0.12 0.07 42% 187 2% / home
/ dev/hd11admin 0.12 0.12% 51% / admin
/ proc-/ proc
/ dev/hd10opt 6.00 3.09 49% 22645 4% / opt
/ dev/livedump 0.25.1% 51% / var/adm/ras/livedump
/ dev/u01_fs 30.00 11.93 61% 235774 8% / U01
/ dev/tsmlog 0.25.1% 91 1% / tsmlog
/ dev/fslv00 60.00 44.19 27% 121% / bibak
/ dev/nmonlv 0.50 0.31 38% 39 1% / nmon
/ dev/backup_fs 40.00 13.00 68% 761% / backup
/ dev/u02_fs 409.00 166.94 60% 400 1% / U02
[biprd1] root#iostat 1 4
System configuration: lcpu=8 drives=5 ent=0.50 paths=10 vdisks=6
Tty: tin tout avg-cpu:% user% sys% idle% iowait physc% entc
0.0 108.6 0.5 3.3 95.9 0.2 0.0 7.0
Disks:% tm_act Kbps tps Kb_read Kb_wrtn
Hdisk0 0.0 0.0 0.0 0 0
Hdisk5 1.0 25.5 6.4 16 0
Hdisk1 0.0 0.0 0.0 0 0
Hdisk6 0.0 0.0 0.0 0 0
Hdisk7 0.0 0.0 0.0 0 0
Tty: tin tout avg-cpu:% user% sys% idle% iowait physc% entc
0.0 865.0 18.5 8.7 72.9 0.0 0.2 36.0
Disks:% tm_act Kbps tps Kb_read Kb_wrtn
Hdisk0 0.0 0.0 0.0 0 0
Hdisk5 0.0 19.0 4.8 0 12
Hdisk1 0.0 0.0 0.0 0 0
Hdisk6 0.0 76.0 4.8 0 48
Hdisk7 0.0 0.0 0.0 0 0
Tty: tin tout avg-cpu:% user% sys% idle% iowait physc% entc
0.0 873.6 0.4 2.8 96.8 0.0 0.0 5.9
Disks:% tm_act Kbps tps Kb_read Kb_wrtn
Hdisk0 0.0 0.0 0.0 0 0
Hdisk5 0.0 0.0 0.0 0 0
Hdisk1 0.0 0.0 0.0 0 0
Hdisk6 0.0 0.0 0.0 0 0
Hdisk7 0.0 0.0 0.0 0 0
Tty: tin tout avg-cpu:% user% sys% idle% iowait physc% entc
0.0 873.6 0.4 2.9 96.8 0.0 0.0 6.0
Disks:% tm_act Kbps tps Kb_read Kb_wrtn
Hdisk0 0.0 0.0 0.0 0 0
Hdisk5 0.0 0.0 0.0 0 0
Hdisk1 0.0 0.0 0.0 0 0
Hdisk6 0.0 0.0 0.0 0 0
Hdisk7 0.0 0.0 0.0 0 0
[biprd1] root#ls-l
Total 2099800
-rw-r--r-- 1 root system 0 Nov 28 2011 clavan.log
-rw-r--r-- 1 root system 74978079 Apr 02 09:04 cluster.log
-rw-r--r-- 1 root system 100000040 Apr 01 16:39 cluster.log.0
-rw-r--r-- 1 root system 100000078 Apr 01 16:36 cluster.log.1
-rw-r--r-- 1 root system 100000002 Apr 01 16:34 cluster.log.2
-rw-r--r-- 1 root system 100000002 Apr 01 16:31 cluster.log.3
-rw-r--r-- 1 root system 100000002 Apr 01 16:28 cluster.log.4
-rw-r--r-- 1 root system 100000040 Apr 01 16:26 cluster.log.5
-rw-r--r-- 1 root system 100000116 Apr 0116: 23 cluster.log.6
-rw-r--r-- 1 root system 100000078 Apr 01 16:21 cluster.log.7
-rw-r--r-- 1 root system 100000078 Apr 01 16:18 cluster.log.8
-rw-r--r-- 1 root system 100000078 Apr 01 16:15 cluster.log.9
Drwxr-xr-x 2 root system 12288 Mar 07 2018 history
Drwxr-xr-x 2 root system 256 Sep 24 2016 wpar
It can be seen that logs are no longer mass produced.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-804399472 [804399472] Calloc call failed. Errno = 804399468.
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 16:41:10 biprd1 daemon:err | error syslog: slp: 0660-080 [804399792] SLPServiceListener-- The SA failed to compute received message: Xiao (- 21).
Apr 1 17:04:50 biprd1 daemon:err | error syslog: slp: 0660-065 [804398544] Impossible to parse attribute | ^ L ^ am.
Apr 1 17:04:50 biprd1 daemon:err | error syslog: slp: [804398928] decode_srvreg-- _ srv_reg_local failed with rc = 804398924.
Apr 1 17:04:50 biprd1 daemon:err | error syslog: slp: 0660-084 [804399280] The SA failed to decode and compute received message: matching Am (- 2).
Apr 1 18:04:50 biprd1 daemon:err | error syslog: slp: 0660-065 [804398544] Impossible to parse attribute | ^ L ^ am.
Apr 1 18:04:50 biprd1 daemon:err | error syslog: slp: [804398928] decode_srvreg-- _ srv_reg_local failed with rc = 804398924.
Apr 1 18:04:50 biprd1 daemon:err | error syslog: slp: 0660-084 [804399280] The SA failed to decode and compute received message: matching Am (- 2).
Apr 1 19:04:50 biprd1 daemon:err | error syslog: slp: 0660-065 [804398544] Impossible to parse attribute | ^ L ^ am.
Apr 1 19:04:50 biprd1 daemon:err | error syslog: slp: [804398928] decode_srvreg-- _ srv_reg_local failed with rc = 804398924.
Apr 1 19:04:50 biprd1 daemon:err | error syslog: slp: 0660-084 [804399280] The SA failed to decode and compute received message: matching Am (- 2).
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 0
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
"Every 5-10 years, there's a rare product, a really special, very unusual product that's the most un
© 2024 shulou.com SLNews company. All rights reserved.