Shulou(Shulou.com)06/01 Report--

The production warehouse of a certain province received an alarm message oracle directory of 100%, and logged in to the system to check that the part-time job was mistakenly scrubbed.

Mon Oct 23 23:25:18 EAT 2017

Thread 1 advanced to log sequence 39420 (LGWR switch)

Current log# 7 seq# 39420 mem# 0: / vgxxx03/oradata/xxx/vg03_1_rd71.log

Current log# 7 seq# 39420 mem# 1: / vgxxx04/oradata/xxx/vg04_1_rd72.log

Tue Oct 24 01:02:04 EAT 2017

Errors in file / oracle/admin/esshlj/udump/xxx1_ora_11790.trc:

ORA-07445: exception error: core dump [kadfih () + 33] [SIGSEGV] [Address not mapped to object] [0x91A1A1A2A000F] [] []

Tue Oct 24 01:02:06 EAT 2017

Trace dumping is performing id= [cdmp _ 20171024010206]

Tue Oct 24 01:02:41 EAT 2017

Errors in file / oracle/admin/1_pmon_27125.trc:

ORA-07445: exception encountered: core dump [kadfih () + 33] [SIGSEGV] [Address not mapped to object] [0x91A1A1A2A000F] [] []

Tue Oct 24 01:02:43 EAT 2017

Errors in file / oracle/admin/1_pmon_27125.trc:

ORA-00001: unique constraint (108.) Violated

ORA-00001: unique constraint (108.) Violated

ORA-00001: unique constraint (.) Violated

ORA-00602: internal programming exception

ORA-00602: internal programming exception

ORA-00602: internal programming exception

ORA-07445: exception encountered: core dump [kadfih () + 33] [SIGSEGV] [Address not mapped to object] [0x91A1A1A2A000F] [] []

Tue Oct 24 01:07:10 EAT 2017

Errors in file / oracle/admin/1_ora_16532.trc:

ORA-00600: internal error code. Parameters: [kghfrmrg:prv], [0xC00000073B406C28], [], []

Tue Oct 24 01:08:15 EAT 2017

Errors in file / oracle/admin/1_ora_16532.trc:

ORA-00600: internal error code. Parameters: [KGHFRE3], [0xC0000007433BACB0], [], []

Tue Oct 24 01:10:13 EAT 2017

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Error 22813 occured while spilling buffered messages

Tue Oct 24 01:10:18 EAT 2017

Errors in file / oracle/admin/1_q003_26244.trc:

ORA-00600: internal error code, arguments: [kpotcprc: uga depth exceeded], [16], [], []

Error 600 occured while spilling buffered messages

Tue Oct 24 01:10:20 EAT 2017

Errors in file / oracle/admin/1_q003_26244.trc:

ORA-00600: internal error code, arguments: [kpotcprc: uga depth exceeded], [16], [], []

Error 600 occured while spilling buffered messages

Tue Oct 24 01:10:23 EAT 2017

Errors in file / oracle/admin/1_q003_26244.trc:

ORA-00600: internal error code, arguments: [kpotcprc: uga depth exceeded], [16], [], []

. .

Tue Oct 24 15:00:26 EAT 2017

Errors in file / oracle/admin/1_q007_20218.trc:

ORA-00600: internal error code, arguments: [kgqbt_search_block198], []

Tue Oct 24 15:00:26 EAT 2017

Errors in file / oracle/admin/1_q005_20204.trc:

ORA-00600: internal error code, arguments: [kgqbt_search_block198], []

Tue Oct 24 15:00:27 EAT 2017

Errors in file / oracle/admin/1_q000_19435.trc:

ORA-07445: exception encountered: core dump [kocgpn2 () + 224] [SIGSEGV] [Address not mapped to object] [0x600000002] []

Tue Oct 24 15:00:28 EAT 2017

Errors in file / oracle/admin/1_q004_20225.trc:

ORA-00600: internal error code, arguments: [kgqbt_search_block198], []

Tue Oct 24 15:00:28 EAT 2017

Errors in file / oracle/admin/1_q007_20218.trc:

ORA-00600: internal error code, arguments: [kgqbt_search_block198], []

Tue Oct 24 15:00:29 EAT 2017

Errors in file / oracle/admin/1_q005_20234.trc:

ORA-00600: internal error code, arguments: [kgqbt_search_block198], []

Tue Oct 24 15:00:29 EAT 2017

Errors in file / oracle/admin/1_q004_20225.trc:

ORA-00600: internal error code, arguments: [kgqbt_search_block198], []

Tue Oct 24 15:00:30 EAT 2017

Errors in file / oracle/admin/1_q003_19467.trc:

ORA-07445: exception encountered: core dump [kocgpn2 () + 224] [SIGSEGV] [Address not mapped to object] [0x600000002] []

The initial verdict should have been caused by stream. Node 2 also generates cdmp files related to stream.

Tue Oct 24 04:56:50 EAT 2017

Trace dumping is performing id= [cdmp _ 20171024015310]

Streams process APPLY_xxx altered (1) on instance 1

Tue Oct 24 05:11:34 EAT 2017

Trace dumping is performing id= [cdmp _ 20171024015317]

Streams process APPLY_xxx altered (1) on instance 1

Streams process APPLY_xxx altered (1) on instance 1

Tue Oct 24 05:26:18 EAT 2017

Trace dumping is performing id= [cdmp _ 20171024015321]

Immediately called the factory personnel, let them see if the stream is normal, the reaction state is abnormal. Kill its processes p000, p001, stop the apply process immediately or report an error!

SQL > show user

USER is "STRMADMIN"

SQL > execute dbms_apply_adm.stop_apply (apply_name = > 'apply_esshlj')

PL/SQL procedure successfully completed.

SQL > select apply_name,queue_name,status from dba_apply

APPLY_NAME QUEUE_NAME STATUS

-

APPLY_ESSHLJ ESSHLJ_QUEUE DISABLED # # now the status is DISABLE### and the status is ENABLE after startup.

Then clean up the cache, which should be executed under strmadmin

Declare

Options dbms_aqadm.aq$_purge_options_t

Begin

Options.delivery_mode: = dbms_aqadm.buffered

Dbms_aqadm.purge_queue_table ('ESSHLJ_QUEUE_TABLE', null, options)

End

/

Wrong report

ERROR at line 1:

ORA-03113: end-of-file on communication channel

1-node alert trc file has been generated, a second can generate about 5 files, a 2m. The oracle directory is only 20g. Write a script to delete the trc file automatically.

1, tried flush buffer_cache

2, tried flush share_pool

Because the error is only Node 1, then I plan to switch stream to Node 2 to see if the error remains the same. Execute the following command on the central library of the target side

Exec DBMS_AQADM.ALTER_QUEUE_TABLE@esshlj (queue_table = > 'ESSHLJ_QUEUE_TABLE', primary_instance = > 2, secondary_instance = > 1)

Observe that the p000 and p001 processes are gone at Node 1. The 2-node stream status is normal, and the ORA-600 error is missing, but the ORA-7445 error is still the same. Because there is always a small worker process Q00 in the error report, temporarily modify the aq_tm_processes parameter to 0 to see if there are any errors.

SQL >! ps-ef | grep Q00

Oracle 8955 8883 1 15:22:05 pts/5 0:00 / sbin/sh-c ps-ef | grep Q00

Oracle 8957 8955 0 15:22:05 pts/5 0:00 grep q00

Oracle 27097 1 0 14:37:32? 0:00 ora_q006_esshlj1

Oracle 8820 1 51 15:21:52? 0:00 ora_q003_esshlj1

Oracle 8018 1 0 15:21:41? 0:00 ora_q008_esshlj1

Oracle 6752 1 0 15:21:12? 0:00 ora_q007_esshlj1

Oracle 7641 1 0 15:21:27? 0:00 ora_q004_esshlj1

Oracle 8863 1 1 15:21:58? 0:00 ora_q000_esshlj1

Oracle 8839 1 0 15:21:55? 0:00 ora_q009_esshlj1

Oracle 8931 1 4 15:22:01? 0:00 ora_q001_esshlj1

Oracle 8954 1 6 15:22:04? 0:00 ora_q002_esshlj1

SQL > alter system set aq_tm_processes = 0; # modify the parameter to declare

System altered.

SQL >! ps-ef | grep Q00

Oracle 11224 8883 0 15:23:08 pts/5 0:00 / sbin/sh-c ps-ef | grep Q00

Oracle 11226 11224 0 15:23:08 pts/5 0:00 grep q00

There is no progress in small labor, but the error report is still a headache. Let's change it back.

SQL > alter system set aq_tm_processes = 1

System altered.

SQL >! ps-ef | grep Q00

Oracle 12198 8883 0 15:23:35 pts/5 0:00 / sbin/sh-c ps-ef | grep Q00

Oracle 12203 12198 0 15:23:35 pts/5 0:00 grep q00

Oracle 12135 1 20 15:23:35? 0:00 ora_q000_esshlj1

Oracle 12199 1 3 15:23:35? 0:00 ora_q002_esshlj1

Oracle 12167 1 7 15:23:35? 0:00 ora_q001_esshlj1

Some colleagues boldly wondered whether it was possible to set the aq_tm_processes parameter of node 1 to 0, the aq_tm_processes parameter of node 2 to 1, and specify SID since it was not running on node 1.

SQL > alter system set aq_tm_processes = 0 sid='esshlj1'

System altered.

Then observe that the 1 node does not produce an annoying 7445 alarm.

Tue Oct 24 15:36:08 EAT 2017

ALTER SYSTEM SET aq_tm_processes=0 SCOPE=BOTH SID='esshlj1'

Tue Oct 24 15:45:58 EAT 2017

Trace dumping is performing id= [cdmp _ 20171024152311]

Tue Oct 24 16:43:44 EAT 2017

Thread 1 advanced to log sequence 39430 (LGWR switch)

Current log# 1 seq# 39430 mem# 0: / vghlj/oradata/redo01.log

Current log# 1 seq# 39430 mem# 1: / vghlj/oradata/1_rd11.log

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.