123+987+137 7656 6262+98=?
点击联系发帖人
时间：2011-09-26 13:42
两台P6-570 服务器 HACMP RAC oracle 双机 节点一上的卷组 非激活状态 。收集了错误日志 ，不知道问题出在哪里。朋友们帮忙分析下 。---------------------------------------------------------------------------LABEL:&&OPMSGIDENTIFIER: AA8AB241Date/Time:...两台P6-570 服务器 HACMP RAC oracle 双机 节点一上的卷组 非激活状态 。收集了错误日志 ，不知道问题出在哪里。朋友们帮忙分析下 。---------------------------------------------------------------------------LABEL:&&OPMSGIDENTIFIER: AA8AB241Date/Time:& && & Thu Jun 17 11:02:06 2010Sequence Number: 1165Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &prognameDescriptionOPERATOR NOTIFICATIONUser CausesERRLOGGER COMMANDRecommended ActionsREVIEW DETAILED DATADetail DataMESSAGE FROM ERRLOGGER COMMANDSrcCntrld: daemon not started via SRC +++---------------------------------------------------------------------------LABEL:&&OPMSGIDENTIFIER: AA8AB241Date/Time:& && & Thu Jun 17 10:48:35 2010Sequence Number: 1164Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &prognameDescriptionOPERATOR NOTIFICATIONUser CausesERRLOGGER COMMANDRecommended ActionsREVIEW DETAILED DATADetail DataMESSAGE FROM ERRLOGGER COMMANDSrcCntrld: daemon not started via SRC +++---------------------------------------------------------------------------LABEL:&&TS_LOC_DOWN_STIDENTIFIER: 173C787FDate/Time:& && & Thu Jun 17 10:31:47 2010Sequence Number: 1163Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &topsvcsDescriptionPossible malfunction on local adapterProbable CausesLocal adapter mal-functionedLocal adapter lost connection to networkLocal adapter mis-configuredFailure CausesLocal adapter mal-functionedLocal adapter lost connection to networkLocal adapter mis-configuredRecommended ActionsVerify adapter configurationVerify network connectivityDetail DataDETECTING MODULErsct,threephs.C,1.206,5242& && && && && && &&&ERROR ID 6zV5DL.XzX4A/7fP1/2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &Adapter interface nameen8Adapter offset& && && &&&1Adapter IP address192.168.1.1---------------------------------------------------------------------------LABEL:&&GS_START_STIDENTIFIER: AFA89905Date/Time:& && & Thu Jun 17 10:25:17 2010Sequence Number: 1162Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &grpsvcsDescriptionGroup Services daemon startedProbable CausesDaemon started during system startupDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsCheck that Group Services daemon is runningDetail DataDETECTING MODULERSCT,pgsd.C,1.62.1.8,606& && && && && && && & ERROR ID 63Y7ej0RtX4A/bSl0/2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &DIAGNOSTIC EXPLANATIONHAGS daemon started by SRC. Log file is /var/ha/log/grpsvcs_trace_1_46.---------------------------------------------------------------------------LABEL:&&TS_START_STIDENTIFIER: 97419D60Date/Time:& && & Thu Jun 17 10:25:13 2010Sequence Number: 1161Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &topsvcsDescriptionTopology Services daemon startedProbable CausesDaemon started during system start-upDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsConfirm that this is desirableDetail DataDETECTING MODULErsct,bootstrp.C,1.213,4440& && && && && && &&&ERROR ID 6UpNEL0NtX4A/8fP1/2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &Topology Services daemon started by:SRCTopology Services daemon log file location/var/ha/log/topsvcs.17.102513.ibm_cls.en_USTopology Services daemon run directory/var/ha/run/topsvcs.ibm_cls/---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Thu Jun 17 09:27:58 2010Sequence Number: 1160Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && &&&74104DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&OPMSGIDENTIFIER: AA8AB241Date/Time:& && & Thu Jun 17 09:25:52 2010Sequence Number: 1159Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &prognameDescriptionOPERATOR NOTIFICATIONUser CausesERRLOGGER COMMANDRecommended ActionsREVIEW DETAILED DATADetail DataMESSAGE FROM ERRLOGGER COMMANDSrcCntrld: daemon not started via SRC +++---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1158Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 188626DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1157Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && &&&78210DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1156Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 188624DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateSun Jun 13 13:53:22 2010Time of last duplicateSun Jun 13 13:53:22 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1155Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 188624DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1154Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 188624DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1153Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 164286DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1152Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 135596DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateSun Jun 13 13:53:22 2010Time of last duplicateSun Jun 13 13:53:22 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1151Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 135596DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Sun Jun 13 13:53:22 2010Sequence Number: 1150Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 135596DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&RMCD_INFO_0_STIDENTIFIER: A6DF45AADate/Time:& && & Sun Jun 13 13:53:21 2010Sequence Number: 1149Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &RMCdaemonDescriptionThe daemon is started.Probable CausesThe Resource Monitoring and Control daemon has been started.User CausesThe startsrc -s ctrmc command has been executed orthe rmcctrl -s command has been executed.Recommended ActionsConfirm that the daemon should be started.Detail DataDETECTING MODULERSCT,rmcd.c,1.56,213& && && && && && && && &&&ERROR ID 6eKora0VYG3A/6et//2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &---------------------------------------------------------------------------LABEL:&&TUNE_RESTRICTEDIDENTIFIER: D221BD55Date/Time:& && & Sun Jun 13 13:53:09 2010Sequence Number: 1148Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &perftuneDescriptionRESTRICTED TUNABLES MODIFIED AT REBOOTProbable CausesSYSTEM TUNINGUser CausesTUNABLE PARAMETER OF TYPE RESTRICTED HAS BEEN MODIFIEDRecommended ActionsREVIEW TUNABLE LISTS IN DETAILED DATADetail DataLIST OF TUNABLE COMMANDS CONTROLLING MODIFIED RESTRICTED TUNABLES AT REBOOT, SEE FILE /etc/tunables/lastboot.logvmo, no---------------------------------------------------------------------------LABEL:&&DUMP_STATSIDENTIFIER: 67145A39Date/Time:& && & Sun Jun 13 13:52:37 2010Sequence Number: 1146Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &SYSDUMPDescriptionSYSTEM DUMPProbable CausesUNEXPECTED SYSTEM HALTUser CausesSYSTEM DUMP REQUESTED BY USERRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESFailure CausesUNEXPECTED SYSTEM HALTRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataDUMP DEVICE/dev/lg_dumplvDUMP SIZE& && && && & TIMESun Jun 13 13:43:19 2010DUMP TYPE (1 = PRIMARY, 2 = SECONDARY)& && && &&&1DUMP STATUS& && && &&&0ERROR CODE& && && &&&0DUMP INTEGRITYCompressed dump - Run dmpfmt with -c flag on dump after uncompressing. FILE NAMEPROCESSOR ID& && && &&&4---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Sun Jun 13 13:51:02 2010Sequence Number: 1145Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 51 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&MINIDUMP_LOGIDENTIFIER: F48137ACDate/Time:& && & Sun Jun 13 13:51:02 2010Sequence Number: 1144Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &minidumpDescriptionCOMPRESSED MINIMAL DUMPProbable CausesSystem dumped. Minimal Dump collected in Non-Volatile Memory.Recommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataMinidump Data:4D32 0D6C 24EC 37 00E4 01DB 45 2E00 E4 67C8 00
50 190A 318C C4E7 BB80 00 6563 DDBA 80 054C 2A98
C387 0E09 0090 44 5AC0 C0A1 CA D879 C1E6 CC17 3275 DAC0 45 A4C0 6D 4C2A
A5F8 4DC9 3205 8A94
12 EE 059A 376D CABC 7823 27CC
C879 43A6 CE18 3A2F 62C0 C17 63E4 CC79 C1E6 CD99 176E CE 1C32
C9B5 ABD7 AF60 C38A 1D4B B66C D937 63AC D1B B322 EDB4 C3C 206C E43 1020 D0DC F962 464E 9D2F 69C8 E800 E1E4 4510 03 E770 E2C5 8D1F D9C 03
3F7E 28D0 C7AD A0C8 C42 10E2 08B4 6AD9 BA9D B802 22C9 2D 7ACD C414 00 E0 9067 AC02 2C18 F2A4 10 10 F00A BEA0 B706 0C45 01C2 B400 A208 27 16FC C7D2 1FC9
0C60 94 10C9 23 F80 89 CA 82F6 94A7 F AD7C BDBB 9A75 6B41 D88 552B 57B3 AC0 A 25 4CA6 28D9 CB 7F2E D3A2 92 4329 428B 50AB 2E41
A208 84E2 0601 76DA 7C61 F3E6 CD9A 3A70 BE90 91B3 4206 0D94 A0
C9A8 C44B 5041 AC56 007A C88B 5307 5DAA 6F41 3150 0A 246D E3D6 CD1B DDAA 87 A232 CA44 C96F E7DE DD9B 9592 E83B E09C 7016 13BB DDEC CBB9 A363 352D E91 6C32 871D FAED CD59 F18B 3E1D 450F DA24 C571 1F73 BDB5 F281 7BF0 A0 51C3 02 13E9 C6C6 01F9 5CC1 8B7B 5D80 02C0
D16C B0 6DE4
2495 41D6 40F3
C054 04 D3F C5C4 53 5147 40 E084 270F 12
2CF3 92 088D A0E4 5A95 52 CB9 058D 2430 CCF4 20
625D 14 0D11 0D22 7F15 CA4F 1B 65D0 B C420 449C 2425 C10B 0488 2ACA A8A3 911A
00C3 CD1C 68B4
0E 711A 494F 3042 CA1A 8FA6 41
0307 AD78 D8BA 020E 9F92 C4C0 35EC A431 C71C 699C B142 0D32 144B
C0EC 199A A661
1940 0536 85FE B50F 6BAE C156 81 02C2 BE0
BB6E 99EF 0623 2FBD F6A6 A3C1 0FFB F6FB 6FC0 050D 5CB0 9828 BD4B 1C45 F3D6 4B60 3A1B FC11 B1BF 2801 AC65 C504 1B4C 03 070D 2CEC
F0CA C831 093A 19C7 0C13 B80E 241A DC4
B891 E 34C4
175F 04B5 09C5 9BBB
6D 4569 57C0 4FFF F886 BA00 982C 40
C156 1704 7A13 8440 DF00
AF11 F955 DD41 3E2D 276A
D601 1004 022E 92C0 6C50 0F21 921B F5 F4E4 0140 CE54 023F FE84 B9E6 9C4F 5EF9 E59E 2B59 E594 008C 6E54 E69B 778E 00E5
E84C A949 5BEA B43D FDC0 5F81 E145 FCEA B9CF EE3C 958A D3D6 240A 4C 12F0 0A13 1C30 E9A4 25D6 A384 BD95 4ED2
F78A 1FB9 48D2 061A D 42E2 A8E3
F1D6 F22 D 88C1 A64
0A 9BC0 E616 49 0B05 EB64 A33B C16F 4F7E F393 CA74 562E 961C AA0D
1AF5 A848 4D0A 5497 CA94 0E37
AB20 A11A 55A9 4E95 AA55 B5EA
AC6A 75AB 67E9 0A25 BDFA 82 1C2B 59CB 6AD6 B3A2 15AE 6A5D 2B5B DBEA D6B7 C235 AE1A FEE3 5CAD 291C 81D0 5F 24BB 5FFE 8C24 002A 30E3 CE 602F 74C8 E340
C644 91 A388 C3C A120 E933 7E A041
FEF4 4712 FE25 B CA00 A0E6 0C16 848E 209C FC18 D4 A54C 3A0B E420 1B46 076F 088D A8A F10A 76FC 8269 1FAA 1DD4 C434 B5BE E8AE A1 60B5 694A F384 719B B4 4DB0
368D 1400 0A66 1325 DF54
8C3F C604 707C 331C D800
CC97 C404 822F 215D D8
9D02 1988 17DB EDAE 743B 43CD F26E A7B9
B15B E0F3 9489 50DD 51CE A00A C580
018A 6E00 C76B 0980 266A 00DC 5E 3F9B B30 129C 841B 485A 04 A092 BF40 A5 EC0 3E12 A986 F 8B40
8010 FB6B 615E 3EA4 A30A E403 35 D9C1
38AD 37 28A8 2084 B960 20F3 11AE 0EC6 E401 740D 614C 01 123C
8F45 75F1 D29F 4842 C31A DE30 873B 4A
38D4 140F 8D08 2A51 91CA 54A8 5215 AB62 E02A
D281 8B1B 4496 B2AE 35C6 2E1A C58C CD42 23B7 4AB3 C35 8463 BAC2 D54F 40 4C1C AED1 301E 1CF3 8E12 4309 04DC 2AB0
C7D5 2A41 20B0 DC86 F900 62D0 CDA3 50A8 8BB2 8BF9 B64C C78D 8172 99FB B11F
252F 412C E6C0 9A90 E4B8 A1E4 2E7B 6916 043C C097 B183 5AAF BDD8 F103 6AFC A2C
6EB7 43C9 8C1E 49A4 06B6 BD38 D36A 7E05 2C45 328C E1BF 61 5AA8 4B37 7D9E ADAD 6F15 2B8A ---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Sun Jun 13 13:51:02 2010Sequence Number: 1143Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 344100FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&ERRLOG_ONIDENTIFIER: 9DBCFDEEDate/Time:& && & Sun Jun 13 13:53:06 2010Sequence Number: 1142Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &errdemonDescriptionERROR LOGGING TURNED ONProbable CausesERRDEMON STARTED AUTOMATICALLYUser Causes/USR/LIB/ERRDEMON COMMANDRecommended ActionsNONE---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Sun Jun 13 13:43:19 2010Sequence Number: 1141Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 344100FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&GS_START_STIDENTIFIER: AFA89905Date/Time:& && & Sun Jun 13 13:10:37 2010Sequence Number: 1140Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &grpsvcsDescriptionGroup Services daemon startedProbable CausesDaemon started during system startupDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsCheck that Group Services daemon is runningDetail DataDETECTING MODULERSCT,pgsd.C,1.62.1.8,606& && && && && && && & ERROR ID 63Y7ej0RwF3A/YGg./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &DIAGNOSTIC EXPLANATIONHAGS daemon started by SRC. Log file is /var/ha/log/grpsvcs_trace_1_45.---------------------------------------------------------------------------LABEL:&&TS_START_STIDENTIFIER: 97419D60Date/Time:& && & Sun Jun 13 13:10:32 2010Sequence Number: 1139Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &topsvcsDescriptionTopology Services daemon startedProbable CausesDaemon started during system start-upDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsConfirm that this is desirableDetail DataDETECTING MODULErsct,bootstrp.C,1.213,4440& && && && && && &&&ERROR ID 6UpNEL0MwF3A/zL3./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &Topology Services daemon started by:SRCTopology Services daemon log file location/var/ha/log/topsvcs.13.131031.ibm_cls.en_USTopology Services daemon run directory/var/ha/run/topsvcs.ibm_cls/---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1138Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172488DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1137Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 192736DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1136Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172486DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateFri Jun&&4 17:39:08 2010Time of last duplicateFri Jun&&4 17:39:08 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1135Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172486DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1134Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172486DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1133Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 176312DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1132Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 131246DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateFri Jun&&4 17:39:08 2010Time of last duplicateFri Jun&&4 17:39:08 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1131Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 131246DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1130Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 131246DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&RMCD_INFO_0_STIDENTIFIER: A6DF45AADate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1129Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &RMCdaemonDescriptionThe daemon is started.Probable CausesThe Resource Monitoring and Control daemon has been started.User CausesThe startsrc -s ctrmc command has been executed orthe rmcctrl -s command has been executed.Recommended ActionsConfirm that the daemon should be started.Detail DataDETECTING MODULERSCT,rmcd.c,1.56,213& && && && && && && && &&&ERROR ID 6eKora0A0M0A/o4Q//2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &---------------------------------------------------------------------------LABEL:&&TUNE_RESTRICTEDIDENTIFIER: D221BD55Date/Time:& && & Fri Jun&&4 17:38:56 2010Sequence Number: 1128Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &perftuneDescriptionRESTRICTED TUNABLES MODIFIED AT REBOOTProbable CausesSYSTEM TUNINGUser CausesTUNABLE PARAMETER OF TYPE RESTRICTED HAS BEEN MODIFIEDRecommended ActionsREVIEW TUNABLE LISTS IN DETAILED DATADetail DataLIST OF TUNABLE COMMANDS CONTROLLING MODIFIED RESTRICTED TUNABLES AT REBOOT, SEE FILE /etc/tunables/lastboot.logvmo, no---------------------------------------------------------------------------LABEL:&&DUMP_STATSIDENTIFIER: 67145A39Date/Time:& && & Fri Jun&&4 17:38:24 2010Sequence Number: 1126Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &SYSDUMPDescriptionSYSTEM DUMPProbable CausesUNEXPECTED SYSTEM HALTUser CausesSYSTEM DUMP REQUESTED BY USERRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESFailure CausesUNEXPECTED SYSTEM HALTRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataDUMP DEVICE/dev/lg_dumplvDUMP SIZE& && && && & TIMEFri Jun&&4 17:27:20 2010DUMP TYPE (1 = PRIMARY, 2 = SECONDARY)& && && &&&1DUMP STATUS& && && &&&0ERROR CODE& && && &&&0DUMP INTEGRITYCompressed dump - Run dmpfmt with -c flag on dump after uncompressing. FILE NAMEPROCESSOR ID& && && &&&0---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Jun&&4 17:36:49 2010Sequence Number: 1125Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 36 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&MINIDUMP_LOGIDENTIFIER: F48137ACDate/Time:& && & Fri Jun&&4 17:36:49 2010Sequence Number: 1124Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &minidumpDescriptionCOMPRESSED MINIMAL DUMPProbable CausesSystem dumped. Minimal Dump collected in Non-Volatile Memory.Recommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataMinidump Data:4D32 0B9B 1E2B 37 00E4 01DB E0 00 8BB7 0217 00
7FD1 2B40 E18F
48 190A 318C C5C7 3DC0 00 6563 DDBA 80 054C 12F4
C387 0E09 384C 00C0 010C 222D 60E0 C808 03C0 0B32 65EC BC60 73E6 0B99 3A6D E0B0 B103
C090 D4C 12F4
9D86 71 622A 12A5 F84D C932 058A 34 F10
EE05 9A37 6DCA BC78 2327 CC18
7943 A6CE 183A 2F62 C070 21C3 058C 1763 E4CC 79C1 E6CD
CE1C C9 B5AB D7AF 60C3 8A1D 4BB6 6CD9 3763 AC92 BB3 22ED B481 33E6 0D9C 3C20 6C08 19A2 006E
DCF9 D 2F69 C8E8 00E1 E445 1005
03E7 70E2 C58D 1F97 C32 61C8 7C59 3F 7E28 D0C7 ADA0 C802 10 E208 B46A D9BA 9DB8 38 7B06 2D7A CDC4 1410 24
E090 67AC 022C 18F2 A409 28 F0 0ABE A0B7 060C
00A2 04 2716 FCC7 D21F C981 20 10 C948 70A3 1D00 0F 40CD
25 417B CA53 018B A2B7 56BE DE59 C5AA B520 BC23 30C8 6CCD 3AB6 6BC1
C25C 8A52 2D80 042A 50B2 FCE7 92E2 DC82 A72 A81 A028 81 50DC 20C0 4E9B 2F6C DEBC 5953 07CE
00C0 09 2E00 730D 000F 479A C28 060A C062 36D1 4481 E4EC DAB7 730B 4AA3 2E28 46 99C8 386D DBB8 75AB B1E5 7C07 9C13 CE62
C071 ECCA D77C 090A C1FB B CC61 671D 39 878E A247 6C92 71D4 879E 6E6B BCC2 9E7B D108 985C
90C0 44B7 55B2 012C 2F1C C15E 17A0 44 041B 20 AD6D E4C6 41 1B84 40C1 8B00 A30 52 C01E 1869 44CF 4F31 B148 9291 FFD1 00 0D1F 283D 20C4 7449 DE55 2541 E50D B088 181F D6 83E3 98 6A B1E5 CD19 489E F5D2
1F11 B60 BAD2 C8 5E84 F263 D91C 9F95 C146
C70A A49 F002 C1A1 892E DA28 A446 0C41 2930 DCCC
C851 4619 77CC 01E9 10A4 91F4 0423 A4AC E168 1A74 3C5A 01 3D70 C88A 07AD 2BE0 E029 490C 5CC3 4E1A 73CC 91C6 192B D420 C3B0 BCA 9E91 691A C39 E080 E8 5EFB A4B6 5A6B 36
F0D4 30E0 2023 BC11 C C 16B4 4800 02AC 9B6E 79ED C602 AFBC C941
DC9B 6F4C FC52 F46F C063 92D4 6E55 42C5 3B6F 09C7 38AC 2F49 11FB 0BB0 C004 30 53CC C1F3 9EF0 80C7
C608 B F938 A7EF 8D3C F E290 CB0 D844 430C
E145 509B 50BC 19A7 D450 4B4D 12D5 00AC F5D0 4C5B A F4BC 812E
C3CC 52AD B108 41DD 18 A468 286B 6F A9 7500 41FC 00A0 C E0B8 51C0 C820
F964 6C49 2BCE F852 090C 9E79 E597 4F8E C001 904B CE24 004E
9D53 6E39 E68F 479E 39EB 9BCF DC9 F900 0FEC D517 5DA2
BBBF EEB5 D2C9 A3B4
E24F AE51 8E1B CDC7 019C 74C9
918B 1F 7F34 EE5E 03
24AD 0E41 7180 08 5D B80E 7F08 4CA0 02E9 42A8 FF64 6F15 92C0 46FA 8CE1 12
30 12C0 17E0 F006 36B0 08 C0 5CBC 7B1A E5FC 07C0
B0F8 C680 76F3 0BA2 C5E9 3F0B 08E2 10D5 2092 BC41 404F
E801 0AC4 B A448 40 A217 EC81 40FB 80 0ABC C81A 00E6 57BF FB21 C
F8A1 16E1 789F 4B1C A220
E9B2 C521 6EE2 654E A4DE 6D28 09 1BEA D044 06F0 BD11 DB 8ACE D744 A 1DBC 514C 76D4 AA2 2B92 2A15 B824 A300 E004
A404 C5D8 5831 4D24 A140 24D0
2345 EC88 CB6F 09D3 814B
659D C 11E1 457C
22B3 F7FD C350 6D40
A6C6 A9A9 A
A14A A5E 15AB 59D5 AA59 B842 C9AE 7AE5 CF60 C193 20C5 3A56 B296 D5AC 677D 6B5A D5BA 56B6 B6D5 AD6F 85CB 9BE5 524D 0E0B
C94B 004C 8C64 E1A
B94B 898D 0C25 C42C C847 B776 C59B 268C
4E29 C252 9F52 8C24 C124 090D D071 CC80 18D5
CAA6 254D 5821 ECE0 0A9D C6 2FF2 E10C 1810 CD68 1E5A DED2 9A96 17D3 31D3 A0 A6D7 BC3A 936D 33E9 E9D7 E B634 7086 4DD3 2E01 BB52 C132 EF4A 7BBB 1B62 B3B6 B7BE 69E4 6F7B CBA1 4F0C F258 BF1C 2E71 595B 5C00 8253 BB12 8CCE C7F C9CD
A02B 9EEC 0491 DAD2 AA36 96BB 839D 6B67 5BDB D042 CEB4 AB5B AD5C 7697 CAA5 140E B242 FA89 F150 BB40 BAE8 B6B9 CF03 C01B 7E31 84 1A06 F5B2 0780 EDD1
0826 AFA9 4924 81A4 50 11CA 68 402E E051 5CB3 A164 90BB 6BA5
4CE0 E99 CA43
4B28 F 32E0 984C 60C1 694B 26D4 A081 05EB 32D8 2FA6 9A66 924C 744D 8A64 739B
C129 4E72 36EA
412A ---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Fri Jun&&4 17:36:49 2010Sequence Number: 1123Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 205054FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&ERRLOG_ONIDENTIFIER: 9DBCFDEEDate/Time:& && & Fri Jun&&4 17:38:53 2010Sequence Number: 1122Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &errdemonDescriptionERROR LOGGING TURNED ONProbable CausesERRDEMON STARTED AUTOMATICALLYUser Causes/USR/LIB/ERRDEMON COMMANDRecommended ActionsNONE---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Fri Jun&&4 17:27:19 2010Sequence Number: 1121Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 205054FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&GS_START_STIDENTIFIER: AFA89905Date/Time:& && & Fri Jun&&4 16:54:59 2010Sequence Number: 1120Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &grpsvcsDescriptionGroup Services daemon startedProbable CausesDaemon started during system startupDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsCheck that Group Services daemon is runningDetail DataDETECTING MODULERSCT,pgsd.C,1.62.1.8,606& && && && && && && & ERROR ID 63Y7ej0nML0A/cSz./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &DIAGNOSTIC EXPLANATIONHAGS daemon started by SRC. Log file is /var/ha/log/grpsvcs_trace_1_44.---------------------------------------------------------------------------LABEL:&&TS_START_STIDENTIFIER: 97419D60Date/Time:& && & Fri Jun&&4 16:54:55 2010Sequence Number: 1119Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &topsvcsDescriptionTopology Services daemon startedProbable CausesDaemon started during system start-upDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsConfirm that this is desirableDetail DataDETECTING MODULErsct,bootstrp.C,1.213,4440& && && && && && &&&ERROR ID 6UpNEL0jML0A/TNn./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &Topology Services daemon started by:SRCTopology Services daemon log file location/var/ha/log/topsvcs.04.165454.ibm_cls.en_USTopology Services daemon run directory/var/ha/run/topsvcs.ibm_cls/---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1118Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 147882DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1117Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 151736DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1116Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172214DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateFri Jun&&4 11:08:41 2010Time of last duplicateFri Jun&&4 11:08:41 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1115Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172214DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1114Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172214DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1113Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 151732DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1112Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172210DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateFri Jun&&4 11:08:41 2010Time of last duplicateFri Jun&&4 11:08:41 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1111Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172210DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1110Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172210DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&RMCD_INFO_0_STIDENTIFIER: A6DF45AADate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1109Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &RMCdaemonDescriptionThe daemon is started.Probable CausesThe Resource Monitoring and Control daemon has been started.User CausesThe startsrc -s ctrmc command has been executed orthe rmcctrl -s command has been executed.Recommended ActionsConfirm that the daemon should be started.Detail DataDETECTING MODULERSCT,rmcd.c,1.56,213& && && && && && && && &&&ERROR ID 6eKora07IG0A/THl./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &---------------------------------------------------------------------------LABEL:&&TUNE_RESTRICTEDIDENTIFIER: D221BD55Date/Time:& && & Fri Jun&&4 11:08:28 2010Sequence Number: 1108Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &perftuneDescriptionRESTRICTED TUNABLES MODIFIED AT REBOOTProbable CausesSYSTEM TUNINGUser CausesTUNABLE PARAMETER OF TYPE RESTRICTED HAS BEEN MODIFIEDRecommended ActionsREVIEW TUNABLE LISTS IN DETAILED DATADetail DataLIST OF TUNABLE COMMANDS CONTROLLING MODIFIED RESTRICTED TUNABLES AT REBOOT, SEE FILE /etc/tunables/lastboot.logvmo, no---------------------------------------------------------------------------LABEL:&&DUMP_STATSIDENTIFIER: 67145A39Date/Time:& && & Fri Jun&&4 11:07:57 2010Sequence Number: 1106Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &SYSDUMPDescriptionSYSTEM DUMPProbable CausesUNEXPECTED SYSTEM HALTUser CausesSYSTEM DUMP REQUESTED BY USERRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESFailure CausesUNEXPECTED SYSTEM HALTRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataDUMP DEVICE/dev/lg_dumplvDUMP SIZE& && && && & TIMEFri Jun&&4 10:56:20 2010DUMP TYPE (1 = PRIMARY, 2 = SECONDARY)& && && &&&1DUMP STATUS& && && &&&0ERROR CODE& && && &&&0DUMP INTEGRITYCompressed dump - Run dmpfmt with -c flag on dump after uncompressing. FILE NAMEPROCESSOR ID& && && &&&2---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Jun&&4 11:06:22 2010Sequence Number: 1105Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 06 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&MINIDUMP_LOGIDENTIFIER: F48137ACDate/Time:& && & Fri Jun&&4 11:06:22 2010Sequence Number: 1104Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &minidumpDescriptionCOMPRESSED MINIMAL DUMPProbable CausesSystem dumped. Minimal Dump collected in Non-Volatile Memory.Recommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataMinidump Data:4D32 0D55 34
01DB ADF 00 F104 689A 00
244F 174A 1DD1
48 18C6 428C C5C7 3DC0 00 6563 DDBA 80 054C
A0A1 C387 0E09 0010 30 88B4 C00 2FC8 94B1 F382 CD99 2F64 EAB4 81C3 C60E 6563 45A4 C090 D4C
A0A0 9D86 71 622A 12A5 F84D C932 058A 34 10
EE05 9A37 6DCA BC78 2327 CC18 3632 E1C8 7943 A6CE 183A 2F62 C070 21C3 058C 1763 E4CC 79C1 E6CD
CE1C C9 B5AB D7AF 60C3 8A1D 4BB6 6CD9 3763 AC92 BB3 22ED B481 33E6 0D9C 3C20 6C08 19A2 006E
DCF9 D 2F69 C8E8 00E1 E445 F19 03E7 70E2 C58D 1F97 C32 61C8 7C59 3F 7E28 D0C7 ADA0 C802 10 E208 B46A D9BA 9DB8 38 7B06 2D7A CDC4 63 10 00B4 08BA
E449 C20 50B0 2200
5B03 A622 BC23 38A0
0D10 8F47 C660 2C48 D207 308B 000E 4082
36EC 6AEA 2C08 CF48 2B22 15BD B5F2 F58E F E4A9 40B7 9320 C91E F8FE 499D 2A95 E640 A 6509 00AA A F24C B952 2B27 585B
C822 F D622 24 2A9E 2CB8
5FD8 BC79 B3A6 0E9C 2F64 E4AC 11 11 A
A EEA4 FC69 0B00 B68 A260 51F3 C0CE 9FDD 4D51 461A
F65A 4CD4 7A33 6CD0 543E D5DE 01E7 8433 9ABC B1F6 7EED B A421 103F F1CC BBA E6DC DC5D 15E1 046D E3EE C E5DC D7A 34F4 B0EB 1DD2 A5A2 76 3E75 E7D5 910F D175 010A
C045 533C F9 40E1 203D 76D4 14E1 48E5 D514 00 31E4 D424 15 411B 54A2 4D45 30 C 0AE8 48D3
A376 E4 05 E0E3 8600 BCA5
B121 5D44 BA72 08
D71C 74 08 0103 4C49 F002 C19B 71CE
0CC1 2730 DCCC
C851 4619 77CC 81E7 108D 59F4 0423 A4AC
688A 07A7 2BE0
B093 C61C 73A4 71C6 0A35 C8B0 6A45 06A4 C142 AC67 049A 861D E38 C064 0015 D8B0 29D5 3E92 A0C
CC62 1E 3DF1 F4F2 0D69 206C D FE58 D022 0A AC4B 10B5 B25C 9BED B6F1 FCF2 05B8 E292 EB63 45E8 AA8B E493 D4C6 22AF B6BF C503 8C2A F88E 0B53 B9FC A6EB 2E41 494E 8B00 5A15 614B
F3AD 53F9 C294 B4F 01AD D4A6 305C 9D71 70C2 209C DC4B 100A 1B90 44D1 10D2 C254 1F
E595 05FD DC33
B45A 53BA B82F CD27 BEF1 2C00 0CC3 B422 D4FB 6AA5 A536 43D7 C430 CD16 45D1 0C33 3595 57 7669 0EBA 84
D9 0D41 01 C06C D0CD B830 CA48 E34E 34DB 1D00 DE35 06 3EB8 DF08 1CB0 77DF 85CF
24FE B7E4 84AB 6539 DF7E C7A8 B98B 2D3E 8EF8 000F 4CE5 4F53 AA47 2EB8 C22D A695 63DC
EE03 CC9C A308 4D74 5BE4 014D 04E4 382E EEB 6C82 43E0 98 209C A9 000C 1C70 D921 4D10 DE4 92BD DB29 D234 35DB B55B F4E2 DF86 E361 23E7 693D 3980 25EE D68 1FBB B0 294F 2A08 BC 2F22 F2E3 1F97 BCD4 6A C F231 65FD C34D 6D80 3B E149 4F7C F213 A046 28A8 3210 EA56
14C5 31 A014 4C2E 95A9 4D75 8A56 A082 C9A8 4AE5 C354 C190 200C 68D5 AB78 452B 5B19 4B57 BCF2 15B0
21CB 83CC 9A4C 657E E38E 049C
1E07 B422 002A
E B02D 770C 221B A441 81C2 23 AD9 C8C5 78 604D F6D8 4647 BCC0 64A1 B288 18C5 E7A1 1A C08D DE90 01B1 C84 CB00 8002 BA3C E963 7A5C E3B6 DEC1 28 1B44 2A72 C00C 6EBC CD 2C72 B30C EA8C 200C 74A0 D11C 98CB A935
0AFF 3A37 80A6 3D6D 7F0F 835F
FE05 1326 CCC4 1D41 BC06 369B 70A5 4B67 43C0 D930 90B6 149D 6D6D 00D0 48FB A459 9004 E6CC 2A8A 1340 E82A B737 F2C8 AE1B B8A4 DF8C ECA7 13CF 552E 5DB4 9B5B EC3E 27B8 78B2 3310 EE94 B62 BED3 9FA3 0BA8 E906 8ABA F2A8 AE9E AC73 1DEC D857 3AC9 A1B1 A0B8 0B80 EE78 E73B 9AD0
01C5 2C92 BC2E 0180 79CE 831E 55A4 5700 EA25 20 08A1 BD15 4DA8 428A B401
C743 A5E6 BE8B 96B3 B2 22 05CD 9F1E
0909 01CA F2C7 3FE4 AB 5BF9 A1 9903 13EF AB4A 96A8 3AC1 46EA 8408 62 010D 3EAC 83CA 02A1
3BE5 08 E2A 518B 6AD4 A322 35A9 4A55
2B 5935 F188 7F83 A2AC A418 ACC5 54D1 22C7 4A96 B2B2 E82C 987C D022 24C0
8018 84A0 8DE3 01 AA36 CC5F 16F9 473F 608B 0B78 56A4 B6B7 E522 39E4 CAB1 7C5E D2B7 E772 986B 5F57 91D8 7A83 B6B6 6D63 39F4 B0DB A956 35BA C0AD 885A 0B12 DB6F 6037 B9DD 41C7 689A 4B13 501E 37BB BF79 470D
C18A 38C6 8C40 C4A4 BCA 4DE9 AC53 43B0 59D1 6A11 0523 0DAA 58F1 2DD3 DCE6 34EF
61 72EA 046F 6723 DB35 B579 4D6E 6644 6DDF 7CA8 ---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Fri Jun&&4 11:06:22 2010Sequence Number: 1103Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 221516FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&ERRLOG_ONIDENTIFIER: 9DBCFDEEDate/Time:& && & Fri Jun&&4 11:08:25 2010Sequence Number: 1102Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &errdemonDescriptionERROR LOGGING TURNED ONProbable CausesERRDEMON STARTED AUTOMATICALLYUser Causes/USR/LIB/ERRDEMON COMMANDRecommended ActionsNONE---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Fri Jun&&4 10:56:20 2010Sequence Number: 1101Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 221516FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Apr&&9 13:20:52 2010Sequence Number: 1095Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 20 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Apr&&9 13:02:04 2010Sequence Number: 1085Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 02 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Apr&&9 12:54:47 2010Sequence Number: 1067Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 54 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&LVM_GS_RLEAVEIDENTIFIER: AB59ABFFDate/Time:& && & Fri Apr&&2 17:51:53 2010Sequence Number: 1062Machine Id:& && &Node Id:& && && &node1Class:& && && &&&UType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &LIBLVMResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionRemote node Concurrent Volume Group failure detectedProbable CausesRemote node Concurrent Volume Group forced offlineFailure CausesRemote node left VGSA/VGDA groups due to failureRecommended ActionsExamine error log on identified remote nodeDetail DataRemote Node Namenode2Volume Group ID00C9 6A02
EF7 47A3 MAJOR/MINOR DEVICE NUMBER SENSE DATA00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&LVM_GS_RLEAVEIDENTIFIER: AB59ABFFDate/Time:& && & Fri Apr&&2 17:51:33 2010Sequence Number: 1061Machine Id:& && &Node Id:& && && &node1Class:& && && &&&UType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &LIBLVMResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionRemote node Concurrent Volume Group failure detectedProbable CausesRemote node Concurrent Volume Group forced offlineFailure CausesRemote node left VGSA/VGDA groups due to failureRecommended ActionsExamine error log on identified remote nodeDetail DataRemote Node Namenode2Volume Group ID00C9 6A02
EF7 47A3 MAJOR/MINOR DEVICE NUMBER SENSE DATA00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&GOENT_RCVRY_EXITIDENTIFIER: F3931284Date/Time:& && & Fri Apr&&2 17:51:14 2010Sequence Number: 1060Machine Id:& && &Node Id:& && && &node1Class:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &ent4Resource Class:&&adapterResource Type:& &Location:& && &&&U789D.001.DQD92Z4-P1-C1-T1VPD:& && && && & & && &2-P NIC-TX PCI-e:& && &&&EC Level....................D76567 & && &&&Part Number.................46K6601& && &&&Manufacture ID..............YL1026& && &&&FRU Number..................46K6601& && &&&Network Address.............00145E74BCB0& && &&&ROM Level.(alterable).......EP0140DescriptionETHERNET NETWORK RECOVERY MODERecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataFILE NAMEline: 304 file: goent_intr.cPCI ETHERNET STATISTICS 00 00 00 00
42 106D 43 00 0132 1ECF C 0041 C52A 8E E12E A23 DBDF 00 01
00 00 00 15 00 0000 00 00 0C
00 00 00 00 00 0000 00 00 DEVICE DRIVER INTERNAL STATE00 00 SOURCE ADDRESS BCB0 ---------------------------------------------------------------------------LABEL:&&HEA_PORT_UPIDENTIFIER: D6A51BF7Date/Time:& && & Fri Apr&&2 17:51:06 2010Sequence Number: 1059Machine Id:& && &Node Id:& && && &node1Class:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &ent7Resource Class:&&adapterResource Type:& ðernetLocation:& && &&&U789D.001.DQD92Z4-P1-C10-T1&&VPD:& && && && & & && &IBM Host Ethernet Adapter:& && &&&Network Address.............DescriptionHEA PORT UPRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataFILE NAMEline: 1946 file: hea_prim.cHEA LOGICAL PORT STATE:UP&&HEA PHYSICAL PORT STATE:UP&&SENSE DATA 00 00 02 00
D9BF EEA2 21 85A3
0041 CFE9 0000 C5
C78F C693 00 03 00 00 00 21 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 DEVICE DRIVER INTERNAL STATE00 00 00 0000 SOURCE ADDRESS 6591 ---------------------------------------------------------------------------LABEL:&&ECH_MAIN_CHAN_FAILIDENTIFIER: Date/Time:& && & Fri Apr&&2 17:51:06 2010Sequence Number: 1058Machine Id:& && &Node Id:& && && &node1Class:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &ent9Resource Class:&&adapterResource Type:& &ibm_echLocation:& && &&&DescriptionTOTAL ETHERCHANNEL FAILUREProbable CausesCABLESWITCHADAPTERFailure CausesCABLES AND CONNECTIONSRecommended ActionsCHECK CABLE AND ITS CONNECTIONSIF ERROR PERSISTS, REPLACE ADAPTER CARD.Detail DataWhole EtherChannel is down: all main adapters failed and there is no backup adapter defined-----------------}
A600 8E00 00 D00 00 A206 51 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&MINIDUMP_LOGIDENTIFIER: F48137ACDate/Time:& && & Sun Jun 13 13:51:02 2010Sequence Number: 1144Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &minidumpDescriptionCOMPRESSED MINIMAL DUMPProbable CausesSystem dumped. Minimal Dump collected in Non-Volatile Memory.Recommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataMinidump Data:4D32 0D6C 24EC 37 00E4 01DB 45 2E00 E4 67C8 00
50 190A 318C C4E7 BB80 00 6563 DDBA 80 054C 2A98
C387 0E09 0090 44 5AC0 C0A1 CA D879 C1E6 CC17 3275 DAC0 45 A4C0 6D 4C2A
A5F8 4DC9 3205 8A94
12 EE 059A 376D CABC 7823 27CC
C879 43A6 CE18 3A2F 62C0 C17 63E4 CC79 C1E6 CD99 176E CE 1C32
C9B5 ABD7 AF60 C38A 1D4B B66C D937 63AC D1B B322 EDB4 C3C 206C E43 1020 D0DC F962 464E 9D2F 69C8 E800 E1E4 4510 03 E770 E2C5 8D1F D9C 03
3F7E 28D0 C7AD A0C8 C42 10E2 08B4 6AD9 BA9D B802 22C9 2D 7ACD C414 00 E0 9067 AC02 2C18 F2A4 10 10 F00A BEA0 B706 0C45 01C2 B400 A208 27 16FC C7D2 1FC9
0C60 94 10C9 23 F80 89 CA 82F6 94A7 F AD7C BDBB 9A75 6B41 D88 552B 57B3 AC0 A 25 4CA6 28D9 CB 7F2E D3A2 92 4329 428B 50AB 2E41
A208 84E2 0601 76DA 7C61 F3E6 CD9A 3A70 BE90 91B3 4206 0D94 A0
C9A8 C44B 5041 AC56 007A C88B 5307 5DAA 6F41 3150 0A 246D E3D6 CD1B DDAA 87 A232 CA44 C96F E7DE DD9B 9592 E83B E09C 7016 13BB DDEC CBB9 A363 352D E91 6C32 871D FAED CD59 F18B 3E1D 450F DA24 C571 1F73 BDB5 F281 7BF0 A0 51C3 02 13E9 C6C6 01F9 5CC1 8B7B 5D80 02C0
D16C B0 6DE4
2495 41D6 40F3
C054 04 D3F C5C4 53 5147 40 E084 270F 12
2CF3 92 088D A0E4 5A95 52 CB9 058D 2430 CCF4 20
625D 14 0D11 0D22 7F15 CA4F 1B 65D0 B C420 449C 2425 C10B 0488 2ACA A8A3 911A
00C3 CD1C 68B4
0E 711A 494F 3042 CA1A 8FA6 41
0307 AD78 D8BA 020E 9F92 C4C0 35EC A431 C71C 699C B142 0D32 144B
C0EC 199A A661
1940 0536 85FE B50F 6BAE C156 81 02C2 BE0
BB6E 99EF 0623 2FBD F6A6 A3C1 0FFB F6FB 6FC0 050D 5CB0 9828 BD4B 1C45 F3D6 4B60 3A1B FC11 B1BF 2801 AC65 C504 1B4C 03 070D 2CEC
F0CA C831 093A 19C7 0C13 B80E 241A DC4
B891 E 34C4
175F 04B5 09C5 9BBB
6D 4569 57C0 4FFF F886 BA00 982C 40
C156 1704 7A13 8440 DF00
AF11 F955 DD41 3E2D 276A
D601 1004 022E 92C0 6C50 0F21 921B F5 F4E4 0140 CE54 023F FE84 B9E6 9C4F 5EF9 E59E 2B59 E594 008C 6E54 E69B 778E 00E5
E84C A949 5BEA B43D FDC0 5F81 E145 FCEA B9CF EE3C 958A D3D6 240A 4C 12F0 0A13 1C30 E9A4 25D6 A384 BD95 4ED2
F78A 1FB9 48D2 061A D 42E2 A8E3
F1D6 F22 D 88C1 A64
0A 9BC0 E616 49 0B05 EB64 A33B C16F 4F7E F393 CA74 562E 961C AA0D
1AF5 A848 4D0A 5497 CA94 0E37
AB20 A11A 55A9 4E95 AA55 B5EA
AC6A 75AB 67E9 0A25 BDFA 82 1C2B 59CB 6AD6 B3A2 15AE 6A5D 2B5B DBEA D6B7 C235 AE1A FEE3 5CAD 291C 81D0 5F 24BB 5FFE 8C24 002A 30E3 CE 602F 74C8 E340
C644 91 A388 C3C A120 E933 7E A041
FEF4 4712 FE25 B CA00 A0E6 0C16 848E 209C FC18 D4 A54C 3A0B E420 1B46 076F 088D A8A F10A 76FC 8269 1FAA 1DD4 C434 B5BE E8AE A1 60B5 694A F384 719B B4 4DB0
368D 1400 0A66 1325 DF54
8C3F C604 707C 331C D800
CC97 C404 822F 215D D8
9D02 1988 17DB EDAE 743B 43CD F26E A7B9
B15B E0F3 9489 50DD 51CE A00A C580
018A 6E00 C76B 0980 266A 00DC 5E 3F9B B30 129C 841B 485A 04 A092 BF40 A5 EC0 3E12 A986 F 8B40
8010 FB6B 615E 3EA4 A30A E403 35 D9C1
38AD 37 28A8 2084 B960 20F3 11AE 0EC6 E401 740D 614C 01 123C
8F45 75F1 D29F 4842 C31A DE30 873B 4A
38D4 140F 8D08 2A51 91CA 54A8 5215 AB62 E02A
D281 8B1B 4496 B2AE 35C6 2E1A C58C CD42 23B7 4AB3 C35 8463 BAC2 D54F 40 4C1C AED1 301E 1CF3 8E12 4309 04DC 2AB0
C7D5 2A41 20B0 DC86 F900 62D0 CDA3 50A8 8BB2 8BF9 B64C C78D 8172 99FB B11F
252F 412C E6C0 9A90 E4B8 A1E4 2E7B 6916 043C C097 B183 5AAF BDD8 F103 6AFC A2C
6EB7 43C9 8C1E 49A4 06B6 BD38 D36A 7E05 2C45 328C E1BF 61 5AA8 4B37 7D9E ADAD 6F15 2B8A ---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Sun Jun 13 13:51:02 2010Sequence Number: 1143Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 344100FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&ERRLOG_ONIDENTIFIER: 9DBCFDEEDate/Time:& && & Sun Jun 13 13:53:06 2010Sequence Number: 1142Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &errdemonDescriptionERROR LOGGING TURNED ONProbable CausesERRDEMON STARTED AUTOMATICALLYUser Causes/USR/LIB/ERRDEMON COMMANDRecommended ActionsNONE---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Sun Jun 13 13:43:19 2010Sequence Number: 1141Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 344100FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&GS_START_STIDENTIFIER: AFA89905Date/Time:& && & Sun Jun 13 13:10:37 2010Sequence Number: 1140Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &grpsvcsDescriptionGroup Services daemon startedProbable CausesDaemon started during system startupDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsCheck that Group Services daemon is runningDetail DataDETECTING MODULERSCT,pgsd.C,1.62.1.8,606& && && && && && && & ERROR ID 63Y7ej0RwF3A/YGg./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &DIAGNOSTIC EXPLANATIONHAGS daemon started by SRC. Log file is /var/ha/log/grpsvcs_trace_1_45.---------------------------------------------------------------------------LABEL:&&TS_START_STIDENTIFIER: 97419D60Date/Time:& && & Sun Jun 13 13:10:32 2010Sequence Number: 1139Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &topsvcsDescriptionTopology Services daemon startedProbable CausesDaemon started during system start-upDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsConfirm that this is desirableDetail DataDETECTING MODULErsct,bootstrp.C,1.213,4440& && && && && && &&&ERROR ID 6UpNEL0MwF3A/zL3./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &Topology Services daemon started by:SRCTopology Services daemon log file location/var/ha/log/topsvcs.13.131031.ibm_cls.en_USTopology Services daemon run directory/var/ha/run/topsvcs.ibm_cls/---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1138Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172488DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1137Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 192736DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1136Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172486DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateFri Jun&&4 17:39:08 2010Time of last duplicateFri Jun&&4 17:39:08 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1135Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172486DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1134Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172486DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1133Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 176312DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1132Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 131246DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateFri Jun&&4 17:39:08 2010Time of last duplicateFri Jun&&4 17:39:08 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1131Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 131246DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1130Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 131246DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&RMCD_INFO_0_STIDENTIFIER: A6DF45AADate/Time:& && & Fri Jun&&4 17:39:08 2010Sequence Number: 1129Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &RMCdaemonDescriptionThe daemon is started.Probable CausesThe Resource Monitoring and Control daemon has been started.User CausesThe startsrc -s ctrmc command has been executed orthe rmcctrl -s command has been executed.Recommended ActionsConfirm that the daemon should be started.Detail DataDETECTING MODULERSCT,rmcd.c,1.56,213& && && && && && && && &&&ERROR ID 6eKora0A0M0A/o4Q//2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &---------------------------------------------------------------------------LABEL:&&TUNE_RESTRICTEDIDENTIFIER: D221BD55Date/Time:& && & Fri Jun&&4 17:38:56 2010Sequence Number: 1128Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &perftuneDescriptionRESTRICTED TUNABLES MODIFIED AT REBOOTProbable CausesSYSTEM TUNINGUser CausesTUNABLE PARAMETER OF TYPE RESTRICTED HAS BEEN MODIFIEDRecommended ActionsREVIEW TUNABLE LISTS IN DETAILED DATADetail DataLIST OF TUNABLE COMMANDS CONTROLLING MODIFIED RESTRICTED TUNABLES AT REBOOT, SEE FILE /etc/tunables/lastboot.logvmo, no---------------------------------------------------------------------------LABEL:&&DUMP_STATSIDENTIFIER: 67145A39Date/Time:& && & Fri Jun&&4 17:38:24 2010Sequence Number: 1126Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &SYSDUMPDescriptionSYSTEM DUMPProbable CausesUNEXPECTED SYSTEM HALTUser CausesSYSTEM DUMP REQUESTED BY USERRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESFailure CausesUNEXPECTED SYSTEM HALTRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataDUMP DEVICE/dev/lg_dumplvDUMP SIZE& && && && & TIMEFri Jun&&4 17:27:20 2010DUMP TYPE (1 = PRIMARY, 2 = SECONDARY)& && && &&&1DUMP STATUS& && && &&&0ERROR CODE& && && &&&0DUMP INTEGRITYCompressed dump - Run dmpfmt with -c flag on dump after uncompressing. FILE NAMEPROCESSOR ID& && && &&&0---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Jun&&4 17:36:49 2010Sequence Number: 1125Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 36 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&MINIDUMP_LOGIDENTIFIER: F48137ACDate/Time:& && & Fri Jun&&4 17:36:49 2010Sequence Number: 1124Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &minidumpDescriptionCOMPRESSED MINIMAL DUMPProbable CausesSystem dumped. Minimal Dump collected in Non-Volatile Memory.Recommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataMinidump Data:4D32 0B9B 1E2B 37 00E4 01DB E0 00 8BB7 0217 00
7FD1 2B40 E18F
48 190A 318C C5C7 3DC0 00 6563 DDBA 80 054C 12F4
C387 0E09 384C 00C0 010C 222D 60E0 C808 03C0 0B32 65EC BC60 73E6 0B99 3A6D E0B0 B103
C090 D4C 12F4
9D86 71 622A 12A5 F84D C932 058A 34 F10
EE05 9A37 6DCA BC78 2327 CC18
7943 A6CE 183A 2F62 C070 21C3 058C 1763 E4CC 79C1 E6CD
CE1C C9 B5AB D7AF 60C3 8A1D 4BB6 6CD9 3763 AC92 BB3 22ED B481 33E6 0D9C 3C20 6C08 19A2 006E
DCF9 D 2F69 C8E8 00E1 E445 1005
03E7 70E2 C58D 1F97 C32 61C8 7C59 3F 7E28 D0C7 ADA0 C802 10 E208 B46A D9BA 9DB8 38 7B06 2D7A CDC4 1410 24
E090 67AC 022C 18F2 A409 28 F0 0ABE A0B7 060C
00A2 04 2716 FCC7 D21F C981 20 10 C948 70A3 1D00 0F 40CD
25 417B CA53 018B A2B7 56BE DE59 C5AA B520 BC23 30C8 6CCD 3AB6 6BC1
C25C 8A52 2D80 042A 50B2 FCE7 92E2 DC82 A72 A81 A028 81 50DC 20C0 4E9B 2F6C DEBC 5953 07CE
00C0 09 2E00 730D 000F 479A C28 060A C062 36D1 4481 E4EC DAB7 730B 4AA3 2E28 46 99C8 386D DBB8 75AB B1E5 7C07 9C13 CE62
C071 ECCA D77C 090A C1FB B CC61 671D 39 878E A247 6C92 71D4 879E 6E6B BCC2 9E7B D108 985C
90C0 44B7 55B2 012C 2F1C C15E 17A0 44 041B 20 AD6D E4C6 41 1B84 40C1 8B00 A30 52 C01E 1869 44CF 4F31 B148 9291 FFD1 00 0D1F 283D 20C4 7449 DE55 2541 E50D B088 181F D6 83E3 98 6A B1E5 CD19 489E F5D2
1F11 B60 BAD2 C8 5E84 F263 D91C 9F95 C146
C70A A49 F002 C1A1 892E DA28 A446 0C41 2930 DCCC
C851 4619 77CC 01E9 10A4 91F4 0423 A4AC E168 1A74 3C5A 01 3D70 C88A 07AD 2BE0 E029 490C 5CC3 4E1A 73CC 91C6 192B D420 C3B0 BCA 9E91 691A C39 E080 E8 5EFB A4B6 5A6B 36
F0D4 30E0 2023 BC11 C C 16B4 4800 02AC 9B6E 79ED C602 AFBC C941
DC9B 6F4C FC52 F46F C063 92D4 6E55 42C5 3B6F 09C7 38AC 2F49 11FB 0BB0 C004 30 53CC C1F3 9EF0 80C7
C608 B F938 A7EF 8D3C F E290 CB0 D844 430C
E145 509B 50BC 19A7 D450 4B4D 12D5 00AC F5D0 4C5B A F4BC 812E
C3CC 52AD B108 41DD 18 A468 286B 6F A9 7500 41FC 00A0 C E0B8 51C0 C820
F964 6C49 2BCE F852 090C 9E79 E597 4F8E C001 904B CE24 004E
9D53 6E39 E68F 479E 39EB 9BCF DC9 F900 0FEC D517 5DA2
BBBF EEB5 D2C9 A3B4
E24F AE51 8E1B CDC7 019C 74C9
918B 1F 7F34 EE5E 03
24AD 0E41 7180 08 5D B80E 7F08 4CA0 02E9 42A8 FF64 6F15 92C0 46FA 8CE1 12
30 12C0 17E0 F006 36B0 08 C0 5CBC 7B1A E5FC 07C0
B0F8 C680 76F3 0BA2 C5E9 3F0B 08E2 10D5 2092 BC41 404F
E801 0AC4 B A448 40 A217 EC81 40FB 80 0ABC C81A 00E6 57BF FB21 C
F8A1 16E1 789F 4B1C A220
E9B2 C521 6EE2 654E A4DE 6D28 09 1BEA D044 06F0 BD11 DB 8ACE D744 A 1DBC 514C 76D4 AA2 2B92 2A15 B824 A300 E004
A404 C5D8 5831 4D24 A140 24D0
2345 EC88 CB6F 09D3 814B
659D C 11E1 457C
22B3 F7FD C350 6D40
A6C6 A9A9 A
A14A A5E 15AB 59D5 AA59 B842 C9AE 7AE5 CF60 C193 20C5 3A56 B296 D5AC 677D 6B5A D5BA 56B6 B6D5 AD6F 85CB 9BE5 524D 0E0B
C94B 004C 8C64 E1A
B94B 898D 0C25 C42C C847 B776 C59B 268C
4E29 C252 9F52 8C24 C124 090D D071 CC80 18D5
CAA6 254D 5821 ECE0 0A9D C6 2FF2 E10C 1810 CD68 1E5A DED2 9A96 17D3 31D3 A0 A6D7 BC3A 936D 33E9 E9D7 E B634 7086 4DD3 2E01 BB52 C132 EF4A 7BBB 1B62 B3B6 B7BE 69E4 6F7B CBA1 4F0C F258 BF1C 2E71 595B 5C00 8253 BB12 8CCE C7F C9CD
A02B 9EEC 0491 DAD2 AA36 96BB 839D 6B67 5BDB D042 CEB4 AB5B AD5C 7697 CAA5 140E B242 FA89 F150 BB40 BAE8 B6B9 CF03 C01B 7E31 84 1A06 F5B2 0780 EDD1
0826 AFA9 4924 81A4 50 11CA 68 402E E051 5CB3 A164 90BB 6BA5
4CE0 E99 CA43
4B28 F 32E0 984C 60C1 694B 26D4 A081 05EB 32D8 2FA6 9A66 924C 744D 8A64 739B
C129 4E72 36EA
412A ---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Fri Jun&&4 17:36:49 2010Sequence Number: 1123Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 205054FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&ERRLOG_ONIDENTIFIER: 9DBCFDEEDate/Time:& && & Fri Jun&&4 17:38:53 2010Sequence Number: 1122Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &errdemonDescriptionERROR LOGGING TURNED ONProbable CausesERRDEMON STARTED AUTOMATICALLYUser Causes/USR/LIB/ERRDEMON COMMANDRecommended ActionsNONE---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Fri Jun&&4 17:27:19 2010Sequence Number: 1121Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 205054FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&GS_START_STIDENTIFIER: AFA89905Date/Time:& && & Fri Jun&&4 16:54:59 2010Sequence Number: 1120Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &grpsvcsDescriptionGroup Services daemon startedProbable CausesDaemon started during system startupDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsCheck that Group Services daemon is runningDetail DataDETECTING MODULERSCT,pgsd.C,1.62.1.8,606& && && && && && && & ERROR ID 63Y7ej0nML0A/cSz./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &DIAGNOSTIC EXPLANATIONHAGS daemon started by SRC. Log file is /var/ha/log/grpsvcs_trace_1_44.---------------------------------------------------------------------------LABEL:&&TS_START_STIDENTIFIER: 97419D60Date/Time:& && & Fri Jun&&4 16:54:55 2010Sequence Number: 1119Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &topsvcsDescriptionTopology Services daemon startedProbable CausesDaemon started during system start-upDaemon re-started automatically by SRCDaemon started during installationDaemon started manually by userUser CausesDaemon started manually by userRecommended ActionsConfirm that this is desirableDetail DataDETECTING MODULErsct,bootstrp.C,1.213,4440& && && && && && &&&ERROR ID 6UpNEL0jML0A/TNn./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &Topology Services daemon started by:SRCTopology Services daemon log file location/var/ha/log/topsvcs.04.165454.ibm_cls.en_USTopology Services daemon run directory/var/ha/run/topsvcs.ibm_cls/---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1118Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 147882DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1117Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 151736DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1116Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172214DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateFri Jun&&4 11:08:41 2010Time of last duplicateFri Jun&&4 11:08:41 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1115Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172214DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1114Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172214DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1113Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 151732DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1112Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172210DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0DuplicatesNumber of duplicates& && && &&&2Time of first duplicateFri Jun&&4 11:08:41 2010Time of last duplicateFri Jun&&4 11:08:41 2010---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1111Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172210DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&CONSOLEIDENTIFIER: 7F88E76DDate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1110Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &consoleDescriptionSOFTWARE PROGRAM ERRORProbable CausesSOFTWARE PROGRAMFailure CausesSOFTWARE PROGRAMRecommended ActionsREVIEW DETAILED DATADetail DataUSER'S PROCESS ID:& && && && && & 172210DETECTING MODULEconwriteFAILING MODULEUIO_WRITERETURN CODE& && && &&&5ERROR CODE& && && &&&0---------------------------------------------------------------------------LABEL:&&RMCD_INFO_0_STIDENTIFIER: A6DF45AADate/Time:& && & Fri Jun&&4 11:08:41 2010Sequence Number: 1109Machine Id:& && &Node Id:& && && &node1Class:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &RMCdaemonDescriptionThe daemon is started.Probable CausesThe Resource Monitoring and Control daemon has been started.User CausesThe startsrc -s ctrmc command has been executed orthe rmcctrl -s command has been executed.Recommended ActionsConfirm that the daemon should be started.Detail DataDETECTING MODULERSCT,rmcd.c,1.56,213& && && && && && && && &&&ERROR ID 6eKora07IG0A/THl./2.e.1...................REFERENCE CODE& && && && && && && && && && && && && && &---------------------------------------------------------------------------LABEL:&&TUNE_RESTRICTEDIDENTIFIER: D221BD55Date/Time:& && & Fri Jun&&4 11:08:28 2010Sequence Number: 1108Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &perftuneDescriptionRESTRICTED TUNABLES MODIFIED AT REBOOTProbable CausesSYSTEM TUNINGUser CausesTUNABLE PARAMETER OF TYPE RESTRICTED HAS BEEN MODIFIEDRecommended ActionsREVIEW TUNABLE LISTS IN DETAILED DATADetail DataLIST OF TUNABLE COMMANDS CONTROLLING MODIFIED RESTRICTED TUNABLES AT REBOOT, SEE FILE /etc/tunables/lastboot.logvmo, no---------------------------------------------------------------------------LABEL:&&DUMP_STATSIDENTIFIER: 67145A39Date/Time:& && & Fri Jun&&4 11:07:57 2010Sequence Number: 1106Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &SYSDUMPDescriptionSYSTEM DUMPProbable CausesUNEXPECTED SYSTEM HALTUser CausesSYSTEM DUMP REQUESTED BY USERRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESFailure CausesUNEXPECTED SYSTEM HALTRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataDUMP DEVICE/dev/lg_dumplvDUMP SIZE& && && && & TIMEFri Jun&&4 10:56:20 2010DUMP TYPE (1 = PRIMARY, 2 = SECONDARY)& && && &&&1DUMP STATUS& && && &&&0ERROR CODE& && && &&&0DUMP INTEGRITYCompressed dump - Run dmpfmt with -c flag on dump after uncompressing. FILE NAMEPROCESSOR ID& && && &&&2---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Jun&&4 11:06:22 2010Sequence Number: 1105Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 06 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&MINIDUMP_LOGIDENTIFIER: F48137ACDate/Time:& && & Fri Jun&&4 11:06:22 2010Sequence Number: 1104Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &minidumpDescriptionCOMPRESSED MINIMAL DUMPProbable CausesSystem dumped. Minimal Dump collected in Non-Volatile Memory.Recommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataMinidump Data:4D32 0D55 34
01DB ADF 00 F104 689A 00
244F 174A 1DD1
48 18C6 428C C5C7 3DC0 00 6563 DDBA 80 054C
A0A1 C387 0E09 0010 30 88B4 C00 2FC8 94B1 F382 CD99 2F64 EAB4 81C3 C60E 6563 45A4 C090 D4C
A0A0 9D86 71 622A 12A5 F84D C932 058A 34 10
EE05 9A37 6DCA BC78 2327 CC18 3632 E1C8 7943 A6CE 183A 2F62 C070 21C3 058C 1763 E4CC 79C1 E6CD
CE1C C9 B5AB D7AF 60C3 8A1D 4BB6 6CD9 3763 AC92 BB3 22ED B481 33E6 0D9C 3C20 6C08 19A2 006E
DCF9 D 2F69 C8E8 00E1 E445 F19 03E7 70E2 C58D 1F97 C32 61C8 7C59 3F 7E28 D0C7 ADA0 C802 10 E208 B46A D9BA 9DB8 38 7B06 2D7A CDC4 63 10 00B4 08BA
E449 C20 50B0 2200
5B03 A622 BC23 38A0
0D10 8F47 C660 2C48 D207 308B 000E 4082
36EC 6AEA 2C08 CF48 2B22 15BD B5F2 F58E F E4A9 40B7 9320 C91E F8FE 499D 2A95 E640 A 6509 00AA A F24C B952 2B27 585B
C822 F D622 24 2A9E 2CB8
5FD8 BC79 B3A6 0E9C 2F64 E4AC 11 11 A
A EEA4 FC69 0B00 B68 A260 51F3 C0CE 9FDD 4D51 461A
F65A 4CD4 7A33 6CD0 543E D5DE 01E7 8433 9ABC B1F6 7EED B A421 103F F1CC BBA E6DC DC5D 15E1 046D E3EE C E5DC D7A 34F4 B0EB 1DD2 A5A2 76 3E75 E7D5 910F D175 010A
C045 533C F9 40E1 203D 76D4 14E1 48E5 D514 00 31E4 D424 15 411B 54A2 4D45 30 C 0AE8 48D3
A376 E4 05 E0E3 8600 BCA5
B121 5D44 BA72 08
D71C 74 08 0103 4C49 F002 C19B 71CE
0CC1 2730 DCCC
C851 4619 77CC 81E7 108D 59F4 0423 A4AC
688A 07A7 2BE0
B093 C61C 73A4 71C6 0A35 C8B0 6A45 06A4 C142 AC67 049A 861D E38 C064 0015 D8B0 29D5 3E92 A0C
CC62 1E 3DF1 F4F2 0D69 206C D FE58 D022 0A AC4B 10B5 B25C 9BED B6F1 FCF2 05B8 E292 EB63 45E8 AA8B E493 D4C6 22AF B6BF C503 8C2A F88E 0B53 B9FC A6EB 2E41 494E 8B00 5A15 614B
F3AD 53F9 C294 B4F 01AD D4A6 305C 9D71 70C2 209C DC4B 100A 1B90 44D1 10D2 C254 1F
E595 05FD DC33
B45A 53BA B82F CD27 BEF1 2C00 0CC3 B422 D4FB 6AA5 A536 43D7 C430 CD16 45D1 0C33 3595 57 7669 0EBA 84
D9 0D41 01 C06C D0CD B830 CA48 E34E 34DB 1D00 DE35 06 3EB8 DF08 1CB0 77DF 85CF
24FE B7E4 84AB 6539 DF7E C7A8 B98B 2D3E 8EF8 000F 4CE5 4F53 AA47 2EB8 C22D A695 63DC
EE03 CC9C A308 4D74 5BE4 014D 04E4 382E EEB 6C82 43E0 98 209C A9 000C 1C70 D921 4D10 DE4 92BD DB29 D234 35DB B55B F4E2 DF86 E361 23E7 693D 3980 25EE D68 1FBB B0 294F 2A08 BC 2F22 F2E3 1F97 BCD4 6A C F231 65FD C34D 6D80 3B E149 4F7C F213 A046 28A8 3210 EA56
14C5 31 A014 4C2E 95A9 4D75 8A56 A082 C9A8 4AE5 C354 C190 200C 68D5 AB78 452B 5B19 4B57 BCF2 15B0
21CB 83CC 9A4C 657E E38E 049C
1E07 B422 002A
E B02D 770C 221B A441 81C2 23 AD9 C8C5 78 604D F6D8 4647 BCC0 64A1 B288 18C5 E7A1 1A C08D DE90 01B1 C84 CB00 8002 BA3C E963 7A5C E3B6 DEC1 28 1B44 2A72 C00C 6EBC CD 2C72 B30C EA8C 200C 74A0 D11C 98CB A935
0AFF 3A37 80A6 3D6D 7F0F 835F
FE05 1326 CCC4 1D41 BC06 369B 70A5 4B67 43C0 D930 90B6 149D 6D6D 00D0 48FB A459 9004 E6CC 2A8A 1340 E82A B737 F2C8 AE1B B8A4 DF8C ECA7 13CF 552E 5DB4 9B5B EC3E 27B8 78B2 3310 EE94 B62 BED3 9FA3 0BA8 E906 8ABA F2A8 AE9E AC73 1DEC D857 3AC9 A1B1 A0B8 0B80 EE78 E73B 9AD0
01C5 2C92 BC2E 0180 79CE 831E 55A4 5700 EA25 20 08A1 BD15 4DA8 428A B401
C743 A5E6 BE8B 96B3 B2 22 05CD 9F1E
0909 01CA F2C7 3FE4 AB 5BF9 A1 9903 13EF AB4A 96A8 3AC1 46EA 8408 62 010D 3EAC 83CA 02A1
3BE5 08 E2A 518B 6AD4 A322 35A9 4A55
2B 5935 F188 7F83 A2AC A418 ACC5 54D1 22C7 4A96 B2B2 E82C 987C D022 24C0
8018 84A0 8DE3 01 AA36 CC5F 16F9 473F 608B 0B78 56A4 B6B7 E522 39E4 CAB1 7C5E D2B7 E772 986B 5F57 91D8 7A83 B6B6 6D63 39F4 B0DB A956 35BA C0AD 885A 0B12 DB6F 6037 B9DD 41C7 689A 4B13 501E 37BB BF79 470D
C18A 38C6 8C40 C4A4 BCA 4DE9 AC53 43B0 59D1 6A11 0523 0DAA 58F1 2DD3 DCE6 34EF
61 72EA 046F 6723 DB35 B579 4D6E 6644 6DDF 7CA8 ---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Fri Jun&&4 11:06:22 2010Sequence Number: 1103Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 221516FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&ERRLOG_ONIDENTIFIER: 9DBCFDEEDate/Time:& && & Fri Jun&&4 11:08:25 2010Sequence Number: 1102Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&OType:& && && && &TEMPWPAR:& && && && &GlobalResource Name:& &errdemonDescriptionERROR LOGGING TURNED ONProbable CausesERRDEMON STARTED AUTOMATICALLYUser Causes/USR/LIB/ERRDEMON COMMANDRecommended ActionsNONE---------------------------------------------------------------------------LABEL:&&CORE_DUMPIDENTIFIER: A924A5FCDate/Time:& && & Fri Jun&&4 10:56:20 2010Sequence Number: 1101Machine Id:& && &Node Id:& && && &node1Class:& && && &&&SType:& && && && &PERMWPAR:& && && && &GlobalResource Name:& &SYSPROCDescriptionSOFTWARE PROGRAM ABNORMALLY TERMINATEDProbable CausesSOFTWARE PROGRAMUser CausesUSER GENERATED SIGNALRecommended ActionsCORRECT THEN RETRYFailure CausesSOFTWARE PROGRAMRecommended ActionsRERUN THE APPLICATION PROGRAMIF PROBLEM PERSISTS THEN DO THE FOLLOWINGCONTACT APPROPRIATE SERVICE REPRESENTATIVEDetail DataSIGNAL NUMBER& && && &&&6USER'S PROCESS ID:& && && && && & 221516FILE SYSTEM SERIAL NUMBER& && && &&&8INODE NUMBER& && & 11238CORE FILE NAME/home/oracle/product/10.2.0/crs/log/node1/cssd/corePROGRAM NAMEocssd.binSTACK EXECUTION DISABLED& && && &&&0COME FROM ADDRESS REGISTERvmpcopy 6BCPROCESSOR ID&&hw_fru_id: N/A&&hw_cpu_id: N/AADDITIONAL INFORMATIONpthread_k B0??Symptom DataREPORTABLE1INTERNAL ERROR0SYMPTOM CODEPCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/b0---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Apr&&9 13:20:52 2010Sequence Number: 1095Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 20 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Apr&&9 13:02:04 2010Sequence Number: 1085Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 02 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&FIRMWARE_EVENTIDENTIFIER: A6D1BD62Date/Time:& && & Fri Apr&&9 12:54:47 2010Sequence Number: 1067Machine Id:& && &Node Id:& && && &localhostClass:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &unspecifiedResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionFirmware EventDetail DataEvent Information
A600 8E00 00 D00 00 A206 54 00 C00 00 00 0000 00 18 03 00 00 0000 4D54 001C 31 D 4D41 30 00 4C52 0014 00 01 9C00 D000 00 00
00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&LVM_GS_RLEAVEIDENTIFIER: AB59ABFFDate/Time:& && & Fri Apr&&2 17:51:53 2010Sequence Number: 1062Machine Id:& && &Node Id:& && && &node1Class:& && && &&&UType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &LIBLVMResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionRemote node Concurrent Volume Group failure detectedProbable CausesRemote node Concurrent Volume Group forced offlineFailure CausesRemote node left VGSA/VGDA groups due to failureRecommended ActionsExamine error log on identified remote nodeDetail DataRemote Node Namenode2Volume Group ID00C9 6A02
EF7 47A3 MAJOR/MINOR DEVICE NUMBER SENSE DATA00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&LVM_GS_RLEAVEIDENTIFIER: AB59ABFFDate/Time:& && & Fri Apr&&2 17:51:33 2010Sequence Number: 1061Machine Id:& && &Node Id:& && && &node1Class:& && && &&&UType:& && && && &UNKNWPAR:& && && && &GlobalResource Name:& &LIBLVMResource Class:&&NONEResource Type:& &NONELocation:& && &&&DescriptionRemote node Concurrent Volume Group failure detectedProbable CausesRemote node Concurrent Volume Group forced offlineFailure CausesRemote node left VGSA/VGDA groups due to failureRecommended ActionsExamine error log on identified remote nodeDetail DataRemote Node Namenode2Volume Group ID00C9 6A02
EF7 47A3 MAJOR/MINOR DEVICE NUMBER SENSE DATA00 00 00 00 00 0000 ---------------------------------------------------------------------------LABEL:&&GOENT_RCVRY_EXITIDENTIFIER: F3931284Date/Time:& && & Fri Apr&&2 17:51:14 2010Sequence Number: 1060Machine Id:& && &Node Id:& && && &node1Class:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &ent4Resource Class:&&adapterResource Type:& &Location:& && &&&U789D.001.DQD92Z4-P1-C1-T1VPD:& && && && & & && &2-P NIC-TX PCI-e:& && &&&EC Level....................D76567 & && &&&Part Number.................46K6601& && &&&Manufacture ID..............YL1026& && &&&FRU Number..................46K6601& && &&&Network Address.............00145E74BCB0& && &&&ROM Level.(alterable).......EP0140DescriptionETHERNET NETWORK RECOVERY MODERecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataFILE NAMEline: 304 file: goent_intr.cPCI ETHERNET STATISTICS 00 00 00 00
42 106D 43 00 0132 1ECF C 0041 C52A 8E E12E A23 DBDF 00 01
00 00 00 15 00 0000 00 00 0C
00 00 00 00 00 0000 00 00 DEVICE DRIVER INTERNAL STATE00 00 SOURCE ADDRESS BCB0 ---------------------------------------------------------------------------LABEL:&&HEA_PORT_UPIDENTIFIER: D6A51BF7Date/Time:& && & Fri Apr&&2 17:51:06 2010Sequence Number: 1059Machine Id:& && &Node Id:& && && &node1Class:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &ent7Resource Class:&&adapterResource Type:& ðernetLocation:& && &&&U789D.001.DQD92Z4-P1-C10-T1&&VPD:& && && && & & && &IBM Host Ethernet Adapter:& && &&&Network Address.............DescriptionHEA PORT UPRecommended ActionsPERFORM PROBLEM DETERMINATION PROCEDURESDetail DataFILE NAMEline: 1946 file: hea_prim.cHEA LOGICAL PORT STATE:UP&&HEA PHYSICAL PORT STATE:UP&&SENSE DATA 00 00 02 00
D9BF EEA2 21 85A3
0041 CFE9 0000 C5
C78F C693 00 03 00 00 00 21 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 00 0000 00 00 00 00 DEVICE DRIVER INTERNAL STATE00 00 00 0000 SOURCE ADDRESS 6591 ---------------------------------------------------------------------------LABEL:&&ECH_MAIN_CHAN_FAILIDENTIFIER: Date/Time:& && & Fri Apr&&2 17:51:06 2010Sequence Number: 1058Machine Id:& && &Node Id:& && && &node1Class:& && && &&&HType:& && && && &INFOWPAR:& && && && &GlobalResource Name:& &ent9Resource Class:&&adapterResource Type:& &ibm_echLocation:& && &&&DescriptionTOTAL ETHERCHANNEL FAILUREProbable CausesCABLESWITCHADAPTERFailure CausesCABLES AND CONNECTIONSRecommended ActionsCHECK CABLE AND ITS CONNECTIONSIF ERROR PERSISTS, REPLACE ADAPTER CARD.Detail DataWhole EtherChannel is down: all main adapters failed and there is no backup adapter defined-----------------}
我要回帖
更多关于 g7656 的文章
更多推荐
- ·魔兽争霸洛丹伦的夏天3冰封王座重回洛丹伦文件名是什么？
- ·求救：月下夜想曲地图完成度怎么看200.5%，还差0.1%不知道在哪里
- ·党的四个意识是指哪四个六项纪律是什么，党员六项纪律和党的四个意识是指哪四个
- ·新疆值钱的黑色石头图片大全有哪些
- ·求解，一个大学物理电磁学简答题场基础题，有答案，为什么r1是z-d/2
- ·龙之谷海龙3攻略第六关树人。。。。。求攻略。。。
- ·炫舞结婚戒指要一样吗怎么卡戒指吗
- ·打阿拉玛王国惩罚修改器需要多少攻击?
- ·DNF的30魔兽世界炼金双倍时间药杂没到时间就没了
- ·谁能帮我解决下GTA4的问题，出现了gta4乱码怎么解决?
- ·cf体验服1区cf点发放为什么没有给我发放CF点
- ·倩女幽魂至尊序列号1888至尊序列号
- ·求NBA2K11 xbox360最新游戏名...
- ·有什么3D,Q版，不是回合制的网页游戏回合制？
- ·真恋姬无双下载萌将传迅雷下载 快的加10分
- ·求cs生化危机竞技版2.0
- ·dnf女柔道柔道纯PK拿dnf柔道用什么武器器好？
- ·1986年玩什么网游玩的人多 6年了 基本不影响生...
- ·[林晨钰爆奶]▲爆▲奶#怎么进不去 ！无【...
- ·pspbemani系列音乐游戏戏问题。30赏！！！！
- ·123+987+137 7656 6262+98=?
- ·完美世界怎么安装没有夺宝奇兵服务器
- ·关于七雄匈奴战力争霸挑战匈奴的问题
- ·为什么侠盗列车54联机版进入就显示:未知...
- ·洛克王国稀有宠物谁给我个蛋啊 只求稀有精灵 雪...
- ·求nba2k9中文版下载 03
- ·街头篮球虚拟ip问题锻造问题
- ·为什么我的nba2k10球员补丁要连接2k s...
- ·现在买3.55的PS3会不会京东买到翻新机的概率的...
- ·e世博源附近好玩的里面有什么好玩的游戏玩法呢？？？...
- ·原先我电脑打dota打电脑都不会卡，不知道为...
- ·移动星乐园观看,AAAD移动星红苹果乐园在线观看哪...
- ·nba2k10中文补丁有没有中文解说？？
- ·求单机nba2k10全能修改器游戏官方下载，中文...
- ·有木有类似于老虎机的单机版老虎机游戏啊？
- ·nba2k10修改器的中文版下载网站？多大内...
