APAR status
Closed as program error.
Error description
[Problem] Unusal message is output at running a shell for DS stop. But process stops. [Additional info.] - today the customer started/stopped Server several times and he got the message at the 5th stop. After that, he got it every time when stopping the Server. - This customer faced to the issue that resource_tracker did not stop by DS stop shell. So now resource_tracker is also stopped in the DS stop shell. - No configuration changes on the system and IS [Question] When (Under which condition) could this message be displayed? How can the customer avoid this message? [root@Infosvr bin]# [root@Infosvr bin]# /opt/IBM/InformationServer/Server/DSEngine/sample/ds.rc stop Stopping JobMonApp JobMonApp has been shut down. resource_tracker has been shutdown. DataStage Engine 8.1.0.0 instance "ade" has been brought down. [root@Infosvr bin]# *** glibc detected *** /opt/IBM/InformationServer/Server/PXEngine/bin/resource_tracker: corrupted double-linked list: 0x0841f098 *** ======= Backtrace: ========= /lib/libc.so.6[0x453b67] /lib/libc.so.6(__libc_malloc+0x7b)[0x4553ab] /opt/IBM/InformationServer/Server/DSComponents/lib/libicuuc.so.3 2(uprv_malloc_3_2+0x45)[0xf72309bd] /opt/IBM/InformationServer/Server/DSComponents/lib/libicuuc.so.3 2(_ZN7icu_3_213UnicodeString8allocateEi+0x4f)[0xf725d169] /opt/IBM/InformationServer/Server/DSComponents/lib/libicuuc.so.3 2(_ZN7icu_3_213UnicodeString18cloneArrayIfNeededEiiaPPia+0xa5)[0 xf725e701] /opt/IBM/InformationServer/Server/DSComponents/lib/libicuuc.so.3 2(_ZN7icu_3_213UnicodeString9doReplaceEiiPKtii+0xa8)[0xf725e162] /opt/IBM/InformationServer/Server/DSComponents/lib/libicui18n.so .32(_ZN7icu_3_213MessageFormat12applyPatternERKNS_13UnicodeStrin gER11UParseErrorR10UErrorCode+0x426)[0xf7315d80] /opt/IBM/InformationServer/Server/DSComponents/lib/libicui18n.so .32(_ZN7icu_3_213MessageFormat12applyPatternERKNS_13UnicodeStrin gER10UErrorCode+0x19)[0xf7315955] /opt/IBM/InformationServer/Server/DSComponents/lib/libicui18n.so .32(_ZN7icu_3_213MessageFormatC1ERKNS_13UnicodeStringER10UErrorC ode+0xe9)[0xf73148d3] /opt/IBM/InformationServer/Server/DSComponents/lib/libicui18n.so .32(_ZN7icu_3_213MessageFormat6formatERKNS_13UnicodeStringEPKNS_ 11FormattableEiRS1_R10UErrorCode+0x2b)[0xf7317009] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN21APT_ResourceBundleRep12formatStringERKN7icu_3_213UnicodeS tringEP15APT_Formattablei+0x114)[0xf74eaf70] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN21APT_ResourceBundleRep24getFormattedOutputStringERK10APT_S tringP15APT_FormattableiRNS_9ParsedKeyE+0xdc)[0xf74ee3f8] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN21APT_ResourceBundleRep12issueMessageEiRK10APT_StringP15APT _FormattableiRN9APT_Error12SourceModuleES7_PKci+0x72)[0xf74ef54e ] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN21APT_ResourceBundleRep12issueMessageEiRK10APT_StringP15APT _FormattableiPvRN9APT_Error12SourceModuleEPKci+0x32)[0xf74ef926] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN18APT_ResourceBundle12issueMessageEiRK10APT_StringP15APT_Fo rmattableiPvRN9APT_Error12SourceModuleEPKci+0x35)[0xf74ef961] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN20APT_FileMessageStore5storeERK11APT_UStringb+0x1e5)[0xf74b 7219] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN20APT_FileMessageStore5storeERK22APT_ErrorConfigurationRKNS 0_8SLPlayerERKN24APT_ErrorConfigMapObject8ECMValueERKNS0_9TimeSt ampERK11APT_UStringN9APT_Error13ErrorSeverityEjSF_SF_+0x49)[0xf7 4c0529] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN22APT_ErrorConfiguration19outputPlayerMessageERKNS_8SLPlaye rERKNS_9TimeStampERK11APT_UStringN9APT_Error13ErrorSeverityEjS8_ S8_+0x7f)[0xf74bd097] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN22APT_ErrorConfiguration13defaultRouterERKNS_9TimeStampERK1 1APT_UStringN9APT_Error13ErrorSeverityEjS5_S5_+0x35)[0xf74c11dd] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN22APT_ErrorConfiguration6outputERKN9APT_Error12SourceModule ENS0_13ErrorSeverityEjRK11APT_UStringS7_+0x6b)[0xf74c1043] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN21APT_ResourceBundleRep12issueMessageEiRK10APT_StringP15APT _FormattableiRN9APT_Error12SourceModuleES7_PKci+0x1e1)[0xf74ef6b d] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN21APT_ResourceBundleRep12issueMessageEiRK10APT_StringP15APT _FormattableiPvRN9APT_Error12SourceModuleEPKci+0x32)[0xf74ef926] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o(_ZN18APT_ResourceBundle12issueMessageEiRK10APT_StringP15APT_Fo rmattableiPvRN9APT_Error12SourceModuleEPKci+0x35)[0xf74ef961] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchresourcei6 86.so(_ZN14APT_LogManager8closeLogEv+0x73)[0xf73d5e5b] /opt/IBM/InformationServer/Server/PXEngine/lib/liborchresourcei6 86.so(_ZN14APT_LogManagerD1Ev+0x2a)[0xf73d698a] /opt/IBM/InformationServer/Server/PXEngine/bin/resource_tracker[ 0x8049e3d] /opt/IBM/InformationServer/Server/PXEngine/bin/resource_tracker( main+0x189)[0x804a539] /lib/libc.so.6(__libc_start_main+0xdc)[0x3ffe8c] /opt/IBM/InformationServer/Server/PXEngine/bin/resource_tracker( __gxx_personality_v0+0x61)[0x80497ed] ======= Memory map: ======== 003cc000-003e6000 r-xp 00000000 fd:00 39486435 /lib/ld-2.5.so 003e6000-003e7000 r--p 00019000 fd:00 39486435 /lib/ld-2.5.so 003e7000-003e8000 rw-p 0001a000 fd:00 39486435 /lib/ld-2.5.so 003ea000-00528000 r-xp 00000000 fd:00 39485457 /lib/libc-2.5.so 00528000-0052a000 r--p 0013e000 fd:00 39485457 /lib/libc-2.5.so 0052a000-0052b000 rw-p 00140000 fd:00 39485457 /lib/libc-2.5.so 0052b000-0052e000 rw-p 0052b000 00:00 0 00530000-00532000 r-xp 00000000 fd:00 39485464 /lib/libdl-2.5.so 00532000-00533000 r--p 00001000 fd:00 39485464 /lib/libdl-2.5.so 00533000-00534000 rw-p 00002000 fd:00 39485464 /lib/libdl-2.5.so 00536000-00549000 r-xp 00000000 fd:00 39485470 /lib/libpthread-2.5.so 00549000-0054a000 r--p 00012000 fd:00 39485470 /lib/libpthread-2.5.so 0054a000-0054b000 rw-p 00013000 fd:00 39485470 /lib/libpthread-2.5.so 0054b000-0054d000 rw-p 0054b000 00:00 0 0054f000-00574000 r-xp 00000000 fd:00 39485508 /lib/libm-2.5.so 00574000-00575000 r--p 00024000 fd:00 39485508 /lib/libm-2.5.so 00575000-00576000 rw-p 00025000 fd:00 39485508 /lib/libm-2.5.so 00664000-00715000 r-xp 00000000 fd:00 14254100 /usr/lib/libstdc++.so.5.0.7 00715000-0071a000 rw-p 000b0000 fd:00 14254100 /usr/lib/libstdc++.so.5.0.7 0071a000-00720000 rw-p 0071a000 00:00 0 0077c000-00787000 r-xp 00000000 fd:00 39485519 /lib/libgcc_s-4.1.2-20080825.so.1 00787000-00788000 rw-p 0000a000 fd:00 39485519 /lib/libgcc_s-4.1.2-20080825.so.1 007fc000-008dc000 r-xp 00000000 fd:00 4596394 /usr/lib/libstdc++.so.6.0.8 008dc000-008e0000 r--p 000df000 fd:00 4596394 /usr/lib/libstdc++.so.6.0.8 008e0000-008e1000 rw-p 000e3000 fd:00 4596394 /usr/lib/libstdc++.so.6.0.8 008e1000-008e7000 rw-p 008e1000 00:00 0 08048000-0804c000 r-xp 00000000 08:21 786808 /opt/IBM/InformationServer/Server/PXEngine/bin/resource_tracker 0804c000-0804d000 rw-p 00003000 08:21 786808 /opt/IBM/InformationServer/Server/PXEngine/bin/resource_tracker 083b7000-0845b000 rw-p 083b7000 00:00 0 [heap] f6000000-f6021000 rw-p f6000000 00:00 0 f6021000-f6100000 ---p f6021000 00:00 0 f610c000-f6200000 r--s 00000000 08:21 787172 /opt/IBM/InformationServer/Server/PXEngine/nls/message/orch_root .res f6200000-f6286000 r--s 00000000 08:21 787173 /opt/IBM/InformationServer/Server/PXEngine/nls/message/orch_ja_J P.res f6286000-f6371000 r--p 02fa1000 fd:00 4591489 /usr/lib/locale/locale-archive f6371000-f6571000 r--p 00000000 fd:00 4591489 /usr/lib/locale/locale-archive f6571000-f6573000 rw-p f6571000 00:00 0 f6573000-f7202000 r-xp 00000000 08:21 836380 /opt/IBM/InformationServer/Server/DSComponents/lib/libicudata.so .32 f7202000-f7203000 rw-p 00c8e000 08:21 836380 /opt/IBM/InformationServer/Server/DSComponents/lib/libicudata.so .32 f7203000-f7204000 rw-p f7203000 00:00 0 f7204000-f72bc000 r-xp 00000000 08:21 836362 /opt/IBM/InformationServer/Server/DSComponents/lib/libicuuc.so.3 2 f72bc000-f72c3000 rw-p 000b7000 08:21 836362 /opt/IBM/InformationServer/Server/DSComponents/lib/libicuuc.so.3 2 f72c3000-f72cb000 r-xp 00000000 08:21 836368 /opt/IBM/InformationServer/Server/DSComponents/lib/libicuio.so.3 2 f72cb000-f72cc000 rw-p 00008000 08:21 836368 /opt/IBM/InformationServer/Server/DSComponents/lib/libicuio.so.3 2 f72cc000-f72cd000 rw-p f72cc000 00:00 0 f72cd000-f73bf000 r-xp 00000000 08:21 836366 /opt/IBM/InformationServer/Server/DSComponents/lib/libicui18n.so .32 f73bf000-f73c4000 rw-p 000f1000 08:21 836366 /opt/IBM/InformationServer/Server/DSComponents/lib/libicui18n.so .32 f73c4000-f73df000 r-xp 00000000 08:21 787183 /opt/IBM/InformationServer/Server/PXEngine/lib/liborchresourcei6 86.so f73df000-f73e0000 rw-p 0001a000 08:21 787183 /opt/IBM/InformationServer/Server/PXEngine/lib/liborchresourcei6 86.so f73f9000-f7463000 r-xp 00000000 08:21 787179 /opt/IBM/InformationServer/Server/PXEngine/lib/librwtool.so f7463000-f7467000 rw-p 0006a000 08:21 787179 /opt/IBM/InformationServer/Server/PXEngine/lib/librwtool.so f7467000-f7468000 rw-p f7467000 00:00 0 f7468000-f758c000 r-xp 00000000 08:21 787194 /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o f758c000-f7590000 rw-p 00124000 08:21 787194 /opt/IBM/InformationServer/Server/PXEngine/lib/liborchcorei686.s o f7590000-f7593000 rw-p f7590000 00:00 0 f7593000-f75a1000 r-xp 00000000 08:21 787187 /opt/IBM/InformationServer/Server/PXEngine/lib/liborchmonitori68 6.so f75a1000-f75a2000 rw-p 0000d000 08:21 787187 /opt/IBM/InformationServer/Server/PXEngine/lib/liborchmonitori68 6.so f75a2000-f7f2e000 r-xp 00000000 08:21 787198 /opt/IBM/InformationServer/Server/PXEngine/lib/liborchi686.so f7f2e000-f7f4f000 rw-p 0098c000 08:21 787198 /opt/IBM/InformationServer/Server/PXEngine/lib/liborchi686.so f7f4f000-f7f6f000 rw-p f7f4f000 00:00 0 ff859000-ff86c000 rwxp 7ffffffea000 00:00 0 [stack] ff86c000-ff86e000 rw-p 7fffffffd000 00:00 0 ffffe000-fffff000 r-xp ffffe000 00:00 0 [root@Infosvr bin]#
Local fix
This fix is included in 8.0.1 fixpack 3
Problem summary
**************************************************************** USERS AFFECTED: Restart of DataStage number of times thrown glibc error although the process stops. Observed on Red Hat Linux Platform. **************************************************************** PROBLEM DESCRIPTION: Unusal message is output at running a shell for DS stop. But process stops **************************************************************** RECOMMENDATION: Apply Patch JR33271 This change is included in 8.1 Fix Pack 1. ****************************************************************
Problem conclusion
Removed local copies of APT_MachineSnapshot classes from resource_tracker and log_manager to avoid double free due to lack of proper copy constructor.
Temporary fix
Comments
APAR Information
APAR number
JR33271
Reported component name
WIS DATASTAGE
Reported component ID
5724Q36DS
Reported release
810
Status
CLOSED PER
PE
NoPE
HIPER
NoHIPER
Special Attention
NoSpecatt
Submitted date
2009-06-08
Closed date
2009-10-06
Last modified date
2010-12-09
APAR is sysrouted FROM one or more of the following:
APAR is sysrouted TO one or more of the following:
Modules/Macros
PXEngine
Fix information
Fixed component name
WIS DATASTAGE
Fixed component ID
5724Q36DS
Applicable component levels
R810 PSN
UP
[{"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"8.1","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]
Document Information
Modified date:
09 December 2010