IBM Support

The javacore for WPA or SY is generated after upgraded to IBM Tivoli Monitoring 6.3 Fix Pack 07 Service Pack 10 with JRE 8.0.6.35 on AIX 7.3.

Troubleshooting


Problem

The javacore for WPA or SY is generated after upgraded to IBM Tivoli Monitoring 6.3 Fix Pack 07 Service Pack 10 with JRE 8.0.6.35 on AIX 7.3.
This issue happens during any of the following conditions
- When reconfigure WPA and SY by tacmd config or tacmd manage  
- When WPA is started after OS reboot
- Randomly

Symptom

The javacore file is generated and the component sometimes crashes.
Regarding during WPA or SY reconfiguration, the following also printed.
 

Unhandled exception
[2023-04-28 15:13:14.404] Type=Illegal instruction vmState=0x00000000
[2023-04-28 15:13:14.404] J9Generic_Signal_Number=00000048 Signal_Number=00000004 Error_Value=00000000 Signal_Code=0000001e
[2023-04-28 15:13:14.404] Handler1=09001000A04EEE10 Handler2=09001000A04C55E8
[2023-04-28 15:13:14.404] R0=0000000000000010 R1=0000010010131480 R2=09001000A04F2B90 R3=0000000000000012
[2023-04-28 15:13:14.404] R4=0000000000000000 R5=0000000000000001 R6=0000000000000001 R7=0000000000000008
[2023-04-28 15:13:14.404] R8=00000000F5861AD0 R9=00000000F5861AD2 R10=00000000300DB7E0 R11=0C00000000000000
[2023-04-28 15:13:14.404] R12=0000000042000844 R13=000001001013C800 R14=00000000300DB770 R15=000000003000E700
[2023-04-28 15:13:14.404] R16=00000000F00234B0 R17=00000000F000F030 R18=00000000F5EF5938 R19=0000000000000000
[2023-04-28 15:13:14.404] R20=00000000F5AA0708 R21=00000000F0013700 R22=00000000F0A7F768 R23=0000000000000000
[2023-04-28 15:13:14.404] R24=0000000000000018 R25=00000000F5804D70 R26=00000000F0013700 R27=00000000F5861A78
[2023-04-28 15:13:14.404] R28=0000000000000000 R29=00000000F5861A78 R30=0000000000000001 R31=000000000000002A
[2023-04-28 15:13:14.404] IAR=090000000759DF68 LR=00000100105156A0 MSR=800000000200D032 CTR=0000000000000001
[2023-04-28 15:13:14.404] CR=4800084200000000 FPSCR=8200200000000000 XER=0000000082002000
Module=/opt/IBM/ITM/JRE/aix526/lib/ppc64/compressedrefs/libj9jit29.so
[2023-04-28 15:13:14.424] Module_base_address=09000000066B5000
[2023-04-28 15:13:14.424] Target=2_90_20210622_7763 (AIX 7.3)
[2023-04-28 15:13:14.424] CPU=ppc64 (16 logical CPUs) (0x760000000 RAM)
[2023-04-28 15:13:14.424] ----------- Stack Backtrace -----------
[2023-04-28 15:13:14.424] runCallInMethod+0x24c (0x090000000648C490 [libj9vm29.so+0x6d490])
[2023-04-28 15:13:14.424] gpProtectedRunCallInMethod__FPv+0x48 (0x090000000647C8AC [libj9vm29.so+0x5d8ac])
[2023-04-28 15:13:14.424] signalProtectAndRunGlue+0x28 (0x09000000064761AC [libj9vm29.so+0x571ac])
[2023-04-28 15:13:14.424] (0x0900000001B90744 [libj9prt29.so+0x57744])
[2023-04-28 15:13:14.424] gpProtectAndRun+0x10c (0x0900000006476310 [libj9vm29.so+0x57310])
[2023-04-28 15:13:14.424] gpCheckCallin+0x170 (0x090000000647C7F4 [libj9vm29.so+0x5d7f4])
[2023-04-28 15:13:14.424] callStaticVoidMethod+0x5c (0x09000000064D63C0 [libj9vm29.so+0xb73c0])
[2023-04-28 15:13:14.424] JavaMain+0x6a4 (0x0000010000004968 [java+0x4968])
[2023-04-28 15:13:14.424] (0x0900000000089214 [libpthreads.a+0x214])
[2023-04-28 15:13:14.424] ---------------------------------------
[2023-04-28 15:13:14.424] JVMDUMP039I Processing dump event "gpf", detail "" at 2023/04/28 15:13:14 - please wait.
[2023-04-28 15:13:14.424] JVMDUMP032I JVM requested System dump using '/opt/IBM/ITM/bin/core.20230428.151314.50266560.0001.dmp' in
response to an event
[2023-04-28 15:13:14.604]
[2023-04-28 15:13:16.004] JVMDUMP010I System dump written to /opt/IBM/ITM/bin/core.20230428.151314.50266560.0001.dmp
[2023-04-28 15:13:16.004] JVMDUMP032I JVM requested Java dump using '/opt/IBM/ITM/bin/javacore.20230428.151314.50266560.0002.txt' in response to an event
[2023-04-28 15:13:16.094] JVMDUMP010I Java dump written to /opt/IBM/ITM/bin/javacore.20230428.151314.50266560.0002.txt
[2023-04-28 15:13:16.094] JVMDUMP032I JVM requested Snap dump using '/opt/IBM/ITM/bin/Snap.20230428.151314.50266560.0003.trc' in response to an event
[2023-04-28 15:13:16.194] JVMDUMP010I Snap dump written to /opt/IBM/ITM/bin/Snap.20230428.151314.50266560.0003.trc
[2023-04-28 15:13:16.194] JVMDUMP032I JVM requested JIT dump using '/opt/IBM/ITM/bin/jitdump.20230428.151314.50266560.0004.dmp' in response to an event
[2023-04-28 15:13:16.194] JVMDUMP051I JIT dump occurred in 'main' thread 0x000000003000E700
[2023-04-28 15:13:16.194] JVMDUMP010I JIT dump written to /opt/IBM/ITM/bin/jitdump.20230428.151314.50266560.0004.dmp
[2023-04-28 15:13:16.194] JVMDUMP013I Processed dump event "gpf", detail "".
[2023-04-28 15:13:16.244] #
Users Affected

 

Cause

This issue is caused by JRE APAR
IJ34951: NEGATIVE OFFSET CAUSED ILLEGAL INSTR BY ASSEMBLER

Environment

AIX 7.3
This issue  is introduced in IBM Tivoli Monitoring Fix Pack 07 Service Pack 10 when Java gets upgraded to JRE 8.0.6.35 (Product Code: jr)
*********** Thu Mar 30 10:00:49 JST 2023 ******************
User: root Groups: system bin sys security cron audit
Host name : itm001     Installer Lvl:06.30.07.16
CandleHome: /opt/IBM/ITM
Version Format: VV.RM.FF.II (V: Version; R: Release; M: Modification; F: Fix; I: Interim Fix)
***********************************************************
...Product inventory
PC   PRODUCT DESC                                              PLAT    VER           BUILD           INSTALL DATE
ax   IBM Tivoli Monitoring Shared Libraries                    aix536  06.30.07.18   d2020b          20230327 1711
cq   Tivoli Enterprise Portal Server                           aix536  06.30.07.12   d6350a          20230323 1329
cw   Tivoli Enterprise Portal Browser Client                   aix536  06.30.07.12   d6350a          20230323 1326
gs   IBM GSKit Security Interface                              aix526  08.00.55.17   d2018a          -
hd   Warehouse Proxy                                           aix536  06.30.07.09   d2020b          20230327 1711
ii   IBM Installation Manager                                  aix533  01.92.01.00   d2018a          20230327 1712
iu   IBM HTTP Server                                           aix536  08.55.16.00   d6276a          20230327 1737
iw   IBM Tivoli Enterprise Portal Server Extensions            aix536  08.55.16.00   d6276a          20230327 1736
jr   Tivoli Enterprise-supplied JRE                            aix523  08.06.35.00   202109131352    -
jr   Tivoli Enterprise-supplied JRE                            aix526  08.06.35.00   202109131352    -
kf   IBM Eclipse Help Server                                   aix533  06.30.07.00   d6276a          20230323 1329
ms   Tivoli Enterprise Monitoring Server                       aix536  06.30.07.11   d6350a          20230323 1322
sh   Tivoli Enterprise Monitoring SOAP Server                  aix536  06.30.07.10   d6350a          20230323 1322
sy   Summarization and Pruning Agent                           aix536  06.30.07.10   d2020b          20230327 1711
t1   File Transfer Enablement                                  aix536  07.30.00.00   20100000-0000   -
ue   Tivoli Enterprise Services User Interface Extensions      aix536  06.30.07.11   d2020b          20230327 1712
ui   Tivoli Enterprise Services User Interface                 aix536  06.30.07.16   d2020b          20230327 1712

Resolving The Problem

Upgrade to JRE 8.0.8 later

IBM Tivoli Monitoring V6 JRE Update (6.X.X-TIV-ITM_JRE_CANDLEHOME-20230628)
www.ibm.com/support/pages/ibm-tivoli-monitoring-v6-jre-update-6xx-tiv-itmjrecandlehome-20230628

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB45","label":"Automation"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSTFXA","label":"Tivoli Monitoring"},"ARM Category":[{"code":"a8m3p000000hBXPAA2","label":"ITM Warehouse Proxy\/Summarization \u0026 Pruning\/TDW"}],"ARM Case Number":"TS012581846","Platform":[{"code":"PF002","label":"AIX"}],"Version":"6.3.0"}]

Document Information

Modified date:
20 June 2023

UID

ibm17004579

Page Feedback