IBM Support

MustGather: Performance monitoring infrastructure (PMI) and performance tool problems

Troubleshooting


Problem

Collecting data for problems with the WebSphere Application Server PMI and Performance Tools (for example, Tivoli Performance Viewer, Resource Analyzer, Performance Advisors). Gathering this information before calling IBM support helps familiarize you with the troubleshooting process and saves you time.

Resolving The Problem

Tab navigation

 

If you have already contacted support, continue to the component-specific MustGather information. Otherwise, click: MustGather: Read first for all WebSphere Application Server products.


PMI/Performance Tools specific MustGather information

PMI service is available in application servers and node agents in WebSphere Application Server V7.0, 8.0, 8.5, 9.0

When diagnosing problems with the PMI or related tools:
  1. Indicate what you are attempting to monitor (for example, connection pooling activity, JVMPI). Provide configuration about the component that you are monitoring. For example, if you are monitoring connection pool or data source, provide the connection pool or data source configuration.

  2. Identify tools that use PMI:
    • WebSphere Application Server provided tools: Tivoli Performance Viewer, Performance Advisor or Resource Analyzer
    • Third-party tool that interfaces with PMI, such as Wily Introscope, and so on.

  3. Identify all monitoring tools that you run in your environment that might alter the behavior of WebSphere Application Server. This includes plug-ins and applications that replace or augment the classes shipped with WebSphere Application Server.

  4. Identify any configuration changes, like adding a generic server to the configuration.

  5. Both the application server and node agent should be traced in a Network Deployment environment.

    Here are the steps for applying a trace:
    1. Start the administrative console.

    2. Click Troubleshooting > Logs and Trace in the console navigation tree, then click server > Diagnostic Trace.

    3. Select the Runtime tab.

    4. Select the Save runtime changes to configuration as well check box if you want to write your changes back to the server configuration.

    5. Change the existing trace state by changing the trace specification to the desired state.

    6. Configure the trace output if a change from the existing one is desired.

    7. Click Apply.

      For PMI apply this trace specification to the processes that you are attempting to monitor:
      com.ibm.ws.pmi.*=all:com.ibm.websphere.pmi.*=all:com.ibm.wsspi.pmi.*=all

  6. For Runtime Performance Advisor, apply this trace specification to the Application Server processes that has performance advisor enabled:
    com.ibm.ws.performance.tuning.*=all

  7. Indicate if security is enabled. If it is, provide security authentication mechanism configuration. Provide details about any firewalls that you have.

  8. Collect the following information if you are using Tivoli Performance Viewer:
    • Indicate the process to which you are connecting: Deployment manager, Application server, or Node agent.

    • Is Tivoli Performance Viewer running locally or remotely?

    • Is Tivoli Performance Viewer installed using the Custom installation option or is the full WebSphere Application Server image installed?

    • Which connector are you using, SOAP or RMI?

    • If you have connectivity issues, did you try running wsadmin? Is wsadmin able to connect using the SOAP or RMI connector?

      Follow the directions in the appropriate WebSphere Application Server product documentation to configure tracing for Application Server, node agent, administrative server, application client, and so forth (search the information center for Logging and tracing).

  9. If you are using Tivoli Performance Viewer or Resource Analyzer as the PMI client, you can trace these tools:

    Version 7.0, 8.0, 8.5, and 9.0 trace the Deployment Manager with this trace specification (enter the string as a single line):

    UI.TivoliPerformanceViewer=all:
    TivoliPerformanceViewer=all:
    com.ibm.ws.performance.tuning.*=all:
    com.ibm.ws.console.tpv.*=all:
    com.ibm.ws.tpv.*=all

  10. If you are using Request Metrics, you can trace them by using the following trace specification (enter string as a single line):

    *=info:com.ibm.ws.pmi.reqmetrics.*=all: com.ibm.websphere.pmi.reqmetrics.*=all: com.ibm.wsspi.pmi.reqmetrics.*=all: com.ibm.ws.websvcs.pmi.reqmetrics.*=all
  11. In case the ConnectionPoolStats MBean is required, please use the followiong instead of the above PMI trace string:

    *=info:com.ibm.websphere.monitor.jmx.*=all:
    com.ibm.websphere.monitor.meters.Meter*=all:
    com.ibm.websphere.monitor.meters.Counter*=all:
    com.ibm.websphere.monitor.meters.Gauge*=all:
    com.ibm.websphere.monitor.meters.StatisticsMeter=all:
    com.ibm.websphere.monitor.meters.StatisticsReading=all:
    com.ibm.ws.monitor.*=all:
    com.ibm.websphere.pmi.*=all:
    com.ibm.ws.monitors.*=all
  13. Follow instructions to send diagnostic information to IBM support.

For a listing of all technotes, downloads, and educational materials specific to the PMI/Performance tools component, search the WebSphere Application Server support site.

Additional logging information for WebSphere V8.0, 8.5, 9.0 and up

Basic mode and HPEL mode
http://publib.boulder.ibm.com/infocenter/wasinfo/v8r0/topic/com.ibm.websphere.express.doc/info/exp/ae/ctrb_HPELCompat.html

[{"Product":{"code":"SSEQTP","label":"WebSphere Application Server"},"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Component":"PMI\/Performance Tools","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF010","label":"HP-UX"},{"code":"PF016","label":"Linux"},{"code":"PF027","label":"Solaris"},{"code":"PF033","label":"Windows"}],"Version":"9.0;8.5.5;8.0;7.0","Edition":"Base;Network Deployment","Line of Business":{"code":"LOB36","label":"IBM Automation"}},{"Product":{"code":"SS7JFU","label":"WebSphere Application Server - Express"},"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Component":" ","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF010","label":"HP-UX"},{"code":"PF016","label":"Linux"},{"code":"PF027","label":"Solaris"},{"code":"PF033","label":"Windows"}],"Version":"8.5.5;8.5;8.0;7.0","Edition":"","Line of Business":{"code":"LOB45","label":"Automation"}},{"Product":{"code":"SSNVBF","label":"Runtimes for Java Technology"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Component":"Java SDK","Platform":[{"code":"","label":""}],"Version":"","Edition":"","Line of Business":{"code":"LOB36","label":"IBM Automation"}}]

Document Information

Modified date:
15 June 2018

UID

swg21141193

Page Feedback