PH20354: MQ AMS ZOS: CSQ0615E CSQ0DLCL AMS POST/WAIT REQUEST FAILED, REASON 000000CA OR 0000012E. JOBS MAY HANG.

Obtain the fix for this APAR.

APAR status

• Closed as program error.

Error description

• Multiple batch jobs are putting / getting messages from queues
  protected with AMS policies
  
  Intermittently, the Advanced Message Security (AMS) and/or
  Channel Initiator (CHIN) joblog may contain some combination of
  the following messages:
  
  CSQ0615E CSQ0DLCL AMS post/wait request failed, reason 000000CA
  CSQ0615E CSQ0DLCL AMS post/wait request failed, reason 0000012E
  
  CSQ0215E CSQ0CPUT Message protection failed return code
  15728646, reason 00000000
  CSQ0216E CSQ0CGET Message unprotection failed return code
  15728646, reason 00000000
  CSQ0217E CSQ0CGET Failed to process object 'not available'
  CSQ0209E CSQ0CMDQ Message for  <queue name> sent to error
  queue, MQRC=2063 (MQRC_SECURITY_ERROR)
  CSQX548E CSQXRESP Messages sent to local dead-letter queue,
  channel <channel-name>,  reason=2063 (MQRC_SECURITY_ERROR)
  
  The 000000CA and 0000012E return codes indicate a failure to
  get the CTLLOCK. 12E is for POST, and CA is for WAIT.
  
  Return code 15728646 = hex 00F60006 = CSQ0_CTL_LOCK_TIMEOUT.
  
  The jobs getting or putting the messages may hang. For
  instance, a job may sit in an MQGET wait beyond the
  WaitInterval, and the application has to be cancelled.
  
  This problem is related to internal defect 221801.
  

Local fix

Problem summary

• ****************************************************************
  * USERS AFFECTED: All users of IBM MQ for z/OS Version 9       *
  *                 Release 1 Modification 0 and Release 2       *
  *                 Modification 0.                              *
  ****************************************************************
  * PROBLEM DESCRIPTION: Various problems when applications of   *
  *                      varying dispatch priority and/or WLM    *
  *                      class concurrently access queues        *
  *                      protected by AMS policies.              *
  *                      Symptoms can include:                   *
  *                      - CSQ0615E CSQ0DLCL AMS post/wait       *
  *                        request failed, reason 000000CA       *
  *                      - CSQ0615E CSQ0DLCL AMS post/wait       *
  *                        request failed, reason 0000012E       *
  *                      - CSQ0215E CSQ0CPUT Message protection  *
  *                        failed return code 15728646,          *
  *                        reason 00000000                       *
  *                      - CSQ0216E CSQ0CGET Message             *
  *                        unprotection failed return code       *
  *                        15728646, reason 00000000             *
  *                      - CSQ0217E CSQ0CGET Failed to process   *
  *                        object 'not available'                *
  *                      - High CPU usage                        *
  *                      - Applications delays or hangs          *
  ****************************************************************
  While manipulating the chain of AMS requests, application and
  AMS tasks are serialised using a lock on the CTLAREA.
  When the lock is already held, application tasks loop for up to
  5 seconds waiting for the lock to become available.
  In a busy system it is possible that TCBs from applications can
  loop, preventing a lower priority task that holds the lock from
  being dispatched in order to release the lock.
  

Problem conclusion

• The locking code is changed to suspend briefly while waiting for
  the lock to be available, allowing other tasks to be dispatched.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

  UI75114 UI75115

Modules/Macros

• CSQ0DPCS CSQ0KRPT CSQ0KRUP
  

Fix information

• Fixed component name

  IBM MQ Z/OS V9

• Fixed component ID

  5655MQ900

Applicable component levels

• R100 PSY UI75115

     UP21/05/29 P F105 ¢

• R200 PSY UI75114

     UP21/05/29 P F105 ¢

Fix is available

• Select the PTF appropriate for your component level. You will be required to sign in. Distribution on physical media is not available in all countries.