IT30041: BACKUP DB2 HANG WITH ERROR GSKKM_ERR_DATABASE_OPEN

APAR status

• Closed as program error.

Error description

• Spectrum protect client API backup db2 may hang, the error
  GSKKM_ERR_DATABASE_OPEN show in dsierror.log,
  example:
  08/06/2019 14:40:51 ANS1579E GSKit function GSKKM_OpenKeyDb
  failed with 6: GSKKM_ERR_DATABASE_OPEN
  ...
  
  Diagnostics:
  api service trace example:
  
  08/06/2019 14:39:52.021 [005378] [3429508992] :
  GSKKeymanager.cpp   ( 278): ENTER =====>
  GSKKeymanager::lockKeyDb
  08/06/2019 14:39:52.021 [005378] [3429508992] : psfilelock.cpp
  ( 157): ENTER =====> psFileLock::createLockFile
  08/06/2019 14:39:52.021 [005378] [3429508992] : psfilelock.cpp
  ( 227): (psFileLock::createLockFile): open(
  /opt/tivoli/tsm/client/api/bin64/passdir/Nodes/DB2NODE/spclicert
  .lock) failed with errno: 13 (Permission denied)
  08/06/2019 14:39:52.021 [005378] [3429508992] : psfilelock.cpp
  ( 157): EXIT  <===== psFileLock::createLockFile
  08/06/2019 14:39:52.021 [005378] [3429508992] :
  GSKKeymanager.cpp   ( 302): GSKKeymanager::lockKeyDb(): Can't
  create lock file
  '/opt/tivoli/tsm/client/api/bin64/passdir/Nodes/DB2NODE/spclicer
  t.lock'.
  ...
  
  08/06/2019 14:44:35.557 [011521] [3536689024] : gskkmlib.cpp
  ( 683): GSKKMlib::gskkmOpenKeyDb key db is
  busy, will retry (#346) in 100ms...
  08/06/2019 14:44:35.692 [011521] [3536689024] : gskkmlib.cpp
  ( 683): GSKKMlib::gskkmOpenKeyDb key db is
  busy, will retry (#347) in 100ms...
  08/06/2019 14:44:35.813 [011521] [3536689024] : gskkmlib.cpp
  ( 683): GSKKMlib::gskkmOpenKeyDb key db is
  busy, will retry (#348) in 100ms...
  08/06/2019 14:44:35.941 [011521] [3536689024] : gskkmlib.cpp
  ( 683): GSKKMlib::gskkmOpenKeyDb key db is
  busy, will retry (#349) in 100ms...
  ...
  08/06/2019 14:52:11.712 [015046] [1086535552] : gskkmlib.cpp
  ( 683): GSKKMlib::gskkmOpenKeyDb key db is
  busy, will retry (#1499) in 100ms...
  08/06/2019 14:52:11.837 [015046] [1086535552] : gskkmlib.cpp
  ( 683): GSKKMlib::gskkmOpenKeyDb key db is
  busy, will retry (#1500) in 100ms...
  08/06/2019 14:52:11.954 [015046] [1086535552] : gskkmlib.cpp
  ( 693): GSKKMlib::gskkmOpenKeyDb Open KeyDb
   (/opt/tivoli/tsm/client/api/bin64/passdir/Nodes/DB2NODE/spclice
  rt.kdb) failed. Reason(GSKKM_ERR_DATABASE_OPEN) - rc(6)
  08/06/2019 14:52:11.954 [015046] [1086535552] : gskkmlib.cpp
  (1144): ENTER =====> GSKKMlib::setLastGskkmError
  
  
  Initial Impact: High
  IBM Spectrum Protect Versions Affected:
    Above Spectrum Protect API 7.1.8 or  8.1.2 on Unix
  
  
  Additional Keywords:
  TS002402293,  spectrum protect, backup db2 hang, db2
  

Local fix

• correct directory and file permissions, make sure db2 instance
  owner have read/write permissions to password files, cert files,
   password directory and all subdirectories under the password
  directory. or config a new passwordir refer to a new directory,
  change db2 instance as owner of the directory, re-run dsmapipw
  as db2 instance owner user
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * Backup-archive client versions 7.1 and 8.1 running on all    *
  * platforms                                                    *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * see ERROR DESCRIPTION                                        *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * This issue is fixed in the backup-archive client versions    *
  * 7.1.8.8, 8.1.9.1 and 8.1.10 on all platforms.                *
  * Note 1: This is subject to change at the discretion of IBM.  *
  ****************************************************************
  

Problem conclusion

• Backup-archive  client will not hang or delay the operation.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Modules/Macros

• dsmc
  

Fix information

• Fixed component name

  TSM CLIENT

• Fixed component ID

  5698ISMCL

Applicable component levels