IT37809: SNAPSHOT COMPLETES WITH ERROR IF MORE THAN ONE STORAGE CLASS ANDVOLUME SNAPSHOT CLASS ARE DEFINED FOR THE SAME PROVISIONER

APAR status

• Closed as program error.

Error description

• Snapshot backup completes with errors, if user created more than
  one storage class and more than one snapshot class for the same
  provisioner:
  $ oc get storageclass
  NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE
  ALLOWVOLUMEEXPANSION AGE
  cet-csi-rbd rbd.csi.ceph.com Delete Immediate false 6d
  cirrus-csi-rbd-sc (default) rbd.csi.ceph.com Delete Immediate
  true 6d1h
  
  $ oc get volumesnapshotclass
  NAME DRIVER DELETIONPOLICY AGE
  cet-csi-rbdplugin-snapclass rbd.csi.ceph.com Delete 6d
  cirrus-csi-rbdplugin-snapclass rbd.csi.ceph.com Delete 6d1h
  
  
  SPP job log shows the following errors for snapshot backup
  operation:
     CTGGK3052    0 out of 1 snapshots succeeded.
     CTGGA2632    Backup failed for PVC cluster:namespace:pvc1:An
  unexpected error occurred during the backup.
  JSONDecodeError('Expecting value: line 1 column 1 (char 0)' )
  This error occurred while performing back up of
  PersistentVolumeClaim cluster:namespace:pvc1
  
  Container application log  shows this error for snapshot backup
  operation:
  [2021-05-27 00:35:35] DEBUG pid:1496 ThreadPoolExecutor-0_0
  getVolumeSnapshot: Get snapshot response
  'error': {'message': 'Failed to create snapshot: failed to take
  snapshot of the volume,  "rpc error: code = DeadlineExceeded
  desc = context deadline exceeded"', 'time':
  '2021-05-27T00:35:34Z'}, 'readyToUse': False}}}
  

Local fix

•  Delete extra storage classes and/or volume snapshot classes
  leaving only one storage class and volume snapshot class for
  each provisioner.
  
  Examples of an Easy workaround:
  oc delete storageclass cet-csi-rbd
  oc delete volumesnapshotclass cet-csi-rbdplugin-snapclass
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * IBM Spectrum Protect Plus level 10.1.8                       *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * see ERROR Description                                        *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply the fixing level when available. This problem is       *
  * currently projected to be fixed in IBM Spectrum Protect Plus *
  * level 10.1.8 patch1 and 10.1.9.                              *
  * Note that this is subject to change at the discretion of IBM *
  ****************************************************************
  

Problem conclusion

• Code changes were made to use different snapshot name on each
  snapshot attempt
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Modules/Macros

• Kubernet
  

Fix information

• Fixed component name

  SP PLUS

• Fixed component ID

  5737SPLUS

Applicable component levels