IT34072: HIGH MEMORY USAGE DUE TO KUBERNETES SERVICES

APAR status

• Closed as program error.

Error description

• Starting with IBM Spectrum Protect Plus version 10.1.6, backup
  of Amazon Elastic Compute Cloud (EC2) workload is possible.
  To
  do that, Kubernetes (k8s) services have been added to the IBM
  Spectrum Protect Plus host.
  These services need resources to
  operate that can restrict available system memory and, if the
  IBM Spectrum Protect Plus host was not sized according to the
  blueprints, this can interfere with normal operations causing
  slowness or hangs.
  This unexpected memory usage can for example
  be seen using the following command :
  sudo top -b -n 3 -o
  %MEM
  
  IBM Spectrum Protect Plus Versions Affected:
  IBM Spectrum
  Protect Plus 10.1.6
  
  Initial Impact: Medium
  
  Additional
  Keywords: SPP, SPPLUS, TS003861069, high, memory, usage,
  resources
  

Local fix

• 1. increase system's memory to at least meet the requirements
  but tuning might be needed to add more until the system behaves
  as expected.
  or
  2. disable the k8s services if Amazon EC2
  backups are not used or planned with the following commands :
  
  sudo systemctl stop k8s-plugins
   sudo systemctl disable
  k8s-plugins
   sudo touch /opt/SPP/spp-k8s/reset_cluster
   sudo
  kubeadm reset -f
  
  If needing to enable these again, use :
   sudo
  rm /opt/SPP/spp-k8s/reset_cluster
   sudo systemctl enable
  k8s-plugins
   sudo systemctl start k8s-plugin
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * IBM Spectrum Protect Plus Level 10.1.6                       *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See ERROR DESCRIPTION                                        *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * This problem is currently projected to be fixed IBM Spectrum *
  * Protect Plus Level 10.1.6 ifix3 and 10.1.7, Note that this   *
  * is subject to change at the discretion of IBM.               *
  ****************************************************************
  

Problem conclusion

• This problem has been fixed by adding configuration to limit the
  memory used by  kubernetes services.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  SP PLUS

• Fixed component ID

  5737SPLUS

Applicable component levels