IT36195: VADP PROXY INCORRECTLY USES DOCKER IP ADDRESS. BACKUPS FAIL WITH: CTGGA2649: "FAILED TO RECEIVE STATUS UPDATES "

APAR status

• Closed as program error.

Error description

• IBM Spectrum Protect Plus Vadp proxy server incorrectly
  uses
  the Docker IP address. Backups fail with the following
  error
  seen in the job log:
  
  CTGGA2649,Backup of VM YOURVMNAME failed
  due to an unexpected error.
  Error: SPP failed to receive
  status updates from the backup process
  on proxy
  (YOURPROXY.HOST.NAME) stopped the backup of VM (YOURVMNAME)
  
  In
  the Vadp Proxy server log you may see the following
  errors:
  
  ERROR 13862 ? [pool-1-thread-5]
  c.c.v.domain.VmdkBackupConfigManager
  : Error updating
  vmbackupstatus
  org.springframework.web.client.ResourceAccessException:
  I/O
  error on POST request for
  "https://1.2.3.4/api/vsphere/vmbackups
  tatus/1234ab56-789c-0123-4567-8-dd90e123fg":
  Connect to
  1.2.3.4:443 [/1.2.3.4] failed: Connection timed out (Connection
  timed out);
  nested exception is
  org.apache.http.conn.HttpHostConnectException:
  
  In the above
  error, 1.2.3.4 is the Docker IP address. The Vadp
  Proxy server
  incorrectly tries to connect to the Docker IP address
  and this
  cases the backup to fail.
  
  Customer/Support Diagnostics (If
  Applicable): N/A
  
  Spectrum Protect Versions Affected: 10.1.7
  
  
  Initial Impact:: Low|Medium|High: LOW
  
  Additional Keywords:
  TS004918065 DOCKER CONNECTION TIMED OUT ERROR 13862
  

Local fix

• NOTE: Make sure no jobs are running before you start this
  procedure
  
  1) Stop Virgo:
  
  sudo systemctl stop virgo
  
  2) Edit
  the /opt/virgo/bin/startup.sh file and change the following
  line:
  
  export RMQ_SERVER_HOST=${RMQ_SERVER_HOST:=$(hostname -I
  | awk '{ print $1 }' )}
  
  3) Change that line to the following,
  where <spp_ip> is the IP
   of Spectrum Protect Plus appliance
  that the VADPs should
   connect back to:
  
  export
  RMQ_SERVER_HOST=<spp_up>
  
  4) Save and close the startup.sh
  file
  
  5) Start Virgo:
  
  sudo systemctl start virgo
  
  6) Once the
  Spectrum Protect Plus UI is available, the Vadp Proxy
  server(s)
  will need to be unregistered and then registered again.
  
  NOTE:
  If you Upgrade Spectrum Protect Plus before the fix is
  available,
  the above procedure will be undone. You will need to
  follow the
  steps again.
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * IBM Spectrum Protect Plus level 10.1.7.                      *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See Error Description.                                       *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply the fixing level when available. This problem is       *
  * projected to be fixed in IBM Spectrum Protect Plus level     *
  * 10.1.8. Note that this is subject to change at the           *
  * discretion of IBM.                                           *
  ****************************************************************
  

Problem conclusion

• The fix for this issue is to get the servers IP address from the
  user defined global setting instead of environment variable.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  SP PLUS

• Fixed component ID

  5737SPLUS

Applicable component levels