IBM Support

IBM Securiy Guardium Enterprise Load Balancer unavailable - Too many connections

Troubleshooting


Problem

When you run the grdapi get_load_balancer_load_map command on your Central Manager (CM), you get the following error:
ERROR : Load Balancer is Disabled

Symptom

You configure and activate Enterprise Load Balance (ELB), then, you are told to gather the load balancer map by running this CLI command:
grdapi get_load_balancer_load_map
After that, you get this error message:
ERROR : Load Balancer is Disabled
You restart 1 or more services ("restart gui", "restart stopped services") or reboot the appliance.
Then, you repeat the process but this time it works, time after you try again and the problem reappears.
You notice that the error occurs in different time intervals between minutes or hours.

Cause

ELB Requires some active connections to the internal database of the CM. Each Collector needs a connection to exchange information, also, some other features (like audit processes, reports) need a connection.
Keep in mind this point:
The more activities, the more connections are required.
If you are managing a huge environment, then the default connection value might ot work for you.

Diagnosing The Problem

The problem is related to the number of active connections on the CM, the number of connected Collectors might be the reason.
In order to validate if you are facing this issue, check this log:

  • dataSec_java.log
In order to gather it, you need a FILESERVER session, try this:
on the CM CLI -> fileserver <YOUR PC IP> 3600then, go to this path:

https://<APPLIANCE IP>:8445/log/opt-ibm-guardium-log/

Finally, take the most recent file. You might see some old files with a timestamp along with the same name, but the most recent is the one you need.

Now, once you have downloaded that file, use any text editor of your preference and look for this part of the log:
 

2021-07-09 22:01:15,611 ERROR [GuardiumScheduler_Worker-4] com.guardium.log.job

 - Unexpected problem when connecting to: 'guard_local'.: Data source rejected establishment of connection,  message from server: "Too many connections"org.apache.torque.TorqueException: Unexpected problem when connecting to: 'guard_local'.: Data source rejected establishment of connection,  message from server: "Too many connections"TorqueException: Unexpected problem when connecting to: 'guard_local'.: Data source rejected establishment of connection,  message from server: "Too many connections"org.apache.torque.Torque.getConnection(Torque.java:1171)

com.guardium.utils.Utils.executeUpdateSqlinTurbine(Utils.java:1064)

Resolving The Problem

In order to remediate this issue, follow these steps on the CM CLI:
  • Validate the current MAX VALUE for MySQL connections:
    • show mysql_max_connections
    • The default value is: 1500
  • If you have the default value, then increase it:
    • store mysql_max_connections 4500
  • Finally, restart these services:
    • restart stopped services
    • support clean servlets
NOTE:
If the problem persists after that, open a support case so IBM Guardium™ Support can provide you further assistance

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB24","label":"Security Software"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSMPHH","label":"IBM Security Guardium"},"ARM Category":[{"code":"a8m0z000000Gp0JAAS","label":"APPLIANCE"},{"code":"a8m0z0000001iWJAAY","label":"STAP-\u003EELB"}],"ARM Case Number":"TS006178280","Platform":[{"code":"PF004","label":"Appliance"}],"Version":"11.0.0"}]

Document Information

Modified date:
24 June 2022

UID

ibm16526444

Page Feedback