IBM Support

How to run multiple instances of Logstash 6.3.2 using one Logstash installation?

Troubleshooting


Problem

I have Logstash 6.3.2 from IBM Log Analysis 1.3.5.3. If I run multiple instances of Logstash 6.3.2, I get the following error:
 

[FATAL] 2020-01-02 10:10:10.732 [LogStash::Runner] runner - Logstash could not be started because there is already another instance using the configured data directory.  If you wish to run multiple instances, you must change the "path.data" setting.

[ERROR] 2020-01-02 10:10:10.745 [LogStash::Runner] Logstash - java.lang.IllegalStateException: Logstash stopped processing because of an error: (SystemExit) exit

Resolving The Problem

After you installed one Logstash remote installation, there are 2 variables needed for each instance. Modify the logstash-util.sh as follows:
1)  Add variable:
 
    logstash_data=
    logstash_conf=
  
For example, one instance can be:
 
    logstash_data="${LOGSTASH_HOME}/data1"
    logstash_conf="config/logstash-scala.conf"
  
2) Modify from:
 
    PIDTEMP=`ps ux | grep logstash | grep config/logstash-scala.conf | grep java | awk '{ print $2 }'`
  
To:

    PIDTEMP=`ps ux | grep logstash | grep ${logstash_conf} | grep java | awk '{ print $2 }'`
  
3) Add the --path.data ${logstash_data} variable as follows:
 
    nohup ${logstash_bin} --verbose -f ${logstash_conf}  --path.logs ${logstash_log} --path.settings ${logstash_path_settings} --path.data ${logstash_data} > /dev/null 2>&1 &
  
logstash_data and logstash_conf needs to be unique for every instance.

Document Location

Worldwide

[{"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Product":{"code":"SSPFMY","label":"IBM Operations Analytics - Log Analysis"},"ARM Category":[{"code":"a8m0z0000001gwtAAA","label":"Log Analysis->Third Party Components->Logstash 6.3.2"}],"ARM Case Number":"TS003587647","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"1.3.5","Line of Business":{"code":"LOB45","label":"Automation"}}]

Product Synonym

LA

Document Information

Modified date:
12 May 2020

UID

ibm16208610