Spark application performance tuning

Use performance tuning methodologies and approaches to enhance Spark application performance in your cluster.

This section describes various aspects, such as JVM flags, Spark properties, and coding practices, in tuning Spark applications that are used with IBM® Spectrum Conductor. Before tuning your applications, familiarize yourself with the basics of Spark tuning. For details on tuning Spark, see Spark documentation.

While tuning, ensure that you monitor application behavior to determine the effect of tuning actions. For information on monitoring applications, see Monitoring Spark applications.