IBM Support

How to extend the time the Spark kernel can be idle

Question & Answer


Question

In the Spark runtime, the kernel is removed due to a timeout after 30 minutes of inactivity. Is it possible to extend this time?

Answer

A project administrator can specify additional configurations for Analytics Engine Powered by Apache Spark. Editable configurations are listed in the documentation below for your reference. The "kernelCullTime" in this list is the configuration for the time until the kernel is removed.
For example, if you want to change the time until the kernel is removed to 60 minutes, you can change it with the following command.
oc patch AnalyticsEngine analyticsengine-sample --type merge --patch '{"spec": {"serviceConfig":{"kernelCullTime":60}}}'
Other configurations can be changed in the same format.

[{"Type":"MASTER","Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSHGYS","label":"IBM Cloud Pak for Data"},"ARM Category":[{"code":"a8m3p000000hBziAAE","label":"Analytics Engine"}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"4.5.4;4.6.6"}]

Document Information

Modified date:
27 May 2023

UID

ibm16999045