Enabling GPUs

You can enable GPUs when you want to create Spark instance groups to use GPU resources for applications and have GPU monitoring available.

About this task

To enable GPUs for Spark instance groups and GPU monitoring charts and table columns in the cluster management console, you run a script on the primary host. You also need to configure GPU resource groups to run the GPU workload.

Procedure

Run the following script on the primary host:
  • To run with user interaction: # $EGO_TOP/conductorspark/2.3.0/etc/gpuconfig.sh enable
  • To run without user interaction: # $EGO_TOP/conductorspark/2.3.0/etc/gpuconfig.sh enable --quiet -u <username> -x <password>

Results

EGO is restarted on all of the hosts in the cluster with the change applied. If you chose to not restart the cluster, you need to manually restart EGO on all the hosts in the cluster for the change to take effect.

What to do next

  1. You must configure GPU resource groups to run the GPU workload; see Using resource groups with GPU hosts.
  2. If you want to disable GPUs, run the following script on the primary host :
    • To run with user interaction: # $EGO_TOP/conductorspark/2.3.0/etc/gpuconfig.sh disable.
    • To run without user interaction: # $EGO_TOP/conductorspark/2.3.0/etc/gpuconfig.sh disable --quiet -u <username> -x <password>