Enabling GPUs
You can enable GPUs when you want to create Spark instance groups to use GPU resources for applications and have GPU monitoring available.
To enable GPUs for Spark instance groups and GPU monitoring charts and table columns in the cluster management console, you run a script on the master host. You also need to configure GPU resource groups to run the GPU workload.
Run the following script on the master host:
- To run with user interaction: # $EGO_TOP/conductorspark/2.3.0/etc/gpuconfig.sh enable
- To run without user interaction: # $EGO_TOP/conductorspark/2.3.0/etc/gpuconfig.sh enable --quiet -u <username> -x <password>
EGO is restarted on all of the hosts in the cluster with the change applied. If you chose to
not restart the cluster, you need to manually restart EGO on all the hosts in the cluster for the
change to take effect.
- You must configure GPU resource groups to run the GPU workload; see Using resource groups with GPU hosts.
- If you want to disable GPUs, run the following script on the master host :
- To run with user interaction: # $EGO_TOP/conductorspark/2.3.0/etc/gpuconfig.sh disable.
- To run without user interaction: # $EGO_TOP/conductorspark/2.3.0/etc/gpuconfig.sh disable --quiet -u <username> -x <password>