Native Spark engine

Introduction to native Spark engine
Native Spark engine is a compute engine in IBM® watsonx.data. You can use native Spark engine to submit applications that involves complex analytical operations.
Provisioning native Spark engine
IBM watsonx.data allows you to provision native Spark engine to run complex analytical workloads.
Managing native Spark engine details
In IBM watsonx.data, you can view and edit the details of a native Spark engine. You can also manage user access and monitor the status of the applications that are submitted.
Submitting Spark application by using native Spark engine
You can submit a Spark application by running a CURL command. Complete the following steps to submit a Python application.
Spark labs - Development environment
Spark lab is a Spark-based development environment that enables you to interactively program, debug, submit, and test Spark applications on a Spark cluster running on the Spark engine. It is available as a Visual Studio Code extension and you can install it in your local system to access Spark IDE using Visual Studio Code. It reduces the time for development and increases usability.

Parent topic: Working with Spark