Loading data

Data ingestion is the process of importing and loading data into watsonx.data.

Loading or ingesting data
You can use the Ingestion jobs tab from the Data manager page to securely and easily load data into watsonx.data console.
Ingesting data by using the web console
You can ingest data into watsonx.data by using the web console.
Advanced options to customize configmap for ingestion
Users can customize the configmap settings to adjust the CPU and memory value. When you run an ingestion job, parameters that control the number of CPUs and the size of memory that is allocated can be specified.
Options and parameters supported in ibm-lh tool
Ingesting data files from S3 or local location into watsonx.data is done by using two options that are supported in ibm-lh tool.
Ingesting data by using the CLI
You can ingest data into watsonx.data by using the Command Line Interface (CLI).
Creating an ingestion job by using the configuration file
You can run the ibm-lh tool to ingest data into watsonx.data through the CLI. The config file to run the ingestion job and examples are listed in this topic.
Ingesting data from object storage bucket
In this tutorial, you learn to move data into a data lake or an object storage bucket and load the data files to Presto. You learn to optimize the file format to choose the table format and run complex SQL query in watsonx.data.

Parent topic: Using the watsonx.data console