IBM Support

JDBC_03

Troubleshooting


Problem

This issue occurs when the JDBC Connection String provided in the stage configuration does not correspond to a JDBC driver class that StreamSets Transformer for Spark can automatically detect. StreamSets Transformer for Spark can automatically detect drivers for the following databases:

  • Apache Derby

  • IBM DB2

  • Microsoft SQL Server

  • MySQL

  • Oracle

  • PostgreSQL

  • Teradata

If you are using a JDBC URL that corresponds to one of these databases and still encounter the error, ensure that the connection string is correctly formatted.

For other databases, or if you are using a custom JDBC driver, Transformer for Spark cannot automatically detect the driver class. In such cases, you must manually specify the JDBC driver class name.

Symptom

The error may appear in JDBC stages when attempting to connect to a database. The error message indicates that StreamSets Transformer for Spark is unable to auto-detect the appropriate JDBC driver for the specified JDBC Connection String.

Resolving The Problem

  1. Identify the JDBC Driver Class Name:

    • Determine the JDBC driver class name associated with your database. This information is usually available in the database’s documentation or from the JDBC driver provider.

  2. Upload the Custom JDBC Driver:

    • Download the JDBC driver JAR file from your database provider.

    • In the Transformer for Spark pipeline, navigate to the JDBC stage where the error occurs.

    • Upload the driver JAR file to the stage.

  3. Manually Specify the JDBC Driver Class:

    • Go to the "Advanced" tab in the stage configuration.

    • In the JDBC Driver dropdown, select "Bundle Custom Driver".

    • Enter the fully qualified JDBC Driver Class Name (e.g., com.amazon.redshift.jdbc42.Driver for Amazon Redshift).

  4. Restart Transformer for Spark:

    • After uploading the custom JDBC driver, restart StreamSets Transformer for Spark to apply the changes. This step is necessary for the new driver to be recognized by the Transformer.

  5. Validate the Connection:

    • After specifying the driver class name and restarting Transformer for Spark, validate the pipeline to ensure your JDBC stage is now able to establish a connection with your database.

Example: Configuring the JDBC Driver for Amazon Redshift

If you are using Amazon Redshift and encounter the JDBC_03 error, follow these specific steps:

For more details on configuring JDBC stages, refer to the official StreamSets Transformer for Spark documentation:

https://docs.streamsets.com/portal/transformer/latest/help/transformer/Origins/JDBC.html#concept_htm_f5y_vgb

Document Location

Worldwide

[{"Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSZUHT0","label":"IBM StreamSets Transformer for Spark"},"ARM Category":[{"code":"","label":""}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)"}]

Document Information

Modified date:
15 March 2025

UID

ibm17186193

Page Feedback