IBM Support

Amazon S3 Connector, File Connector and Cloud Object Storage Connector ORC job that use SNAPPY as compression codec fails with java.lang.ExceptionInInitializerError on Big Endian platforms

Troubleshooting


Problem

Amazon S3 Connector, File Connector and Cloud Object Storage Connector ORC job that use SNAPPY as compression codec fails with java.lang.ExceptionInInitializerError on Big Endian platforms

Symptom

 ORC job fails when using SNAPPY compression on Big Endian Platform with error message as follows:  java.lang.ExceptionInInitializerError

Cause

This is due to a limitation in the existing third-party snappy library, which does not support Big Endian Platforms.

Environment

Amazon S3 Connector, File Connector and Cloud Object Storage Connector jobs that use ORC file format with SNAPPY as compression codec on Big Endian platforms.

Resolving The Problem

The issue will be fixed in a future release when the open source libraries are updated to include the latest third-party snappy library that supports Big Endian platforms.

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"ARM Category":[{"code":"a8m50000000L12jAAC","label":"DataStage->Job Stages->File Stages->Amazon S3 Connector"},{"code":"a8m0z00000006uzAAA","label":"DataStage->Job Stages->File Stages->CloudObjectStorage Connector"}],"ARM Case Number":"","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF035","label":"z\/OS"}],"Version":"11.7.1"}]

Document Information

Modified date:
27 October 2021

UID

ibm16498077