IBM Support

Existing jobs using File Connector, Azure Storage Connector or Snowflake Connector will abort with Pipe closed exception after installing IBM InfoSphere Information Server 11.7.1.1 Service Pack 2 and later.

Troubleshooting


Problem

Existing jobs that use File Connector, Azure Storage Connector, Snowflake Connector will abort with Pipe closed exception after installing IBM InfoSphere Information Server 11.7.1.1 Service Pack 2 and later.

Cause

Changes to the version of some of the open source libraries.

Environment

Existing jobs of File Connector, Azure Storage Connector, Snowflake Connector in IBM InfoSphere Information Server 11.7.1.1 Service Pack 2 or later.

Diagnosing The Problem

Jobs abort with the error message 
Java runtime exception occurred: java.lang.RuntimeException: java.io.IOException: Pipe closed

Resolving The Problem

Steps to be followed to make existing Snowflake connector jobs work:
Customer has to run a one time CMT tool (Connection Migration Tool) that would update all the Stage Descriptors of the existing jobs so that the jobs will not fail with ClassNotFound Exception

  • Navigate to folder <ISHOME>\Clients\CCMigrationTool on the Windows client machine
  • Take backup of the existing file StageUpgrades.xml, meaning copy the file to another location for recovery(if needed).
  • Edit the StageUpgrades.xml and add the below lines before the last line (</StageUpgrades>)
    <StageType name="SnowflakeConnectorPX"> <Set path="/Usage/Java/Classpath" contexts="all" >!DEFAULT!</Set> </StageType>
  • Close all Snowflake connector jobs in the designer.
  • Open a new command prompt, change directory to <ISHOME>\Clients\CCMigrationTool and run the below command after filling with correct values - 

CCMigration.exe -h <hostname>:<port> -u <username> -p <password> -P <project> -U
  • The command run should be successful after which all existing jobs will be updated with the correct classpath
Steps to be followed to make existing Azure Storage Connector jobs to work after upgrading to commons-io-2.8.0.jar
  •  Export all the jobs that use Azure Storage Connector
  •  Replace all the occurrences of the following string in the job export
      $(DSHOME)/../../ASBNode/lib/java/commons-io-2.4.jar;
      With the following string below,
      $(DSHOME)/../DSComponents/bin/azure;
Save the file and import the modified job export and run the jobs.
Note: The jobs must be exported in the DataStage export format (DSX)
Steps to be followed to make existing File Connector jobs work:
On the Engine tier, create a file by name FileConnector.ini in location - <ISHOME>/Server/DSComponents/bin with below contents
If the file exists, then edit it to append the following content in the relevant sections.
[connector]
[XMLProperties]
/Usage/Java/Classpath(force)=$(DSHOME)/../../ASBNode/lib/java/iis-shared.jar;$(DSHOME)/../DSComponents/bin/ccjava-api.jar;$(DSHOME)/../DSComponents/bin/ccapi.jar;$(DSHOME)/../DSComponents/bin/JISDocHandler.jar;$(DSHOME)/../../ASBNode/lib/java/commons-io-2.8.0.jar
[linkXMLProperties]
[Environment Parameter]
[System]
Note: For Information Server 11.7.1.4, set the version of the commons-io as commons-io-2.11.0.jar.

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"ARM Category":[{"code":"a8m0z000000ble2AAA","label":"DataStage-\u003EJob Stages-\u003EDatabase Stages-\u003ESnowflake Connector"},{"code":"a8m0z000000cvcDAAQ","label":"DataStage-\u003EJob Stages-\u003EFile Stages-\u003EAzure Data Connecor"},{"code":"a8m50000000L12ZAAS","label":"DataStage-\u003EJob Stages-\u003EFile Stages-\u003EFile Connector"}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"11.7.1"}]

Document Information

Modified date:
16 August 2023

UID

ibm16464355

Page Feedback