IBM Support

Migration guide for legacy IDoc Extract/Load Stage to CP4D IDoc connector

Preventive Service Planning


Abstract

This document guides the user to perform migration from legacy IDoc Extract/Load Stage to unified IDoc connector in CP4D environment, if migration is possible. Only jobs compatible with the new SCAPI IDoc connector features are subject for the potential automated migration

Content

Support Statement
This section describes the parameters that can or cannot be migrated from the legacy IDoc Extract/Load Stage to CP4D IDoc connector.
Properties Group
Feature/Properties
Legacy IDoc Extract Stage Support
CP4D IDoc Extract Support
Feature Migration feasibility
Idoc Listener Settings (DS Admin tool)
IDoc Listener Program ID
Stores the logical system used for IDoc listener for receiving IDocs.
Supported
This property is applicable for migration
Gateway Host
Provides the address of GW Server
Supported
Supported in migration
Gateway Service/ System Number
Provides the Gateway service like sapgw00 (in this case there must be service entry available in host file, refer -  https://www.ibm.com/docs/en/iis/11.5?topic=reference-configuring-sap-dispatchgateway-service) or user can directly provide the system number that is., 00 /
IDoc connector supports both GW service and system number
Supported in migration
Gateway Router String
Provides the router string to be used while connecting to remote SAP server.
Supported
Supported in migration
Acknowledge idoc reception to SAP
When selected, user can send status messages to the SAP application system when IDocs are received
Supported
This property is supported and applicable for migration in CP4D.
Number of Servers for this connection
User can specify the number of IDoc listener instances that must be opened to receive IDocs from SAP.
Supported
Supported in migration
Listen for incoming IDocs on this connection
If selected, this option indicates that the connection is enabled for use with IDoc Extract, or IDoc Load stages and receive the IDocs from SAP.
If not selected, the other controls on the IDoc Listener Settings page and DataStage Job Options for IDocs page are disabled
Not supported – IDoc listener settings are no more associated with connection in CP4D due to intermittent IDoc listener. IDoc listener automatically comes up for specified time at job start and close with completion of job. 
This property is not required due to implementation of intermittent server in CP4D IDoc connector. Hence, not applicable for migration.
DataStage Job options (DS admin tool)
Run appropriate IDoc job automatically after receiving IDocs from this SAP connection
Supported- based on this option and configuring the IDoc for a given job it starts execution after receiving IDocs
Not supported
In CP4D IDoc connector, IDocs are received synchronously during job runtime. Hence this feature is not applicable for migration.
Idoc Version (configure in DS admin tool)
Configure an Idoc (SAP Version)
Supported – IDoc can be searched and configured based on SAP Version that can be selected from a dropdown
Supported – IDoc can be searched and configured based on SAP Version that can be selected from a dropdown
The property is applicable for migration in CP4D IDoc Connector.
Automatic Clear IDoc Log (DS admin tool)
Automatically clears the IDoc listener logs after specified buffer size
Clean-up IDoc logs when the specified buffer size is reached.
Not supported
Not supported since no separate logging is implemented for IDoc listener in CP4D IDoc connector.
Buffer Size (DS admin tool)
Specifies the buffer size for IDoc listener logs clean-up
Specifies the size in MB for automatic clean-up of IDoc listener logs
Not supported
Not supported since no separate logging is implemented for IDoc listener in CP4D IDoc connector.
Connections
Establishing connection through Admin tool by using Logical system and Partner number
Does not require any additional tool for adding a connection between SAP and Connector
All the connection parameters available in legacy IDoc Stages are available in CP4D after job migration. [For all types of connection]
Execution Mode
Uses Parallel/Sequential Mode
Can support both Parallel/Sequential Modes.
The IDoc Extract connector has implemented partitioning support that allows user to run the migrated job in multiple runtime engine instance pods. So, parallelism support can be migrated.
Idoc Type
Stores the selected IDoc Type for given job
Supported
This property is supported and applicable for migration in CP4D.
Idoc Type Description
Stores the description of selected IDoc type. Auto-Populate when IDoc type selected by user
Not supported: Not a stage level property and no provision provided in asset browser to display this value.
This property is not applicable for migration in CP4D due to the unavailability of this field on UI.
Idoc Data Directory Path
This option is used to generate and store IDoc data or to read IDoc data files when the SAP R/3 system is not available.
Not supported
Since offline IDoc processing is not supported in CP4D, this property is not applicable for migration.
Idoc Components
Segments (Control record or child or grandchild) selection
Supported – select the segments for a given IDoc (hierarchy Idoc segments)
Supported
All the Segment details like segment name and type are available in CP4D after job migration.
Properties Group
Feature/Properties
Legacy IDoc Load Stage Support
CP4D IDoc Load Support
Feature Migration feasibility
Idoc Load Settings (DS Admin tool)
Idoc Listener Partner Number
Supported- Partner number for a given SAP system is provided here that is, sender port of IDoc
Supported
Supported during migration and this property gets populated as it is from legacy stage.
Destination Partner Number
Supported-Destination partner number for a given SAP system is provided here that is, receiver port of IDoc
Supported
Supported during migration and gets populated with details that are present in legacy connection
Location of Temp Segment index files
Supported- temp files gets created under
Not supported
Not supported
Idoc Version (configure in DS admin tool)
Configure an Idoc (SAP Version)
Supported – IDoc can be searched and configured based on SAP Version that can be selected from a dropdown
Supported- User can provide the IDoc Version manually
The property is applicable for migration in CP4D IDoc Connector.
Connections
Establishing connection through Admin tool by using Logical system , Partner number and Destination Partner number
Does not require any additional tool for adding a connection between SAP and Connector
All the connection parameters available in IDoc Load Stage are available in CP4D after job migration. [For all types of connection]
Execution Mode
Uses Parallel/Sequential Mode
Can support both Parallel/Sequential Modes.
The IDoc Load connector has implemented partitioning support that allows user to run the migrated job in multiple runtime engine instance pods. So, parallelism support can be migrated.
Idoc Type
Stores the selected IDoc Type for given job
Supported
This property is supported and applicable for migration in CP4D.
Idoc Type Description
Stores the description of selected IDoc type. Auto-Populate when IDoc type selected by user
Not supported
Not supported
Idoc Data Directory Path
This option is used to generate and store IDoc data or to read IDoc data files when the SAP R/3 system is not available.
Not supported
Since offline IDoc processing is not supported in CP4D, this property is not applicable for migration.
Idoc Load Packet Size
Idoc Load Packet Size
Supported- user can provide the number of IDocs to be processed from DataStage side to SAP side in one transaction
Supported -gets displayed under
This property is applicable for migration and is  available after migration from legacy stage.
Message Type
Message type
Supported- Message type selected in connector level as per the configuration done for a given Partner number in SAP side
Supported-under IDoc Message Type field
IDoc Message type property  is migrated successfully with the value applicable in legacy stage.
Message Type Description
Stores the description of selected message type. Gets auto-Populates when message type selected by user
Not supported: Not a stage level property and no provision provided in asset browser to display this value.
This property is not applicable for migration in CP4D due to the unavailability of this field in UI.
Idoc Components
Segments (Control record or child or grandchild) selection
Supported – select the segments for a given IDoc (hierarchy idoc segments)
Supported- provide the segment name and type in the field for a given link or gets auto populated if designed from asset browser
All the Segment details like segment name and type are available in CP4D after job migration [as in legacy job]
Enable file-based IDoc processing
Enables file-based processing for Idocs
Supported- Enables the file-based processing for IDocs instead of in-memory
Not Supported- Only in-memory processing is supported in CP4D
Not supported
Prerequisites
Correct ISX file must be created for the user before importing this to CP4D environment. User need to make sure to create the proper isx based on scenario to be checked.
Migrating the IDoc Extract/Load job
Create an ISX file from a compliable and runnable IDoc Extract/load job created in DataStage Designer Client. Use ISTOOL for creation and exporting of ISX file. For detailed instructions on the steps involved, refer

 Export command for InfoSphere DataStage and QualityStage assets and

 How to use ISTOOL for EXPORT IMPORT Information Server Components..

Note: Make sure that the ISX file export includes all dependencies, such as parameter sets and table definitions.
Here’s a sample command :

istool export -dom DELVM04S02:9443 -u isadmin -p isadmin -ar /idoc_load/IDOC_Load_SNC_Load_Balancing_GUI_016.isx -ds 'DELVM04S02/dstage1/Jobs/Idoc_Legacy_CP4D_Migration/IDOC_Load_SNC_Load_Balancing_GUI_016.pjb'
 
If the IDoc Extract/load Stage job is designed to use Parameter or Parameter Sets in job, ensure that you use the switch -includedependent in the command line tool.
Then, command to create ISX file shall be modified:

istool export -dom DELVM04S02:9443 -u isadmin -p isadmin -ar /idoc_load/IDOC_Load_SNC_Load_Balancing_GUI_016.isx -ds 'DELVM04S02/dstage1/Jobs/Idoc_Legacy_CP4D_Migration/IDOC_Load_SNC_Load_Balancing_GUI_016.pjb -includedependent'
Importing and executing the migrated job in canvas
  • Import the ISX file:
    • Open an existing project or create a new Project in the CP4D canvas. (Refer screenshot for existing project)
      image 12873
    • From the Assets tab of the project, click New asset, then select the DataStage tile.image 12874
      image 12875

    • On the ISX file import tab, click Upload .isx file. Browse to the file that you want to import and click Import.
      image 12872
    • Validate the Import summary to validate if the isx is imported successfully or not.
      image 12871
    • If you try to import .isx files for IDoc jobs where migration is not supported, the import will FAIL or IMPORT with WARNINGS as demonstrated in screenshots:image 12877

      image 12878

    • If the UI displays Status as skipped, scroll to Left pane, and click Download the CSV option to download CSV file. This file gives detailed information on the error cause during import.
  • Compile and execute the imported job.image 12879

    image-20221215163517-15
  • If the export did not pick up the specific values for the parameters of hostname or port number from the original job, you must manually specify the information in the job settings

    One such example is Router String field (Needed if SAP system is not hosted on cluster where we execute the job).If this is not provided by user in legacy designed job, it appears blank in imported job leading to Test Connection failure.

image-20221215163134-12

You must manually provide the Router string value for correct behavior.

image-20221215163134-13

Limitation and Workarounds

This section describes the cases where a complete or automatic migration of IDoc stage is not possible or manual intervention is required to execute the migrated job.
  1. Legacy jobs designed with multi-node configuration
    The jobs that are designed in legacy DataStage with parallelism support and making use of multi-node configuration using .apt files won’t be able to execute in the CP4D environment.
    Workaround: Remove the APT_CONFIG_FILE environment variable from the IDoc Stage or point it to a relevant .apt file in the CP4D env.

[{"Type":"MASTER","Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSDTJL","label":"IBM DataStage Enterprise for IBM Cloud Pak for Data"},"ARM Category":[{"code":"a8m0z000000GoyHAAS","label":"Tutorials"}],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions"}]

Document Information

Modified date:
24 November 2023

UID

ibm16848233