What's new in IMS Database Reorganization Expert

This topic summarizes the technical changes for this edition.

New and changed information is denoted by carets (Symbol that indicates the start of new or changed content) and (Symbol that indicates the end of new or changed content) at the beginning and end of the new or changed information. Editorial changes that have no technical significance are not noted.

Revision markers follow these general conventions:
  • Only technical changes are marked; style and grammatical changes are not marked.
  • If part of an element, such as a paragraph, syntax diagram, list item, task step, or figure is changed, the entire element is marked with revision markers, even though only part of the element might have changed.
  • If a topic is changed by more than 50%, the entire topic is marked with revision markers (so it might seem to be a new topic, even though it is not).

Revision markers do not necessarily indicate all the changes made to the information because deleted text and graphics cannot be marked with revision markers.

For more information about functional enhancements, see Changes in IMS Database Reorganization Expert 4.1.

Start of change

SC19-1137-12 (July 2024)

Description Related APARs
(Smart Reorg utility) Key label check support. Use the KEYLABELCHK statement to check whether the key labels of database data sets match the key labels defined in the RACF data set profile or SMS data class. If the key labels are different, the CRSS determines that the database requires reorganization. The following topics are added or modified: PH59280
End of change

SC19-1137-11 (June 2024)

Description Related APARs
To support the enhancement made by IMS APAR PH53287 (read STAGING option from SYSIN), description about the SYSIN DD statement is added to IPR Reload JCL requirements. N/A

SC19-1137-10 (April 2024)

Description Related APARs
Added message HPSC3722E. PH60605

SC19-1137-09 (November 2022)

Description Related APARs
(Smart Reorg utility) Support for the following new control statements:
  • CRIC control statement: Creates image copies of all database data sets or HALDB partitions even when the Conditional Reorganization Support Service (CRSS) determines that reorganization of the entire database or some partitions are not needed.
  • CRUNLOAD control statement: Creates an unload data set that contains data from the database or HALDB partitions. You can choose to create an unload data set only when the CRSS determines that reorganization is needed or every time the job is run (regardless of whether reorganization is needed).
PH41443

SC19-1137-08 (May 2022)

Description Related APARs
Updated the explanation section and the system action section of message BBE1323I. N/A
Updated topic Processing option (PROCOPT) requirements. N/A

SC19-1137-07 (August 2021)

Description Related APARs
(Smart Reorg utility) A new parameter, FORCE, is supported for the STARTDB control statement. The following topics are modified: PH36650
(DB Sensor) OSAM encryption support. Changed messages: HPSG2313W, BBE1444E PH35209 and PH29916
(Smart Reorg utility) Changed messages: HPSG0306E, HPSG0307E PH35323
Support for IMS OSAM database enhancements. The following topics are modified: PH26055
(Smart Reorg utility) Reporting result of renaming old data sets: The Result of Renaming Old Data Sets report contains result of renaming old (original) data sets with IDCAMS commands. The following topics are modified: PH25042 and PH26788
(Smart Reorg utility) DDEFPDS2 DD statement for IDCAMS commands: Use the DDEFPDS2 DD statement to point to a data set containing IDCAMS commands for deleting and allocating shadow data sets. The following topics are modified: PH13318 and PH15942
(Smart Reorg utility) Support conditional unload: The Smart Reorg utility can unload the database without reorganizing it. It can also pass a specific return code to the succeeding job step so that the database is reorganized in the succeeding job step. For more information, see the following topics: PH12332
(DB Sensor) Encrypted VSAM ESDS database data sets support. Restriction item added to SPACEALLOC control statement. PH11511
(IPR Reload utility) EXTENT control statement enhancement: The default value for the EXTENT control statement is changed to 120. Also, the default value for the EXTENT control statement can be specified in the Installation Default Option Table (HPSCOPTI). The following topics are modified: PH11352
(Smart Reorg utility) Ability to specify the access intent of the database: The STARTDB control statement supports new parameters, which you can use to specify the access intent of the database after post-reorganization processing. For more information, see STARTDB control statement.

New message: HPSG0252E

PH09434
(IPR Unload utility) Reporting of twin chained segments: The Segment Statistics report contains Twin Segment Statistics section, which provides statistics about twin chained segments. For more information, see Segment Statistics report. PH07025
(Smart Reorg utility) Information about how to avoid data set allocation failures when the HPSGAMSA data set contains many IDCAMS ALLOCATE commands is added to SPACEALLOC control statement. Also, message HPSG0102E is updated. N/A

SC19-1137-06 (January 2019)

Description Related APARs
(Smart Reorg utility) IMS management of ACBs support: The Smart Reorg utility was enhanced so that it can refer to database definitions in the IMS catalog instead of DBD libraries when the IMS management of ACBs is enabled. For more information, see the following topics: PH04969
zIIP support: IMS Database Reorganization Expert supports IBM® z Integrated Information Processor (zIIP) to offload eligible workloads to zIIP processors. To enable zIIP support, the following APARs must also be applied:
  • APAR PI89050 for IMS HP Unload 1.2
  • APAR PI88156 for IMS HP Load 2.1
For more information, see the following topics:
PI88158
(IPR Unload utility) IMS management of ACBs support: The IPR Unload utility can refer to database definitions in the IMS catalog instead of DBD libraries when the IMS management of ACBs is enabled. For more information, see the following topics: (IPR DB Scan utility) IMS management of ACBs support: The IPR DB Scan utility can refer to database definitions in the IMS catalog instead of DBD libraries when the IMS management of ACBs is enabled. For more information, see the following topics: PI83671
(Smart Reorg utility) Build PSINDEXes in HALDB reorganization jobs: The Smart Reorg utility supports building PSINDEXes when it reorganizes all the partitions of a HALDB. By this APAR, the Smart Reorg utility has been enhanced to support building of PSINDEXes even when some partitions of the HALDB are reorganized. For more information, see PSINDEXBLD control statement. PI81313
(Smart Reorg utility) DBD change support after Pre-reorganization utility jobs: The Smart Reorg utility has been enhanced to support running Smart Reorg utility jobs with a NEWDBD control statement after Pre-reorganization utility jobs. For more information, see Smart Reorg utility JCL considerations (after running the Pre-reorganization utility). PI80066
(IPR Reload utility) IMS management of ACBs support: The IPR Reload utility can refer to database definitions in the IMS catalog instead of DBD libraries when the IMS management of ACBs is enabled. For more information, see the following topics: PI79464
(IPR Unload utility) CABBASE statement: The IPR Unload utility supports a new control statement, CABBASE. This statement specifies the basic size of I/O buffers that the CAB buffer handler allocates. For more information, see CABBASE control statement. PI77308
IMS 15 support: IMS Database Reorganization Expert supports IMS 15. To use IMS Database Reorganization Expert with IMS 15, the following APARs are also required for the related products:
  • APAR PI73493 for IMS HP Unload 1.2
  • APAR PI73050 for IMS HP Load 2.1
  • APAR PI73092 for IMS Index Builder 3.1
  • APAR PI73293 for IMS HP Image Copy 4.2
  • APAR PI73091 for IMS HP Prefix Resolution 3.1
  • APAR PI73056 for IMS HP Pointer Checker 3.1
  • APAR PI73057 for IMS Library Integrity Utilities 2.2
  • APAR PI72067 for IMS Tools Base 1.6
PI73196
(IPR Reload utility) New parameter for ILDSBLD statement: The IPR Reload utility supports a new parameter, YES,COND, for the ILDSBLD control statement, which specifies to build the Indirect List data sets (ILDSs) for the HALDB in the Smart Reorg job step. This parameter applies either YES,DSPR or YES,INITONLY depending on the condition. For more information, see ILDSBLD control statement. PI69221
(Smart Reorg utility) New parameter for ILDSBLD statement: The Smart Reorg utility supports a new parameter, YES,COND, for the ILDSBLD control statement, which specifies to build the Indirect List data sets (ILDSs) for the HALDB in the Smart Reorg job step. This parameter applies either YES,DSPR or YES,INITONLY depending on the condition. For more information, see ILDSBLD control statement. PI68964
(Smart Reorg utility) TOSITEST statement: The Smart Reorg utility supports a new control statement, TOSITEST. This statement specifies to wait for a certain amount of time for BMPs and MPPs to end before issuing IMS /DBD and /DBR commands. For more information, see TOSITEST control statement. PI68510
(IPR Unload utility) HPSRAPC DD statement: The IPR Unload utility supports a new DD statement, HPSRAPC DD. This DD statement defines the output data set for writing the check report when the RAPCHECK option is enabled for the Unload task. For more information, see DD names for the Unload task. PI65915
N/A

SC19-1137-05 (September 2016)

Description Related APARs
(Smart Reorg utility) HALDB multiple partition support for CRSS: The CRSS can process multiple partitions of a HALDB. If you specify CONDREORG=YES, the CRSS diagnoses all the partitions and the Smart Reorg utility reorganizes only the partitions that require reorganization. Also you can use the PARTITION control statement to specify non-sequential partitions. For more information, see the following topics: PI64268
Option to call the segment compression exit in supervisor state: Use the new COMPAUTH control statement to call the segment compression exit in supervisor state. The COMPAUTH control statement is supported for the IPR Unload utility (HSSR Engine) and the IPR Reload utility and can be enabled in jobs of the Smart Reorg utility, IPR Unload utility, IPR Reload utility, and the IPR DB Scan utility. For more information, see the following topics: PI52760
(IPR Reload utility) PHIDAM database sorting before reload: If you use the SORTHIDAM control statement, the IPR Reload utility sorts the unloaded data before loading it into the database. For more information, see SORTHIDAM control statement. PI50574
(Smart Reorg utility) PIPEWAIT control statement enabled for installation default option: If you set the default value for the PIPEWAIT control statement in the Installation Default Option Table, the value will be applied to Smart Reorg jobs. For more information, see How to code HPSCOPT macro statements. PI40739
(Smart Reorg utility) Support for a new rule and CRSS enhancement: If you use the new IBM.LAST_REORG.10 rule and enable the Conditional Reorganization Support Service (CRSS), the Smart Reorg utility evaluates the number of days since the last reorganization and reorganizes the database only when the number of days exceeds the threshold defined by the rule. For more information, see Example 14: Conditional reorganization based on the number of days since the last reorganization. This APAR also enhances the CRSS to support IMS Online Reorganization Facility. PI32990

SC19-1137-04 (March 2015)

Description Related APARs
IMS 14 support: IMS Database Reorganization Expert supports IMS 14. To use IMS Database Reorganization Expert with IMS 14, the following APARs are also required for the related products:
  • APAR PI27636 for IMS HP Unload 1.2
  • APAR PI27637 for IMS HP Load 2.1
  • APAR PI27638 for IMS Index Builder 3.1
  • APAR PI27561 for IMS HP Image Copy 4.2
  • APAR PI27640 for IMS HP Prefix Resolution 3.1
  • APAR PI27563 for IMS HP Pointer Checker 3.1
  • APAR PI27566 for IMS Library Integrity Utilities 2.2
  • APAR PI26352 for Tools Base 1.5
PI27634
Change in the return code for IMS Tools Knowledge Base failures: The return code that indicates an IMS Tools Knowledge Base Output repository processing failure is changed from 4 to 0. This change was implemented to unify the behavior of the products across IMS Database Solution Pack.
If you want return code 4 to be returned for IMS Tools KB Output processing failures, specify the ERRC04 keyword for the ITKBSRVR control statement. For more information about this keyword, see the following topics:
PI17978 and PI32987
(Pre-reorganization and Post-reorganization utilities) OSAM large format sequential data set support: The Pre-reorganization and Post-reorganization utilities now support databases that use OSAM large format sequential data sets. For more information, see the following topics: PI17557
(IPR Reload utility) CHKEMPTYUL control statement support: You can use new control statement, CHKEMPTYUL, to check if the unloaded data set contains segment data. You can also use it to specify the return code that is set when no segment data is found in the unloaded data set. For more information, see CHKEMPTYUL control statement. PI14951
(IPR Unload utility) Type-B user exit routine enhancement: The IPR Unload utility now accepts return codes 100 - 999 from the Type-B user exit routine. For more information, see the following topics: PI13315
(Smart Reorg utility) Enhancements related to HALDB processing
  • The Smart Reorg utility now supports XTIOT (extended task input/output table) for allocation of HALDB data sets. For more information, see DYNALLOC control statement.
  • When REORG NUMBER VERIFICATION=YES is set in the RECON data sets, the Smart Reorg utility requests DBRC to update the HALDB reorganization number in the RECON data sets.
PI11626
(Smart Reorg utility) New data element for DB Sensor: DB Sensor collects new data element, DB_AVG_LEN_SYNONYM_CHAIN. This data element is for reporting the average length of all synonym chains in the data set that have a length greater than or equal to 2. For more information, see SENSOR_HOME control statement. PI08979

SC19-1137-03

Description Related APARs
(Smart Reorg utility) Partitioned secondary indexes build for HALDBs: The Smart Reorg utility can rebuild partitioned secondary indexes (PSINDEXes) while reorganizing HALDBs. This function can be enabled by the PSINDEXBLD control statement. For more information, see PSINDEXBLD control statement. PM94787
(Smart Reorg utility) Conditional reorganization without automatic post-reorganization processing: The Smart Reorg utility is enhanced to support conditional reorganization of databases even when automatic post-reorganization processing is not requested. PM99143
Support of IMS database group-managed reorganization: The Smart Reorg utility, the Pre-reorganization utility, the Post-reorganization utility, and the IPR Scan utility can send system notification to IMS Tools Base Autonomics Director to indicate the completion of the job. Autonomic Director will use this notification as a trigger to start analyzing and generating recommendations for the database. This function can be enabled by the new ADXCFGRP and the ADDBGRP control statements. For more information, see ADXCFGRP control statement and ADDBGRP control statement. For the IPR Scan utility, see ADXCFGRP control statement and ADDBGRP control statement. PM86931
(IPR Reload utility) Padding character support for segment length: You can specify the padding character to fill out the segments to adjust to the length that is defined in the DBD definition. For more information, see PAD control statement. PM82938
(IPR Reload utility) Reporting of twin chained segments: You can use the new TWINSTAT control statement to print statistics about the twin chained segments in the Segment Statistics report. For more information, see TWINSTAT control statement. PM79676
IMS 13 support: IMS Database Reorganization Expert supports IMS 13. To use IMS Database Reorganization Expert with IMS 13, the following APARs are also required for the related products:
  • APAR PM75257 for IMS HP Unload 1.2
  • APAR PM75254 for IMS HP Load 2.1
  • APAR PM75258 for IMS Index Builder 3.1
  • APAR PM75253 for IMS HP Image Copy 4.2
  • APAR PM75256 for IMS HP Prefix Resolution 3.1
  • APAR PM75255 for IMS HP Pointer Checker 3.1
  • APAR PM75259 for IMS Library Integrity Utilities 2.1
  • APAR PM75247 for Tools Base 1.3
PM75249
(Pre-reorganization and Post-reorganization utilities) New reports for the Pre-reorganization utility: The Pre-reorganization utility generates the following two new reports:
  • List of Databases Need to be Processed report
  • Work Data Set Information report
For more information about these reports, see HPSOUT data set (Pre-reorganization utility).
PM72877
(IPR Reload utility) Support reassigning of indirect list keys: If duplicated indirect list keys (ILKs) exist, you can use the new REPAIRILK control statement to reassign ILKs. For more information, see REPAIRILK control statement. PM68883
(Pre-reorganization and Post-reorganization utilities) Pre-reorganization utility and the Post-reorganization utility: IMS Database Reorganization Expert provides these two new utilities for reorganization of databases that have external logical relationships. The Pre-reorganization utility is used before the Smart Reorg job step to do pre-reorganization processing. The Post-reorganization utility is used after the Smart Reorg job step to do post-reorganization processing. For more information, see Pre-reorganization utility and Post-reorganization utility. PM68661
(IPR Reload utility) Generate work files for rebuilding partitioned secondary indexes: Supports generating work files (WFP work data sets) that can be used as input to IMS Index Builder to rebuild partitioned secondary indexes (PSINDEXes) in a separate job step. For more information, see HPSRPnnn DD statement in IPR Reload JCL requirements and WFPxxxx control statements in Overview of the IPR Reload control statements. PM62216
(IPR Reload utility) Support data class and storage class specifications for HPSRILEA and HPSRILEB data sets: You can specify the data class (DATACLAS) and the storage class (STORCLAS) for the HPSRILEA and HPSRILEB data sets. These data sets are used in rebuilding ILDSs and are used as substitute for the SORTIN data sets of DFSORT. For more information, see ILEDATAC control statement and ILESTORC control statement. PM60646
(IPR Reload utility) SORT statement: The SORT control statement, which specifies to run the physical sequential sort processing before reload, can now be specified together with the USERHDR or USERHDRX statement. For more information, see SORT control statement. PM57126 (APAR for IMS High Performance Load)
(IPR Unload utility) BLDLPCK statement enabled for installation default option: You can set the default value for the BLDLPCK control statement in the Installation Default Option Table and that value will be applied to IPR Unload jobs. For more information, see How to code HPSCOPT macro statements. PM55891
(IPR Reload utility) SORT statement enabled for installation default option: You can set the default value for the SORT control statement in the Installation Default Option Table and that value will be applied to IPR Reload jobs. For more information, see How to code HPSCOPT macro statements. PM52306
(IPR Unload utility) Migration unload and fallback unload support: You can use the IPR Unload utility when you migrate a non-partitioned database to a partitioned database, or a partitioned database to a non-partitioned database. The utility unloads the database in the required format for migration. For more information, see MIGRATE control statement and FALLBACK control statement. PM51943
(IPR Reload utility) DDEFPDS DD statement for deleting and defining database data sets: You can specify the DDEFPDS DD statement so that the database data sets are automatically deleted or defined during the IPR Reload job step. For more information, see DDEFPDS DD statement in IPR Reload JCL requirements. PM46446

SC19-1137-02

Description Related APARs
(Smart Reorg utility) The Smart Reorg Driver supports the following new functions:
  • The statistics about the primary indexes of HIDAM and PHIDAM databases are displayed in the Diagnosis report.
  • When the TOSIXCFGROUP control statement is specified, the latest VSAM statistics is collected from the database that is online.
PM50158
(Smart Reorg utility) Reorganization Diagnosis mode support: The Smart Reorg Driver supports Reorganization Diagnosis mode to reorganize the database regardless of the results from policy evaluation, and generate a Diagnosis report. PM38767
(Smart Reorg utility) Change in the default value of the ILDSBLD statement: The ILDSBLD=YES specification is obsolete. The default value for the ILDSBLD control statement is changed from ILDSBLD=YES to ILDSBLD=YES,DSPR. PM33765
(IPR Reload utility) Change in the default value of the ILDSBLD statement: The ILDSBLD=YES specification is obsolete. The default value for the ILDSBLD control statement is changed from ILDSBLD=C to ILDSBLD=YES,DSPR. PM33765
(Smart Reorg utility) LASTAUTHFLAG statement for restoring authorization flags: The Smart Reorg Driver supports the LASTAUTHFLAG control statement to restore the authorization flags in RECON to the original state. PM31076
(Smart Reorg utility) IMS 12 support: The Smart Reorg Driver supports IMS 12. To use the Smart Reorg Driver with IMS 12, the following APARs are also required for the related products.
  • APAR PM22119 for IMS HP Unload 1.2
  • APAR PM22118 for IMS HP Load 2.1
  • APAR PM22120 for IMS Index Builder 3.1
  • APAR PM21942 for IMS HP Image Copy 4.2
  • APAR PM22121 for IMS HP Prefix Resolution 3.1
  • APAR PM21945 for IMS HP Pointer Checker 3.1
  • APAR PM21961 for IMS Library Integrity Utilities 2.1
  • APAR PM21167 for Tools Base 1.1
PM22116

SC19-1137-01

Description Related APARs
(Smart Reorg utility) IMSCMDOPT statement support: The Smart Reorg Driver supports the IMSCMDOPT control statement to allow you change the options of the IMS commands that are issued by IMS Tools Online System Interface. PM14690
(Smart Reorg utility) Generate DSPURX00 control statements: The Smart Reorg Driver generates DSPURX00 control statements that can be used for manual post processing. PM12505
(IPR Unload utility) SKIPAUTH statement support: The IPR Unload utility supports the SKIPAUTH control statement to bypass IMS DBRC database authorization. PM12287
(Smart Reorg utility) New parameter for the PIPEWAIT statement: The Smart Reorg Driver supports a third parameter for the PIPEWAIT control statement. You can specify different time periods for opening and reading/writing wait states. PM11142
(IPR Reload utility) Generation of GDG base: The IPR Reload utility creates a GDG base when the base does not exist and when DFSURWF1 is defined as a generation data set. PM09527