Release Notes for IDR 11.4 for Google BigQuery

IDR 11.4.0.5-5731

Enhancements in IDR 11.4.0.5-5731 for CDC Replication Engine for BigQuery

• Add ability for user to specify the string that will represent SQL NULL in the bigqueryloadoptions.xml file
• Users can now specify subscriptions that are not allowed to use the shared scrape staging store by setting system property mirror_subs_allowed_to_use_staging_store to false at the subscription level

Known Issues fixed in IDR 11.4.0.5-5731 for CDC Replication Engine for BigQuery

• DT394553 CDC Replication Engines - subscription ends on error NullPointerException when a commit fails on the target engine
• DT393813 CDC Replication Engines - Differential Refresh includes CDR columns in update and delete where clauses leading to rows not being found

IDR 11.4.0.5-5730

Enhancements in IDR 11.4.0.5-5730 for CDC Replication Engine for BigQuery

• BigQuery Bytes datatype now supported
• New lines in the column value now successfully replicate to BigQuery
• CDC Replication Engines now issue a warning if source and target columns have incompatible datatypes during table assignment for non-explicitly mapped columns
• System property mirror_timezone_support_enabled added to force CDC Replication Engines to use the source timezone when converting JCF and commit timestamps

Known Issues fixed in IDR 11.4.0.5-5730 for CDC Replication Engine for BigQuery

• DT391703 CDC Replication Engine for BigQuery - Refresh fails when replicating double quotes as part of a column value
• DT392323 CDC Replication Engine for BigQuery - Many small units of work (UOW) are applied after a crash or abort stop if only one apply thread is configured

IDR 11.4.0.5-5726

Enhancements in IDR 11.4.0.5-5726 for CDC Replication Engine for BigQuery

• CDC Replication Engine for BigQuery now supports AIX
• CDC Replication Engine for BigQuery now enables preserve_ascii_control_characters in BigQuery load configuration. This helps to handle EBCDIC to UTF conversion.
• Effective January 2025, IDR CDC will no longer provide support for following operating system versions: RedHat Enterprise Linux (RHEL) 7; CentOS 7.x

Bugs fixed in IDR 11.4.0.5-5726 for CDC Replication Engine for BigQuery

• NullPointerException when BigQuery job failed.
• Assertion error when mapping to target BIGNUMERIC datatype.

IDR 11.4.0.5-5725

Enhancements in IDR 11.4.0.5-5725 for CDC Replication Engine for BigQuery

• IIDR now provides the option of retrying the fast apply failed Unit of Work
• Updated JVM to 8.0.8.25, java version "1.8.0_411" Java(TM) SE Runtime Environment (build 8.0.8.25 - pwa6480sr8fp25-20240328_01(SR8 FP25))

Known Issues fixed in IDR 11.4.0.5-5725 for CDC Replication Engine for BigQuery

• DT382379 CDC Replication Engines - dmsupportinfo command does not collect complete details expected.

IDR 11.4.0.5-5722

Known Issues fixed in IDR 11.4.0.5-5722 for CDC Replication Engine for BigQuery

• DT258648 CDC Replication Engines - Replication ends on error "ClassNotFoundException" for Timestamp12Format class when executing a user exit that uses Timestamp12 class

IDR 11.4.0.5-5721

Enhancements in IDR 11.4.0.5-5721 for CDC Replication Engine for BigQuery

• CDC now supports custom character sets that map multiple byte sequences to the same Unicode character.

IDR 11.4.0.5-5715

Enhancements in IDR 11.4.0.5-5715 for CDC Replication Engine for BigQuery

• Allow CDC to trace BigQuery Errors while applying CSV file
• Document userexit interfaces such as UserExitIF, DataRecordIF and ReplicationEventIF in docs folder

Known Issues fixed in IDR 11.4.0.5-5715 for CDC Replication Engine for BigQuery

• DT363625 CDC Replication Engine for BigQuery - external table mirror bulk apply insert fails when the column value contains a CSV file delimiter

IDR 11.4.0.5-5706

Enhancements in IDR 11.4.0.5-5706 for CDC Replication Engine for BigQuery

• Allow CDC for BigQuery to create a single CSV file for refresh operation because bigquery has a limit of 1500 operations per day
• Updated JVM to 8.0.8.20, java version "1.8.0_401" (build 8.0.8.20 - pwa6480sr8fp20-20240112_01(SR8 FP20))
• Increased the requested maximum number of pending connections on the TCP accept queue

Known Issues fixed in IDR 11.4.0.5-5706 for CDC Replication Engine for BigQuery

• DT260363 CDC Replication Engine for BigQuery - Operations can be delayed getting applied after a abort/immediate stop or crash when using fast apply and some or all tables are refreshed before restarting

IDR 11.4.0.5-5703

Enhancements in IDR 11.4.0.5-5703 for CDC Replication Engine for BigQuery

• Effective February 2024, IDR CDC will no longer provide support for following operating system versions: SuSE 11.0; Ubuntu 16.04; Oracle Linux 6.x; CentOS 6.x; AIX 7.1; Microsoft Windows 7, 8, 8.1, Server 2008, Server 2008R2

Known Issues fixed in IDR 11.4.0.5-5703 for CDC Replication Engine for BigQuery

• DT259051 - CDC Replication Engine for BigQuery - Refresh ends on error "BigQueryException Error while reading data, error message: CSV processing encountered too many errors, giving up."

Bugs fixed in IDR 11.4.0.5-5703 for CDC Replication Engine for BigQuery

• When a key column update is converted to a delete/insert, we unnecessarily use Adaptive Apply as the RWA conflict resolution method for the delete and insert

IDR 11.4.0.5-5702

Enhancements in IDR 11.4.0.5-5702 for CDC Replication Engine for BigQuery

• Added ParallelizeByHash, ParallelizeByHashNetEffect, and ParallelizeByHashNetEffectConvertUpdates fast apply algorithms

Bugs fixed in IDR 11.4.0.5-5702 for CDC Replication Engine for BigQuery

• NecessityException if MBA is used and update before image is missing a column value
• Specifying the number of image builder threads via the NullMirrorOptimizer fast apply user exit causes subscription to stop

IDR 11.4.0.5-5700

Enhancements in IDR 11.4.0.5-5700 for CDC Replication Engine for BigQuery

• If system property mirror_refresh_while_active_resolution_method is set to IGNORE_CONFLICTS, CDC no longer uses full Adaptive Apply to resolve conflicts when applying operations that occurred during the refresh-while-active period for a table. Instead, conflicts are resolved in a simpler, more efficient way that allows JDBC batching.
• Updated various open source libraries

IDR 11.4.0.5-5699

Bugs fixed in IDR 11.4.0.5-5699 for CDC Replication Engine for BigQuery

• Fix incorrect product version shown in Windows program manager

IDR 11.4.0.5-5696

Enhancements in IDR 11.4.0.5-5696 for BigQuery

• IDR now supports BigQuery as a target
• Updated JVM to 8.0.8.11, java version "1.8.0_381"