What's new and changed in Execution Engine for Apache Hadoop

Important: IBM Cloud Pak® for Data Version 4.6 will reach end of support (EOS) on 31 July, 2025. For more information, see the Discontinuance of service announcement for IBM Cloud Pak for Data Version 4.X.

Upgrade to IBM Software Hub Version 5.1 before IBM Cloud Pak for Data Version 4.6 reaches end of support. For more information, see Upgrading IBM Software Hub in the IBM Software Hub Version 5.1 documentation.

Execution Engine for Apache Hadoop updates can include new features, bug fixes, and security updates. Updates are listed in reverse chronological order so that the latest release is at the beginning of the topic.

You can see a list of the new features for the platform and all of the services at What's new in IBM Cloud Pak for Data.

Installing or upgrading Execution Engine for Apache Hadoop

Ready to install or upgrade Execution Engine for Apache Hadoop?

Related documentation:

Cloud Pak for Data Version 4.6.5

A new version of Execution Engine for Apache Hadoop was released in April 2023 with Cloud Pak for Data 4.6.5.

Operand version: 4.6.5

This release includes the following changes:

Security fixes

CVE-2023-23916, CVE-2023-0215

CVE-2022-23491, CVE-2022-4450, CVE-2022-4304

Cloud Pak for Data Version 4.6.4

A new version of Execution Engine for Apache Hadoop was released in March 2023 with Cloud Pak for Data 4.6.4.

Operand version: 4.6.4

This release includes the following changes:

Security fixes

This release includes fixes for the following security issues:

CVE-2022-48303, CVE-2022-47629, CVE-2022-45061, CVE-2022-4415, CVE-2022-43945, CVE-2022-41903, CVE-2022-41717, CVE-2022-41716, CVE-2022-41222, CVE-2022-40897, CVE-2022-36087, CVE-2022-29526, CVE-2022-2873, CVE-2022-27664, CVE-2022-27191, CVE-2022-25881, CVE-2022-24999, CVE-2022-23521

CVE-2021-28861

CVE-2020-10735

Cloud Pak for Data Version 4.6.3

A new version of Execution Engine for Apache Hadoop was released in February 2023 with Cloud Pak for Data 4.6.3.

Operand version: 4.6.3

This release includes the following changes:

New features

The 4.6.3 release of Execution Engine for Apache Hadoop includes the following features and updates:

Updated version of Cloudera

You can now use Cloudera Data Platform (CDP) Version 7.1.8.

Updates for Jupyter Enterprise Gateway

Jupyter Enterprise Gateway is upgraded from Version 2.6.0 to 3.1.0. No action is needed for this upgrade.
Jupyter Enterprise Gateway now supports Spark 3.3. To start a Jupyter notebook after you upgrade to Cloud Pak for Data Version 4.6.3, you must run commands as the first cell after the kernel starts. For details, see Building models with JEG.

Security fixes

This release includes fixes for the following security issues:

CVE-2022-43680, CVE-2022-42012, CVE-2022-42011, CVE-2022-42010, CVE-2022-41715, CVE-2022-4139, CVE-2022-40897, CVE-2022-40304, CVE-2022-40303, CVE-2022-39353, CVE-2022-3821, CVE-2022-37616, CVE-2022-35737, CVE-2022-32190, CVE-2022-32189, CVE-2022-2964, CVE-2022-2880, CVE-2022-2879, CVE-2022-27664, CVE-2022-23541, CVE-2022-23540, CVE-2022-23539, CVE-2022-21704, CVE-2022-21476, CVE-2022-1996

CVE-2021-46848, CVE-2021-32796, CVE-2021-20264

CVE-2014-2428, CVE-2014-2427, CVE-2014-2423, CVE-2014-2422, CVE-2014-2421, CVE-2014-2420, CVE-2014-2414, CVE-2014-2413, CVE-2014-2412, CVE-2014-2410, CVE-2014-2409, CVE-2014-2403, CVE-2014-2402, CVE-2014-2401, CVE-2014-2398, CVE-2014-2397, CVE-2014-1876, CVE-2014-0464, CVE-2014-0463, CVE-2014-0461, CVE-2014-0460, CVE-2014-0459, CVE-2014-0458, CVE-2014-0457, CVE-2014-0456, CVE-2014-0455, CVE-2014-0454, CVE-2014-0453, CVE-2014-0452, CVE-2014-0451, CVE-2014-0449, CVE-2014-0448, CVE-2014-0446, CVE-2014-0432, CVE-2014-0429

CVE-2013-0169

Cloud Pak for Data Version 4.6.1

A new version of Execution Engine for Apache Hadoop was released in December 2022 with Cloud Pak for Data 4.6.1.

Operand version: 4.6.1

This release includes the following changes:

Security fixes

This release includes fixes for the following security issues:

CVE-2022-36946, CVE-2022-29581, CVE-2022-2938, CVE-2022-28893, CVE-2022-28390, CVE-2022-27950, CVE-2022-2639, CVE-2022-26373, CVE-2022-2586, CVE-2022-24448, CVE-2022-23960, CVE-2022-21499, CVE-2022-2078, CVE-2022-20368, CVE-2022-1852, CVE-2022-1304, CVE-2022-1184, CVE-2022-1055, CVE-2022-1048, CVE-2022-1016, CVE-2022-0854, CVE-2022-0617, CVE-2022-0168

CVE-2021-3640, CVE-2021-30002

CVE-2020-36558, CVE-2020-36516

CVE-2016-3709

CVE-2015-20107

Cloud Pak for Data Version 4.6.0

A new version of Execution Engine for Apache Hadoop was released in November 2022 with Cloud Pak for Data 4.6.0.

Operand version: 4.6.0

This release includes the following changes:

New features

The 4.6.0 release of Execution Engine for Apache Hadoop includes the following features and updates:

Python 3.10 now supported: You can now use Python 3.10 in Execution Engine for Apache Hadoop in Watson Studio. The default version remains Python 3.9.

Security fixes

This release includes fixes for the following security issues:

CVE-2022-40674, CVE-2022-37434, CVE-2022-36087, CVE-2022-3515, CVE-2022-34903, CVE-2022-32148, CVE-2022-30635, CVE-2022-30633, CVE-2022-30632, CVE-2022-30631, CVE-2022-30630, CVE-2022-30629, CVE-2022-30580, CVE-2022-29901, CVE-2022-29900, CVE-2022-28131, CVE-2022-2588, CVE-2022-2509, CVE-2022-23825, CVE-2022-23816, CVE-2022-21166, CVE-2022-21125, CVE-2022-21123, CVE-2022-1962, CVE-2022-1705, CVE-2022-1353, CVE-2022-0494, CVE-2022-0391

CVE-2020-35527, CVE-2020-35525

CVE-2015-20107