IBM Support

Possibility of I/O errors when enabling virtual pmem with dedicated I/O adapters enabled

Flashes (Alerts)


Abstract

If you enable virtual pmem and then install the operating system (OS), you might not see the correct disk drive to perform the installation from.
Or if you enable virtual pmem after Linux OS installation to a logical partition with dedicated I/O adapters, I/O errors might be seen.

Content

Linux Releases Affected
RedHat Enterprise Linux 8.7, for Power LE
RedHat Enterprise Linux 9.1, for Power LE
SUSE Linux Enterprise Server 15, Service Pack 4
IBM Systems Affected
Linux logical partitions that run on any PowerVM based POWER9 or Power10 system.
Symptoms
The disk drive is not detected when you install Linux OS.
Or after Linux OS installation, when virtual pmem is enabled, this issue can manifest as I/O errors and I/O device DLPAR failures. 
Workaround
Although it is recommended to avoid mixing SR-IOV and dedicated I/O devices with virtual pmem 
until this issue is resolved, the following workaround can be used:
  1. In the file /etc/default/grub, append disable_ddw=1 to the GRUB_CMDLINE_LINUX_DEFAULT entry.
  2. Run the following command to update the bootloader configuration.
    grub2-mkconfig -o /boot/grub2/grub.cfg
  3. Reboot the LPAR
If you enable virtual pmem before installing the OS, then you need to append disable_ddw=1 at the grub install prompt before you proceed with installing the OS. 
Fix Outlook
IBM is working to include a fix in a future RedHat and SUSE update.
 
I/O device impacted

SR-IOV logical port or I/O adapters assigned directly to a Linux logical partition with virtual pmem assigned to it.

[{"Type":"MASTER","Line of Business":{"code":"LOB26","label":"Storage"},"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SGMV157","label":"IBM Support for Red Hat Enterprise Linux Server"},"ARM Category":[{"code":"a8m0z000000Gnl7AAC","label":"Red Hat Enterprise Linux"},{"code":"a8m0z000000GnlCAAS","label":"SUSE Linux Enterprise Server"}],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions"}]

Document Information

Modified date:
24 April 2023

UID

ibm16837545