PCIe RoCE Express network guide

Find out how to use PCIe RoCE network express (RoCE) to install Red Hat Enterprise Linux (RHEL) in an LPAR (natively), and how to add RoCE as an additional interface.

This network guide describes two scenarios.

  • How to install Red Hat Enterprise Linux (RHEL) in an LPAR (natively) on IBM Z or LinuxONE using the PCIe RoCE Express 2 (RoCE).
  • How to add RoCE Express 2 (RoCE) as an additional interface to an existing LPAR (natively).

Publication date: May 2022.

You can also view and print this information in PDF format.

A video demonstrating how to install RHEL 9 is available here:

An image from the linked video

What is RoCE?

RDMA over Converged Ethernet (RoCE) is a standard network protocol that enables remote direct memory access (RDMA) efficient data transfer over Ethernet.

RoCE is a standard protocol defined in the InfiniBand Trade Association (IBTA) standard. The main advantage of RoCE is it allows direct memory to memory transfer at the application level without involving the CPU. As a result of this, RoCE has low latency and, depending on the workload, can offer a performance advantage. RoCE supports TCP/IP connection and Shared Memory Communications Remote (SMC-R) connection.

What is PCIe?

Peripheral component interconnect express (PCIe) is an interface standard for connecting high-speed components. In IBM, PCIe slots are used to connect networking devices (RoCe express), storage devices, and so on.