Users Guide

Broadcom NetXtreme-E-UG304-2CS
102
NetXtreme-E User Guide User Guide for Dell Platforms
14 RoCE – Configuration and Use Case Examples
This section provides configuration and use case examples for Remote Direct Memory Access over Converged Ethernet
(RoCE).
NOTE: If using NPAR + SR-IOV mode, only two VFs from each parent physical port can enable RDMA support, or a total
of four VFs + RDMA per physical device.
NOTE: RoCE over VF is not supported on BCM575XX devices.
14.1 Enabling RoCE
To enable RoCE for PFs or VFs, the enable the RDMA selection in the HII menu in the BIOS before the RDMA option takes
effect in the host or guest OS.
To enable RDMA in single function mode (if Virtualization Mode is None or SR-IOV):
1. During the system boot, access the System Setup → NetXtreme-E NIC → Main Configuration Page and set NIC+
RMDA Mode to Enabled.
To enable RDMA if Virtualization Mode is NPAR or NPAR + SR-IOV:
1. During the system boot, access the System Setup → NetXtreme-E NIC →NIC Partitioning Configuration → Partition
1 (or 2) Configuration and set NIC+ RMDA Mode to Enabled.
14.2 Linux Configuration and Use Case Examples
This section describes how to install the bnxt_en Linux L2 and/or bnxt_re RoCE driver and user space library for the
Broadcom NetXtreme-E BCM9574XX and BCM9575XX 10/20/25/40/50/100/200 Gb/s Ethernet Network Controllers
(ENCs).
14.2.1 Requirements
To configure RoCE in Linux, the following items are required:
 Linux L2 driver bnxt_en
 Linux RDMA RoCE driver bnxt_re
 Linux RoCE user space library libbnxt_re
14.2.1.1 BNXT_EN Driver Dependencies
If kernels older than 4.7 are used or if the CONFIG_VLAN_MODULE kernel option is set as a module option, the vxlan.ko
module must be loaded before the bnxt_en.ko module.
ping 192.168.1.10 –
Table 32: VXLAN Command and Configuration Examples (Continued)
System 1 System 2