Users Guide

7–RoCE Configuration
Configuring RoCE on the Adapter for VMware ESX
164 AH0054602-00 M
Limitations
VF RMDA has the following limitations:
 No iWARP support
 No NPAR support
 Cross OS is not supported; for example, a Linux hypervisor cannot use a
Windows guest OS (VM)
 Perftest latency test on VF interfaces can be run only with the inline size
zero
-I 0 option. Neither the default nor more than one inline size works.
 To allow RDMA_CM applications to run on different MTU sizes (512–9000)
other than the default (1500), follow these steps:
1. Unload the
qedr driver:
#rmmod qedr
2. Set MTU on the VF interface:
#ifconfig <VF interface> mtu 9000
3. Load the qedr driver:
#modprobe qedr
 The rdma_server/rdma_xserver does not support VF interfaces.
 No RDMA bonding support on VFs.
Configuring RoCE on the Adapter for VMware ESX
This section provides the following procedures and information for RoCE
configuration:
 Configuring RDMA Interfaces
 Configuring MTU
 RoCE Mode and Statistics
 Configuring a Paravirtual RDMA Device (PVRDMA)
NOTE
Mapping Ethernet speeds to RDMA speeds is not always accurate, because
values that can be specified by the RoCE driver are aligned with Infiniband
®
.
For example, if RoCE is configured on an Ethernet interface operating at
1Gbps, the RDMA speed is shown as 2.5Gbps. There are no other suitable
values available in the header files provided by ESXi that can be used by the
RoCE driver to indicate 1Gbps speed.