Users Guide

7–RoCE Configuration
Configuring RoCE on the Adapter for VMware ESX
166 AH0054602-00 M
7. To create a new port group on this vSwitch, issue the following command:
# esxcli network vswitch standard portgroup add -p roce_pg -v
roce_vs
For example:
# esxcli network vswitch standard portgroup add -p roce_pg -v
roce_vs
8. To create a vmknic interface on this port group and configure the IP, issue
the following command:
# esxcfg-vmknic -a -i <IP address> -n <subnet mask> <roce port
group name>
For example:
# esxcfg-vmknic -a -i 192.168.10.20 -n 255.255.255.0 roce_pg
9. To configure the vLAN ID, issue the following command:
# esxcfg-vswitch -v <VLAN ID> -p roce_pg
To run RoCE traffic with a vLAN ID, configure the vLAN ID on the
corresponding VMkernel port group.
Configuring MTU
To modify the MTU for an RoCE interface, change the MTU of the corresponding
vSwitch. Set the MTU size of the RDMA interface based on the MTU of the
vSwitch by issuing the following command:
# esxcfg-vswitch -m <new MTU> <RoCE vswitch name>
For example:
# esxcfg-vswitch -m 4000 roce_vs
# esxcli rdma device list
Name Driver State MTU Speed Paired Uplink Description
------- ------- ------ ---- ------- ------------- -------------------------------
vmrdma0 qedrntv Active 2048 25 Gbps vmnic0 QLogic FastLinQ QL45xxx RDMA Interface
vmrdma1 qedrntv Active 1024 25 Gbps vmnic1 QLogic FastLinQ QL45xxx RDMA Interface
RoCE Mode and Statistics
For the RoCE mode, ESXi requires concurrent support of both RoCE v1 and v2.
The decision regarding which RoCE mode to use is made during queue pair
creation. The ESXi driver advertises both modes during registration and
initialization. To view RoCE statistics, issue the following command:
# esxcli rdma device stats get -d vmrdma0