Users Guide

7–RoCE Configuration
Configuring RoCE on the Adapter for Linux
163 AH0054602-00 M
device node GUID
------ ----------------
qedr0 1602ecfffececfa0
qedr1 1602ecfffececfa1
qedr_vf0 b81aadfffe088900
qedr_vf1 944061fffe49cd68
Number of VFs Supported for RDMA
For the 41xxx Series Adapters, the number of VFs for L2 and RDMA are shared
based on resources availability.
Dual Port Adapters
Each PF supports a maximum of 40 VFs for RDMA. If the number of VFs
exceeds 56, it will be subtracted by the total number of VFs (96).
In the following example, PF0 is
/sys/class/net/<PF-interface>/device/sriov_numvfs
Echo 40 > PF0 (VFs for L2+RDMA=40+40 (40 VFs can use for both L2 and RDMA))
Echo 56 > PF0 (VFs for L2+RDMA=56+40)
After crossing 56 VFs, this number is subtracted by the total number of VFs. For
example:
echo 57 > PF0 then 96-57=39 VFs for RDMA (57 VFs for L2 + 39VFs for RDMA)
echo 96 > PF0 then 96-96=0 VFs for RDMA (all 96 VFs can use only for L2)
To view the available VFs for L2 and RDMA:
L2 : # ip link show
RDMA: # ibv_devices
Quad Port Adapters
Each PF supports a maximum of 20 VFs for RDMA; until 48 VFs, there are 20 VFs
for RDMA. When exceeding 28 VFs, that number is subtracted by the total VFs
(48).
For example, in a 4x10G:
Echo 20 > PF0 (VFs for L2+RDMA=20+20)
Echo 28 > PF0 (VFs for L2+RDMA=28+20)
When exceeding 28 VFs, this number is subtracted by the total number of VFs.
For example:
echo 29 > PF0 (48–29=19VFs for RDMA; 29 VFs for L2 + 19 VFs for RDMA)
echo 48 > PF0 (48-48=0 VFs for RDMA; all 48 VFs can use only for L2)