White Papers

5 Dell EMC Networking – RDMA over Converged Ethernet (RoCE v2) Cheat Sheet
2 Setup
Figure 1, describes the reference test environment used to deploy a converged data center.
The test environment uses a distributed Spine-Leaf architecture, where the leaf layer acts
as both Leaf and ToR (Top of Rack).
The connected servers to the Leaf/ToR switches simulate a rack within a data center. Each
server is simulating FCoE, and RDMA traffic, however, for the sake of this document, only
RDMA traffic is highlighted.
Besides iSCSI and LAN traffic, RDMA traffic is also being generated by the IXIA traffic
generator to simulate a typical converged environment.
The following items were used to test RDMA, iSCSI, and LAN:
 Dell EMC Networking Layer 2/3 switches supporting DCB such as:
o S4048-ON and S4148F-ON
 Dell EMC OS10.4.1, OS9.13.0
 QLogic – QL41254HLCU – Quad port 25GbE SFP+
 Windows 2016 Server
 IOMeter
 IMDisk
 IXIA – XG12, 10/40GE Modules
 Dell Poweredge R630s
The following traffic parameters were used to ensure RDMA workload over iSCSI and LAN
data traffic:
 LAN data traffic
o 802.1p priority CoS = 0, vlan 100
o ETS = 10%, PFC off
 iSCSI data traffic
o 802.1p priority CoS = 4, vlan 200
o ETS = 40%, PFC on
 RDMA
o 802.1p priority CoS = 6 (RDMA v2), vlan 400
o ETS = 50%, PFC on
Note: RDMA v1 and v2 will be tested separately.
RoCE traffic is crossing the spine layer via the congested 20GE port channels.