User Manual
Rev 4.70
Mellanox Technologies
50
8.7.2.1 Prerequisites
The following are the driver’s prerequisites in order to set or configure RoCE:
• ConnectX®-3 and ConnectX®-3 Pro firmware version 2.30.3000 or higher
• All InfiniBand verbs applications which run over InfiniBand verbs should work on
RoCE links if they use GRH headers.
• Set HCA to use Ethernet protocol:
Display the Device Manager and expand “System Devices”. Please refer to
Section 8.4.2, “Port Protocol Configuration”, on page 38.
8.7.2.2 Configuring Windows Host
Configuring Windows host requires configuring QoS. To configure QoS, please follow the pro-
cedure described in Section 7.4, “Configuring Quality of Service (QoS)”, on page 34
8.7.2.2.1 Using Global Pause Flow Control (GFC)
To use Global Pause Flow Control (GFC) mode, disable QoS and Priority:
8.7.3 Configuring SwitchX® Based Switch System
To enable RoCE, the SwitchX should be configured as follows:
• Ports facing the host should be configured as access ports, and either use global pause
or Port Control Protocol (PCP) for priority flow control
• Ports facing the network should be configured as trunk ports, and use Port Control Pro-
tocol (PCP) for priority flow control
For further information on how to configure SwitchX, please refer to SwitchX User Manual.
8.7.4 Configuring Arista Switch
Step 1. Set the ports that face the hosts as trunk.
Step 2. Set VID allowed on trunk port to match the host VID.
Step 3. Set the ports that face the network as trunk.
Step 4. Assign the relevant ports to LAG.
Since PFC is responsible for flow controlling at the granularity of traffic priority, it is
necessary to assign different priorities to different types of network traffic.
As per RoCE configuration, all ND/NDK traffic is assigned to one or more chosen pri-
orities, where PFC is enabled on those priorities.
PS $ Disable-NetQosFlowControl
PS $ Disable-NetAdapterQos <interface name>
(config)# interface et10
(config-if-Et10)# switchport mode trunk
(config-if-Et10)# switchport trunk allowed vlan 100
(config)# interface et20
(config-if-Et20)# switchport mode trunk
(config)# interface et10
(config-if-Et10)# dcbx mode ieee