User Manual

Rev 4.60
Mellanox Technologies
30
• All InfiniBand verbs applications which run over InfiniBand verbs should work on
RoCE links if they use GRH headers.
• Set HCA to use Ethernet protocol:
Display the Device Manager and expand “System Devices”. Please refer to
Section 3.4.2, “Port Protocol Configuration”, on page 19.
3.7.2.2 Configuring Windows Host
Configuring Windows host requires configuring QoS. To configure QoS, please follow the pro-
cedure described in Section 5.3, “Configuring Quality of Service (QoS)”, on page 43
3.7.2.2.1 Using Global Pause Flow Control (GFC)
 To use Global Pause Flow Control (GFC) mode, disable QoS and Priority:
3.7.3 Configuring SwitchX® Based Switch System
 To enable RoCE, the SwitchX should be configured as follows:
• Ports facing the host should be configured as access ports, and either use global pause
or Port Control Protocol (PCP) for priority flow control
• Ports facing the network should be configured as trunk ports, and use Port Control Pro-
tocol (PCP) for priority flow control
3.7.3.1 Configuring SwitchX®
Step 1. Set the ports that face the hosts to access-dcb mode.
Step 2. Create LAG for ports that are connected to switches.
NOTE: This step should be performed in case there is more than one switch in the network.
Step 3. Assign ports to LAG (ports that connected to switches).
NOTE: This step should be performed in case there is more than one switch in the network.
Step 4. Enable trunk on all ports that belong to LAG (in the example below port-channel 55).
NOTE: This step should be performed in case there is more than one switch in the network.
Step 5. Enable IP routing (Should be configured when working with L3 only).
Since PFC is responsible for flow controlling at the granularity of traffic priority, it is
necessary to assign different priorities to different types of network traffic.
As per RoCE configuration, all ND/NDK traffic is assigned to one or more chosen pri-
orities, where PFC is enabled on those priorities.
PS $ Disable-NetQosFlowControl
PS $ Disable-NetAdapterQos
(config interface eth 1/19)# dcb priority-flow-control mode on force
(config interface eth 1/19) # switchport mode access-dcb
(config)# interface port-channel 55
(config)# interface ethernet 1/20 channel-group 55 mode active
(config)# interface port-channel 55 switchport mode trunk
(config)# ip routing