User Manual
Table Of Contents
- Mellanox WinOF VPI User Manual
- Table of Contents
- List of Tables
- Document Revision History
- About this Manual
- 1 Introduction
- 2 Firmware Upgrade
- 3 Driver Features
- 3.1 Hyper-V with VMQ
- 3.2 Header Data Split
- 3.3 Receive Side Scaling (RSS)
- 3.4 Port Configuration
- 3.5 Load Balancing, Fail-Over (LBFO) and VLAN
- 3.6 Ports TX Arbitration
- 3.7 RDMA over Converged Ethernet (RoCE)
- 3.8 Network Virtualization using Generic Routing Encapsulation
- 3.9 Differentiated Services Code Point (DSCP)
- 4 Deploying Windows Server 2012 and Above with SMB Direct
- 5 Driver Configuration
- 6 Performance Tuning
- 7 OpenSM - Subnet Manager
- 8 InfiniBand Fabric
- 8.1 Network Direct Interface
- 8.2 part_man - Virtual IPoIB Port Creation Utility
- 8.3 InfiniBand Fabric Diagnostic Utilities
- 8.3.1 Utilities Usage
- 8.3.2 ibdiagnet
- 8.3.3 ibportstate
- 8.3.4 ibroute
- 8.3.5 ibdump
- 8.3.6 smpquery
- 8.3.7 perfquery
- 8.3.8 ibping
- 8.3.9 ibnetdiscover
- 8.3.10 ibtracert
- 8.3.11 sminfo
- 8.3.12 ibclearerrors
- 8.3.13 ibstat
- 8.3.14 vstat
- 8.3.15 osmtest
- 8.3.16 ibaddr
- 8.3.17 ibcacheedit
- 8.3.18 iblinkinfo
- 8.3.19 ibqueryerrors
- 8.3.20 ibsysstat
- 8.3.21 saquery
- 8.3.22 smpdump
- 8.4 InfiniBand Fabric Performance Utilities
- 8.4.1 ib_read_bw
- 8.4.2 ib_read_lat
- 8.4.3 ib_send_bw
- 8.4.4 ib_send_lat
- 8.4.5 ib_write_bw
- 8.4.6 ib_write_lat
- 8.4.7 ibv_read_bw
- 8.4.8 ibv_read_lat
- 8.4.9 ibv_send_bw
- 8.4.10 ibv_send_lat
- 8.4.11 ibv_write_bw
- 8.4.12 ibv_write_lat
- 8.4.13 nd_write_bw
- 8.4.14 nd_write_lat
- 8.4.15 nd_read_bw
- 8.4.16 nd_read_lat
- 8.4.17 nd_send_bw
- 8.4.18 nd_send_lat
- 8.4.19 NTttcp
- 9 Software Development Kit
- 10 Troubleshooting
- 11 Documentation
- Appendix A: Windows MPI (MS-MPI)
- Appendix B: NVGRE Configuration Scrips Examples
Rev 4.60
Mellanox Technologies
35
3.9 Differentiated Services Code Point (DSCP)
DSCP is a mechanism used for classifying network traffic on IP networks. It uses the 6-bit Dif-
ferentiated Services Field (DS or DSCP field) in the IP header for packet classification purposes.
Using Layer 3 classification enables you to maintain the same classification semantics beyond
local network, across routers.
Every transmitted packet holds the information allowing network devices to map the packet to
the appropriate 802.1Qbb CoS. For DSCP based PFC the packet is marked with a DSCP value in
the Differentiated Services (DS) field of the IP header.
3.9.1 Setting the DSCP in the IP Header
Marking DSCP value in the IP header is done differently for IP packets constructed by the NIC
(e.g. RDMA traffic) and for packets constructed by the IP stack (e.g. TCP traffic).
• For IP packets generated by the IP stack, the DSCP value is provided by the IP stack.
The NIC does not validate the match between DSCP and Class of Service (CoS) values.
CoS and DSCP values are expected to be set through standard tools, such as PowerShell
command New-NetQosPolicy using PriorityValue8021Action and DSCPAction flags
respectively.
• For IP packets generated by the NIC (RDMA), the DSCP value is generated according
to the CoS value programmed for the interface. CoS value is set through standard tools,
such as PowerShell command New-NetQosPolicy using PriorityValue8021Action flag.
The NIC uses a mapping table between the CoS value and the DSCP value configured
through the RroceDscpMarkPriorityFlow- Control[0-7] Registry keys
3.9.2 Configuring Quality of Service for TCP and RDMA Traffic
Step 1. Verify that DCB is installed and enabled (is not installed by default).
Step 2. Import the PowerShell modules that are required to configure DCB.
Step 3. Configure DCB.
Step 4. Enable Network Adapter QoS.
Step 5. Enable Priority Flow Control (PFC) on the specific priority 3,5.
3.9.3 Configuring DSCP for TCP Traffic
• Create a QoS policy to tag All TCP/UDP traffic with CoS value 1 and DSCP value 9.
DSCP can also be configured per protocol.
$ Install-WindowsFeature Data-Center-Bridging
$ import-module NetQos
$ import-module DcbQos
$ import-module NetAdapter
$ Set-NetQosDcbxSetting -Willing 0
$ Set-NetAdapterQos -Name "Cx3Pro_ETH_P1" -Enabled 1
$ Enable-NetQosFlowControl 3,5
$ New-NetQosPolicy "DEFAULT" -PriorityValue8021Action 3 -DSCPAction 9
$ New-NetQosPolicy "TCP" -IPProtocolMatchCondition TCP -PriorityValue8021Action 3 -DSCPAction 16
$ New-NetQosPolicy "UDP" -IPProtocolMatchCondition UDP -PriorityValue8021Action 3 -DSCPAction 32