User Manual
Table Of Contents
- Mellanox WinOF VPI User Manual
- Table of Contents
- List of Tables
- Document Revision History
- About this Manual
- 1 Introduction
- 2 Firmware Upgrade
- 3 Driver Features
- 3.1 Hyper-V with VMQ
- 3.2 Header Data Split
- 3.3 Receive Side Scaling (RSS)
- 3.4 Port Configuration
- 3.5 Load Balancing, Fail-Over (LBFO) and VLAN
- 3.6 Ports TX Arbitration
- 3.7 RDMA over Converged Ethernet (RoCE)
- 3.8 Network Virtualization using Generic Routing Encapsulation
- 3.9 Differentiated Services Code Point (DSCP)
- 4 Deploying Windows Server 2012 and Above with SMB Direct
- 5 Driver Configuration
- 6 Performance Tuning
- 7 OpenSM - Subnet Manager
- 8 InfiniBand Fabric
- 8.1 Network Direct Interface
- 8.2 part_man - Virtual IPoIB Port Creation Utility
- 8.3 InfiniBand Fabric Diagnostic Utilities
- 8.3.1 Utilities Usage
- 8.3.2 ibdiagnet
- 8.3.3 ibportstate
- 8.3.4 ibroute
- 8.3.5 ibdump
- 8.3.6 smpquery
- 8.3.7 perfquery
- 8.3.8 ibping
- 8.3.9 ibnetdiscover
- 8.3.10 ibtracert
- 8.3.11 sminfo
- 8.3.12 ibclearerrors
- 8.3.13 ibstat
- 8.3.14 vstat
- 8.3.15 osmtest
- 8.3.16 ibaddr
- 8.3.17 ibcacheedit
- 8.3.18 iblinkinfo
- 8.3.19 ibqueryerrors
- 8.3.20 ibsysstat
- 8.3.21 saquery
- 8.3.22 smpdump
- 8.4 InfiniBand Fabric Performance Utilities
- 8.4.1 ib_read_bw
- 8.4.2 ib_read_lat
- 8.4.3 ib_send_bw
- 8.4.4 ib_send_lat
- 8.4.5 ib_write_bw
- 8.4.6 ib_write_lat
- 8.4.7 ibv_read_bw
- 8.4.8 ibv_read_lat
- 8.4.9 ibv_send_bw
- 8.4.10 ibv_send_lat
- 8.4.11 ibv_write_bw
- 8.4.12 ibv_write_lat
- 8.4.13 nd_write_bw
- 8.4.14 nd_write_lat
- 8.4.15 nd_read_bw
- 8.4.16 nd_read_lat
- 8.4.17 nd_send_bw
- 8.4.18 nd_send_lat
- 8.4.19 NTttcp
- 9 Software Development Kit
- 10 Troubleshooting
- 11 Documentation
- Appendix A: Windows MPI (MS-MPI)
- Appendix B: NVGRE Configuration Scrips Examples
Rev 4.60
Mellanox Technologies
31
Step 6. Create a VLAN, in case VLANs are used in the network.
Step 7. Create a VLAN interface (Should be configured when working with L3 only).
Step 8. Assign an IP address to the vlan interface.
Step 9. Allow ports that belong to LAG (port-channel 55) access VLAN 55.
Step 10. Set access ports VLAN ID to match the host VLAN ID. The default (native) VLAN ID that is
associated with access port is VLAN ID 1.
Step 11. Disable spanning tree algorithm.
NOTE: In order to avoid disabling redundant links among the switches, this step should be per-
formed in case there is more than one switch in the network
Step 12. Enable LACP.
NOTE: This step should be performed in case there is more than one switch in the network.
Step 13. Enable OSPF routing protocol (Should be configured when working with L3 only).
Step 14. Enable PFC on the switch.
Step 15. Enable PFC on the specific priority 3.
Step 16. Enable PFC on the port.
3.7.3.1.1 Using Global Pause Flow Control (GFC)
Enable GFC on ports that are facing hosts (access ports).
(config)# vlan 55
(config)# interface vlan 55
(config)# interface vlan 55 ip address 100.5.5.1 255.255.255.252
(config)# interface port-channel 55 switchport trunk allowed-vlan 55
(config) # interface ethernet 1/19
(config interface eth 1/19) # switchport access vlan 55
(config)# no spanning-tree
(config)# lacp
(config)# protocol ospf
(config)# router ospf
(config)# interface vlan 55 ip ospf area 0.0.0.
(config)# dcb priority-flow-control enable force
(config)# dcb priority-flow-control priority 3 enable
(config interface eth 1/19)# no dcb priority-flow-control mode force
(config interface eth 1/19)# flowcontrol receive off force
(config interface eth 1/19)# flowcontrol send off force
(config interface eth 1/19)# dcb priority-flow-control mode on force
(config) # no dcb priority enable
(config) # interface ethernet 1/10
(config interface eth 1/10) # no dcb priority-flow-control mode force
(config interface eth 1/10) # flowcontrol receive on force
(config interface eth 1/10) # flowcontrol send on force