Users Guide
Table Of Contents
- Table of Contents
- 1 Regulatory and Safety Approvals
- 2 Functional Description
- 3 Network Link and Activity Indication
- 4 Features
- 4.1 Software and Hardware Features
- 4.2 Virtualization Features
- 4.3 VXLAN
- 4.4 NVGRE/GRE/IP-in-IP/Geneve
- 4.5 Stateless Offloads
- 4.6 Priority Flow Control
- 4.7 Virtualization Offload
- 4.8 SR-IOV
- 4.9 Network Partitioning (NPAR)
- 4.10 Security
- 4.11 RDMA over Converged Ethernet – RoCE
- 4.12 VMWare Enhanced Networking Stack (ENS)
- 4.13 Supported Combinations
- 4.14 Unsupported Combinations
- 5 Installing the Hardware
- 6 Software Packages and Installation
- 7 Updating the Firmware
- 8 Link Aggregation
- 9 System-Level Configuration
- 10 PXE Boot
- 11 SR-IOV – Configuration and Use Case Examples
- 12 NPAR – Configuration and Use Case Example
- 13 Tunneling Configuration Examples
- 14 RoCE – Configuration and Use Case Examples
- 15 DCBX – Data Center Bridging
- 16 DPDK – Configuration and Use Case Examples
- Revision History
Broadcom NetXtreme-E-UG304-2CS
115
NetXtreme-E User Guide User Guide for Dell Platforms
mkdir -p /sys/kernel/config/rdma_cm/bnxt_re0
echo RoCE v2 > /sys/kernel/config/rdma_cm/bnxt_re0/ports/1/default_roce_mode
mkdir -p /sys/kernel/config/bnxt_re/bnxt_re0
cd /sys/kernel/config/bnxt_re/bnxt_re0/ports/1/cc/
# DSCP configuration
echo -n 0x1 > roce_dscp
echo -n 0x1 > roce_prio
echo -n 0x1 > vlan_tx_disable
# Set CC parameters for and enable
echo -n 0x1 > ecn_enable
echo -n 0x1 > ecn_marking
echo -n 0xc8 > tcp_cp
echo -n 0x3 > nph_per_state
echo -n 0x28 > rtt
echo -n 0x4 > g
echo -n 0x1f4 > init_cr
echo -n 0x3ff > init_tr
echo -n 0x1f40 > inact_cp
echo -n 0x1 > apply
14.2.5.7.2 Setup Script
A setup script is provided as part of the release to configure the priority, DSCP, and congestion control parameters. The script
does not load the drivers, bring up the interface, or setup the addresses.
Usage: bnxt_setupcc.sh [OPTION]...
-d - RoCE Device Name (e.g. bnxt_re0, bnxt_re_bond)
-i - Ethernet Interface Name (example: p1p1 or for bond, specify slave interfaces like -i p6p1 -i p6p2)
-r [0-7] - RoCE Packet Priority
-s VALUE - RoCE Packet DSCP Value
-c [0-7] - RoCE CNP Packet Priority
-p VALUE - RoCE CNP Packet DSCP Value
-h - Display help
NOTE: In SIT release 212.1.x, the cosq used for CNPs has been removed from the user scope. Only two traffic classes
are available to the user. Previous versions of the script were still configuring the 3rd traffic to be used for CNPs
which results in unexpected behaviors (ensure that traffic class 2 is not set in the prio2tc).
The following is an example of running the setup script:
cd $REL_DIR/Linux/netxtreme-bnxt_en-x.y.z/bnxt_re
./bnxt_setupcc.sh -d bnxt_re0 -i p1p1-r 5 -s 0x22 -c 6 -p 0x23
14.2.5.8 Switch Configuration
NCC uses ECN to react to marked packets within the network switch infrastructure during times of congestion. The correct
ECN threshold value is specific to each switch port, and is dependent on the link speed of that port. The following table shows
which values are to be used for deterministic marking (cc_mode=0).
Link Speed ECN Min./Max. Threshold (kilobytes)
10 Gb/s 12/12