Users Guide
Table Of Contents
- Table of Contents
- 1 Regulatory and Safety Approvals
- 2 Functional Description
- 3 Network Link and Activity Indication
- 4 Features
- 4.1 Software and Hardware Features
- 4.2 Virtualization Features
- 4.3 VXLAN
- 4.4 NVGRE/GRE/IP-in-IP/Geneve
- 4.5 Stateless Offloads
- 4.6 Priority Flow Control
- 4.7 Virtualization Offload
- 4.8 SR-IOV
- 4.9 Network Partitioning (NPAR)
- 4.10 Security
- 4.11 RDMA over Converged Ethernet – RoCE
- 4.12 VMWare Enhanced Networking Stack (ENS)
- 4.13 Supported Combinations
- 4.14 Unsupported Combinations
- 5 Installing the Hardware
- 6 Software Packages and Installation
- 7 Updating the Firmware
- 8 Link Aggregation
- 9 System-Level Configuration
- 10 PXE Boot
- 11 SR-IOV – Configuration and Use Case Examples
- 12 NPAR – Configuration and Use Case Example
- 13 Tunneling Configuration Examples
- 14 RoCE – Configuration and Use Case Examples
- 15 DCBX – Data Center Bridging
- 16 DPDK – Configuration and Use Case Examples
- Revision History
Broadcom NetXtreme-E-UG304-2CS
113
NetXtreme-E User Guide User Guide for Dell Platforms
bnxtqos -dev=$IFACE set_apptlv set_ets
tsa=0:ets,1:ets,2:strict,3:strict,4:strict,5:strict,6:strict,7:strict
up2tc=0:0,1:1,2:0,3:0,4:0,5:0,6:0,7:0 tcbw=10,90
bnxtqos -dev=$IFACE set_pfc enabled=1
#Uncomment if using LLDP Agent
#/usr/sbin/lldptool -T -i $IFACE -V APP app=1,5,34*
#/usr/sbin/lldptool -T -i $IFACE -V APP app=1,1,35093
#/usr/sbin/lldptool -T -i $IFACE -V APP app=1,3,4791
#/usr/sbin/lldptool -T -i $IFACE -V ETS-CFG
tsa=0:ets,1:ets,2:strict,3:strict,4:strict,5:strict,6:st
#rict,7:strict up2tc=0:0,1:1,2:0,3:0,4:0,5:0,6:0,7:0 tcbw=10,90
#/usr/sbin/lldptool -T -i $IFACE -V PFC enabled=1
#systemctl restart lldpad
sleep 10
/sbin/modprobe bnxt_re
sleep 5
mkdir -p /sys/kernel/config/rdma_cm/bnxt_re0
echo RoCE v2 > /sys/kernel/config/rdma_cm/bnxt_re0/ports/1/default_roce_mode
mkdir -p /sys/kernel/config/bnxt_re/bnxt_re0
cd /sys/kernel/config/bnxt_re/bnxt_re0/ports/1/cc/
# Uncomment below for DSCP Mode
#echo -n 0x22 > roce_dscp # DSCP RoCE packets
#echo -n 0x6 > cnp_prio # Priority for CNP Packets
#echo -n 0x23 > cnp_dscp # DSCP for CNP packets
#echo -n 0x1 > vlan_tx_disable # Set DSCP mode
# Uncomment below for VLAN mode
#echo -n 0x0 > vlan_tx_disable # Set VLAN mode
#echo -n 0x6 > cnp_prio # Priority for CNP Packets
The support for DSCP tagging through lldptool is supported on a newer kernel.
3. Set the script to be executable with the following command:
sudo chmod 755 /etc/ifup-roce-<IFACE>
14.2.5.6.3 Debian
To configure a boot-time RoCE configuration, create the following /etc/network/if-up.d/roce script with the following
commands:
#!/bin/sh
if [ -x /etc/ifup-roce-${IFACE} ]; then
/etc/ifup-roce-${IFACE}
fi
Set the script to be executable with the following command:
sudo chmod 755 /etc/network/if-up.d/roce
14.2.5.6.4 Red Hat
1. Create an /sbin/ifup-local script to allow boot-time RoCE configuration with the following commands: