User Manual

TRex 82 / 113
Kernel params:
# cat /proc/cmdline
BOOT_IMAGE=/vmlinuz-3.10.0-514.el7.x86_64 root=/dev/mapper/cl-root ro crashkernel=auto rd. -
lvm.lv=cl/root rd.lvm.lv=cl/swap nomodeset rhgb quiet intel_iommu=on iommu=pt isolcpus -
=2-23 nohz_full=2-23 selinux=0 audit=0
82599 and Mellanox VFs:
# cat /etc/rc.local
##############
# 82599
##############
ifconfig enp2s0f0 up
ifconfig enp2s0f1 up
echo 9500 > /sys/bus/pci/devices/0000:02:00.0/net/
*
/mtu
echo 9500 > /sys/bus/pci/devices/0000:02:00.1/net/
*
/mtu
echo 3 > /sys/bus/pci/devices/0000:02:00.0/sriov_numvfs
echo 1 > /sys/bus/pci/devices/0000:02:00.1/sriov_numvfs
##############
# Mellanox
##############
echo 9500 > /sys/bus/pci/devices/0000:84:00.0/net/
*
/mtu
echo 9500 > /sys/bus/pci/devices/0000:84:00.1/net/
*
/mtu
echo 3 > /sys/bus/pci/devices/0000:84:00.0/sriov_numvfs
echo 1 > /sys/bus/pci/devices/0000:84:00.1/sriov_numvfs
Intel i40e VFs:
# cat /etc/modprobe.d/tuned.conf
options i40e max_vfs=3,3
7.6.3 x710 specific instructions
For x710 (i40e driver), we needed to download latest kernel driver. On all distributions we were using, existing driver was not
new enough.
To make the system use your new compiled driver with the correct parameters:
Copy the .ko file to /lib/modules/Your kernel version as seen by uname -r/kernel/drivers/net/ethernet/intel/i40e/i40e.ko
7.6.4 82599 specific instructions
In order to make VF interfaces work correctly, we had to increase mtu on related PF interfaces.
For example, if you run with max_vfs=1,1 (one VF per PF), you will have something like this: