User Manual

Working With VPIRev 1.4.1-2.0.000
Mellanox Techologies
24
a. Open "Network Connections"
b. Select the IPoIB adapter and right click on it
c. Select "Properties"
d. Press "Configure" and then go to the "Advanced" tab
e. Select the payload MTU size and change it to 1500
f. Make sure that the firmware of the HCAs and the swit
ches supports the MTU you wish to set.
g. Configure your Subnet Manager (SM) to set the MTU value i
n the configuration file. The SM configuration
for MTU value is per Partition Key (PKey).
For example, to enable 4K MTUs on
a default PKey using the OpenSM SM6, log into the Linux machine
(running OpenSM) and perform the following commands:
h. Edit the file:
/usr/local/ofed/etc/opensm/partitions.conf
and include the line:
key0=0x7fff,ipoib,mtu=5 : ALL=full;
i. Restart OpenSM:
/etc/init.d/opensmd restart
4.2.6 Performance
For best performance, it is recommended to use ConnectX InfiniBand cards since they have
enhanced capabilities and offloading features.
To enhance networking performance, it is recommende
d to enable NetQueue as explained in sec-
tion “NetQueue” on page 22. and to use Jumbo Frames as explained in section “Maximum Trans-
mit Unit (MTU) Configuration” on page 23.
IPoIB can create up to 8 nics over each physical p
ort. To create 8 uplinks over each physical port
run:
esxcfg-module -s 'ipoib_uplink_num=8 ipoib_mac_type=1' ib_ipoib
The change will take effect after the reboot
For further information on VMware performanc
e, see http://www.vmware.com/resources/
techresources/10161
To enable 4k mtu support: run esxcfg-module -s 'set_4k_mtu=1' mlx4_en .
Changes will take effect after the reboot.
You must change the mac type, to add ipoib_uplink_num.
Mellanox Technologies Confidential