User Manual

Rev 2.2-1.0.1
Mellanox Technologies
151
Possible values for MXM_IB_MAP_MODE are:
• first - [Default] Maps the first suitable HCA port to all processes
• affinity - Distributes the HCA ports evenly among processes based on CPU affinity
• nearest - Tries to find the nearest HCA port based on CPU affinity
You may also use an asterisk (
*) and a question mark (?) to choose the HCA and the port you
would like to use.
• * - use all active cards/ports that are available
• ? - use the first active card/port that is available
For example:
-x MXM_IB_PORTS=*:?
will take all the active HCAs and the first active port on each of them.
5.4.5 Configuring MXM over the Ethernet Fabric
 To configure MXM over the Ethernet fabric:
Step 1. Make sure the Ethernet port is active.
% ibv_devinfo
ibv_devinfo displays the list of cards and ports in the system. Please make sure (in the
ibv_devinfo output) that the desired port has Ethernet at the link_layer field and that
its state is PORT_ACTIVE.
Step 2. Specify the ports you would like to use, if there is a non Ethernet active port in the card.
-x MXM_RDMA_PORTS=mlx4_0:1
-x MXM_IB_PORTS=mlx4_0:1
or
5.4.6 Configuring MXM over Different Transports
MXM v3.0 supports the following transports.
• Intra node communication via Shared Memory with KNEM support
• Unreliable Datagram (UD)
• Reliable Connected (RC)
• SELF transport - a single process communicates with itself
• Dynamically Connected Transport (DC) (at beta level)
Note: DC is supported on Connect-IB® HCAs with MLNX_OFED v2.1-1.0.0 and higher
.
To use DC set the following:
• in the command line:
% mpirun -x MXM_TLS=self,shm,dc
• from the SHELL:
% export MXM_TLS=self,shm,dc