User Manual

Rev 2.0-3.0.0
Mellanox Technologies
103
5.2.4 Compiling MPI Applications
Compiling MVAPICH Applications
Please refer to http://mvapich.cse.ohio-state.edu/support/mvapich_user_guide.html.
To review the default configuration of the installation, check the default configuration file:
Compiling Open MPI Applications
Please refer to http://www.open-mpi.org/faq/?category=mpi-apps.
5.3 MellanoX Messaging
MellanoX Messaging (MXM) provides enhancements to parallel communication libraries by
fully utilizing the underlying networking infrastructure provided by Mellanox HCA/switch hard-
ware. This includes a variety of enhancements that take advantage of Mellanox networking hard-
ware including:
• Multiple transport support including RC and UD
• Proper management of HCA resources and memory structures
• Efficient memory registration
• One-sided communication semantics
• Connection management
• Receive side tag matching
• Intra-node shared memory communication
These enhancements significantly increase the scalability and performance of message commu-
nications in the network, alleviating bottlenecks within the parallel communication libraries.
The latest MXM software can be downloaded from the Mellanox website.
5.3.1 Compiling OpenMPI with MXM
Step 1. Install MXM from RPM.
MXM will be installed automatically in the /opt/mellanox/mxm folder.
Step 2.
Enter OpenMPI source directory and run:
MLNX_OFED v2.0 or later comes with a pre-installed version of MXM v1.1 and OpenMPI
compiled with MXM v1.1.
/usr/mpi/<compiler>/mvapich-<mvapich-ver>/etc/mvapich.conf
% rpm -ihv mxm-x.y.z-1.x86_64.rpm
% cd $OMPI_HOME
% ./configure --with-mxm=/opt/mellanox/mxm <... other configure parameters...>
% make all && make install