User Manual

Rev 2.1-1.0.6
Mellanox Technologies
119
5.2.4 Compiling MPI Applications
Compiling MVAPICH Applications
Please refer to http://mvapich.cse.ohio-state.edu/support/mvapich_user_guide.html.
To review the default configuration of the installation, check the default configuration file:
Compiling Open MPI Applications
Please refer to http://www.open-mpi.org/faq/?category=mpi-apps.
5.3 MellanoX Messaging
MellanoX Messaging (MXM) provides enhancements to parallel communication libraries by
fully utilizing the underlying networking infrastructure provided by Mellanox HCA/switch hard-
ware. This includes a variety of enhancements that take advantage of Mellanox networking hard-
ware including:
• Multiple transport support including RC and UD
• Proper management of HCA resources and memory structures
• Efficient memory registration
• One-sided communication semantics
• Connection management
• Receive side tag matching
• Intra-node shared memory communication
These enhancements significantly increase the scalability and performance of message commu-
nications in the network, alleviating bottlenecks within the parallel communication libraries.
The latest MXM software can be downloaded from the Mellanox website.
MLNX_OFED v2.0 or later comes with a pre-installed version of MXM v2.x and OpenMPI
compiled with MXM v2.x.
5.3.1 Compiling OpenMPI with MXM
Step 1. Install MXM from RPM.
MXM will be installed automatically in the /opt/mellanox/mxm folder.
Step 2. Enter OpenMPI source directory and run:
MLNX_OFED v2.0 or later comes with a pre-installed version of MXM v2.x and OpenMPI
compiled with MXM v2.x.
To check the version of MXM installed on your host, run:
/usr/mpi/<compiler>/mvapich-<mvapich-ver>/etc/mvapich.conf
% rpm -ihv mxm-x.y.z-1.x86_64.rpm
% cd $OMPI_HOME
% ./configure --with-mxm=/opt/mellanox/mxm <... other configure parameters...>
% make all && make install
rpm -qi mxm