User guide

5–Using Other MPIs
Intel MPI
IB0054606-02 A 5-9
Using DAPL 2.0.
$ rpm -qa | grep dapl
dapl-devel-static-2.0.19-1
compat-dapl-1.2.14-1
dapl-2.0.19-1
dapl-debuginfo-2.0.19-1
compat-dapl-devel-static-1.2.14-1
dapl-utils-2.0.19-1
compat-dapl-devel-1.2.14-1
dapl-devel-2.0.19-1
2. Verify that there is a /etc/dat.conf file. It should be installed by the
dapl- RPM. The file dat.conf contains a list of interface adapters
supported by uDAPL service providers. In particular, it must contain
mapping entries for OpenIB-cma for dapl 1.2.x and ofa-v2-ib for
dapl 2.0.x, in a form similar to this (each on one line):
OpenIB-cma u1.2 nonthreadsafe default libdaplcma.so.1
dapl.1.2 "ib0 0" ""
and
ofa-v2-ib0 u2.0 nonthreadsafe default libdaplofa.so.2
dapl.2.0 "ib0 0" ""
3. On every node, type the following command (as a root user):
# modprobe rdma_ucm
To ensure that the module is loaded when the driver is loaded, add
RDMA_UCM_LOAD=yes to the /etc/infiniband/openib.conf file.
(Note that rdma_cm is also used, but it is loaded automatically.)
4. Bring up an IPoIB interface on every node, for example, ib0. See
“Configuring IPoIB” on page 3-5 for more details on configuring IPoIB.
Intel MPI has different bin directories for 32-bit (bin) and 64-bit (bin64); 64-bit is
the most commonly used.
To launch MPI jobs, the Intel installation directory must be included in PATH and
LD_LIBRARY_PATH.
When using sh for launching MPI jobs, run the following command:
$ source <$prefix>/bin64/mpivars.sh
When using csh for launching MPI jobs, run the following command:
$ source <$prefix>/bin64/mpivars.csh