HP-MPI User's Guide (11th Edition)
Understanding HP-MPI
Running applications on HP-UX and Linux
Chapter 390
the application to hang due to lack of message progression while inside
the Elan collective. This is actually a rather uncommon situation in real
applications. But if such hangs are observed, then the use of Elan
collectives can be disabled by using the environment variable
MPI_USE_LIBELAN=0.
ITAPI On HP-UX InfiniBand is available by using the ITAPI protocol,
which requires MLOCK privileges. When setting up InfiniBand on an
HP-UX system, all users (other than root) who wish to use InfiniBand
need to have their group id in the /etc/privgroup file and the permissions
for access must be enabled via:
% setprivgrp -f /etc/privgroup
The above may be done automatically at boot time, but should also be
performed once manually after setup of the InfiniBand drivers to ensure
access. For example:
% grep user /etc/passwd
user:UJqaKNCCsESLo,O.fQ:836:1007:User Name:/home/user:/bin/tcsh
% grep 1007 /etc/group
ibusers::1007:
% cat /etc/privgroup
ibusers MLOCK
#add entries to /etc/privgroup
% setprivgrp -f /etc/privgroup
A one-time setting can also be done using:
/usr/sbin/setprivgrp <group> MLOCK
The above setting will not survive a reboot.
Interconnect selection examples
The default MPI_IC_ORDER will generally result in the fastest available
protocol being used. The following example uses the default ordering and
also supplies a -netaddr setting, in case TCP/IP is the only interconnect
available.
% echo MPI_IC_ORDER
ibv:vapi:udapl:psm:mx:gm:elan:tcp
% export MPIRUN_SYSTEM_OPTIONS="-netaddr 192.168.1.0/24"