HP-MPI Version 2.3.1 for Linux Release Note
Table Of Contents
- HP-MPI V2.3.1 for Linux Release Note
- Table of Contents
- 1 Information About This Release
- 2 New or Changed Features in V2.3.1
- 3 New or Changed Features in V2.3
- 3.1 Options Supported Only on HP Hardware
- 3.2 System Check
- 3.3 Default Message Size Changed For -ndd
- 3.4 MPICH2 Compatibility
- 3.5 Support for Large Messages
- 3.6 Redundant License Servers
- 3.7 License Release/Regain on Suspend/Resume
- 3.8 Expanded Functionality for -ha
- 3.8.1 Support for High Availability on InfiniBand Verbs
- 3.8.2 Highly Available Infrastructure (-ha:infra)
- 3.8.3 Using MPI_Comm_connect and MPI_Comm_accept
- 3.8.4 Using MPI_Comm_disconnect
- 3.8.5 Instrumentation and High Availability Mode
- 3.8.6 Failure Recover (-ha:recover)
- 3.8.7 Network High Availability (-ha:net)
- 3.8.8 Failure Detection (-ha:detect)
- 3.8.9 Clarification of the Functionality of Completion Routines in High Availability Mode
- 3.9 Enhanced InfiniBand Support for Dynamic Processes
- 3.10 Singleton Launching
- 3.11 Using the -stdio=files Option
- 3.12 Using the -stdio=none Option
- 3.13 Expanded Lightweight Instrumentation
- 3.14 The api option to MPI_INSTR
- 3.15 New mpirun option -xrc
- 4 Known Issues and Workarounds
- 4.1 Running on iWarp Hardware
- 4.2 Running with Chelsio uDAPL
- 4.3 Mapping Ranks to a CPU
- 4.4 OFED Firmware
- 4.5 Spawn on Remote Nodes
- 4.6 Default Interconnect for -ha Option
- 4.7 Linking Without Compiler Wrappers
- 4.8 Locating the Instrumentation Output File
- 4.9 Using the ScaLAPACK Library
- 4.10 Increasing Shared Memory Segment Size
- 4.11 Using MPI_FLUSH_FCACHE
- 4.12 Using MPI_REMSH
- 4.13 Increasing Pinned Memory
- 4.14 Disabling Fork Safety
- 4.15 Using Fork with OFED
- 4.16 Memory Pinning with OFED 1.2
- 4.17 Upgrading to OFED 1.2
- 4.18 Increasing the nofile Limit
- 4.19 Using appfiles on HP XC Quadrics
- 4.20 Using MPI_Bcast on Quadrics
- 4.21 MPI_Issend Call Limitation on Myrinet MX
- 4.22 Terminating Shells
- 4.23 Disabling Interval Timer Conflicts
- 4.24 libpthread Dependency
- 4.25 Fortran Calls Wrappers
- 4.26 Bindings for C++ and Fortran 90
- 4.27 Using HP Caliper
- 4.28 Using -tv
- 4.29 Extended Collectives with Lightweight Instrumentation
- 4.30 Using -ha with Diagnostic Library
- 4.31 Using MPICH with Diagnostic Library
- 4.32 Using -ha with MPICH
- 4.33 Using MPI-2 with Diagnostic Library
- 4.34 Quadrics Memory Leak
- 5 Installation Information
- 6 Licensing Information
- 7 Additional Product Information
amount of physical memory that is detected by HP-MPI. If the detection is wrong, the
correct amount of physical memory should be set with MPI_PHYSICAL_MEMORY in
bytes. This memory is only returned to the operating system for use by other processes
after the job resumes and exits.
3.8 Expanded Functionality for -ha
HP-MPI high availability mode eliminates teardown when ranks exit abnormally.
Further communications involved with ranks that are unreachable return error class
MPI_ERR_EXITED, but do not force the application to teardown as long as the
MPI_Errhandler is set to MPI_ERRORS_RETURN. This mode never uses shared
memory for inter-process communication.
HP-MPI high availability mode is accessed by using the -ha option to mpirun. The
high availability mode has been expanded substantially in this release. Some of the
expanded features are available only on HP platforms.
To allow users to select the correct level of high availability features for an application,
the -ha option now accepts a number of additional colon-separated options which
may be appended to the -ha command line option. For example:
mpirun -ha[:option1][:option2][...]
Table 3-2 High Availability Options
DescriptionsOptions
Basic high availability protection. When specified with no options, -ha
is equivalent to -ha:noteardown:detect.
-ha
Use of lightweight instrumentation with -ha. HP hardware only.-ha -i
High availability for infrastructure (mpirun, mpid). HP hardware only.
For more information, see “Highly Available Infrastructure (-ha:infra)”
(page 18).
-ha:infra
Detection of failed communication connections. For more information,
see “Failure Detection (-ha:detect)” (page 21).
-ha:detect
Recovery of communication connections after failures. HP hardware only.
For more information, see “Failure Recover (-ha:recover)” (page 19).
-ha:recover
Enables Automatic Port Migration. HP hardware only. For more
information, see “Network High Availability (-ha:net)” (page 21).
-ha:net
If mpirun and mpid exist, they should not tear down an application in
which some ranks have exited after MPI_Init, but before MPI_Finalize.
If -ha:infra is specified, this option is ignored.
-ha:noteardown
Indicates that all options should be used. -ha:all is equivalent to
-ha:infra:noteardown:recover:detect:net, which is equivalent
to -ha:infra:recover:net.
-ha:all
3.8 Expanded Functionality for -ha 17