HP-MPI Version 2.3.1 for Linux Release Note
Table Of Contents
- HP-MPI V2.3.1 for Linux Release Note
- Table of Contents
- 1 Information About This Release
- 2 New or Changed Features in V2.3.1
- 3 New or Changed Features in V2.3
- 3.1 Options Supported Only on HP Hardware
- 3.2 System Check
- 3.3 Default Message Size Changed For -ndd
- 3.4 MPICH2 Compatibility
- 3.5 Support for Large Messages
- 3.6 Redundant License Servers
- 3.7 License Release/Regain on Suspend/Resume
- 3.8 Expanded Functionality for -ha
- 3.8.1 Support for High Availability on InfiniBand Verbs
- 3.8.2 Highly Available Infrastructure (-ha:infra)
- 3.8.3 Using MPI_Comm_connect and MPI_Comm_accept
- 3.8.4 Using MPI_Comm_disconnect
- 3.8.5 Instrumentation and High Availability Mode
- 3.8.6 Failure Recover (-ha:recover)
- 3.8.7 Network High Availability (-ha:net)
- 3.8.8 Failure Detection (-ha:detect)
- 3.8.9 Clarification of the Functionality of Completion Routines in High Availability Mode
- 3.9 Enhanced InfiniBand Support for Dynamic Processes
- 3.10 Singleton Launching
- 3.11 Using the -stdio=files Option
- 3.12 Using the -stdio=none Option
- 3.13 Expanded Lightweight Instrumentation
- 3.14 The api option to MPI_INSTR
- 3.15 New mpirun option -xrc
- 4 Known Issues and Workarounds
- 4.1 Running on iWarp Hardware
- 4.2 Running with Chelsio uDAPL
- 4.3 Mapping Ranks to a CPU
- 4.4 OFED Firmware
- 4.5 Spawn on Remote Nodes
- 4.6 Default Interconnect for -ha Option
- 4.7 Linking Without Compiler Wrappers
- 4.8 Locating the Instrumentation Output File
- 4.9 Using the ScaLAPACK Library
- 4.10 Increasing Shared Memory Segment Size
- 4.11 Using MPI_FLUSH_FCACHE
- 4.12 Using MPI_REMSH
- 4.13 Increasing Pinned Memory
- 4.14 Disabling Fork Safety
- 4.15 Using Fork with OFED
- 4.16 Memory Pinning with OFED 1.2
- 4.17 Upgrading to OFED 1.2
- 4.18 Increasing the nofile Limit
- 4.19 Using appfiles on HP XC Quadrics
- 4.20 Using MPI_Bcast on Quadrics
- 4.21 MPI_Issend Call Limitation on Myrinet MX
- 4.22 Terminating Shells
- 4.23 Disabling Interval Timer Conflicts
- 4.24 libpthread Dependency
- 4.25 Fortran Calls Wrappers
- 4.26 Bindings for C++ and Fortran 90
- 4.27 Using HP Caliper
- 4.28 Using -tv
- 4.29 Extended Collectives with Lightweight Instrumentation
- 4.30 Using -ha with Diagnostic Library
- 4.31 Using MPICH with Diagnostic Library
- 4.32 Using -ha with MPICH
- 4.33 Using MPI-2 with Diagnostic Library
- 4.34 Quadrics Memory Leak
- 5 Installation Information
- 6 Licensing Information
- 7 Additional Product Information
NOTE: If a process uses -ha:detect, then all processes it communicates with must
also use -ha:detect. Likewise, if a process uses -ha:recover then all processes it
communicates with must also use -ha:recover.
3.8.1 Support for High Availability on InfiniBand Verbs
You can use the -ha option with the -IBV option. When using -ha, automatic network
selection is restricted to TCP and IBV. Be aware that -ha no longer forces the use of
TCP.
If TCP is desired on a system that has both TCP and IBV available, it is necessary to
explicitly specify -TCP on the mpirun command line. All high availability features are
available on both TCP and IBV interconnects.
3.8.2 Highly Available Infrastructure (-ha:infra)
The -ha option allows MPI ranks to be more tolerant of system failures. However,
failures can still affect the mpirun and mpid processes used to support HP-MPI
applications.
When the mpirun/mpid infrastructure is affected by failures, it can affect the application
ranks and the services provided to those ranks. Using -ha:infra indicates that the
mpirun and mpid processes normally used to support the application ranks are
terminated after all ranks have called MPI_Init().
This option implies -stdio=none (see “Using the -stdio=none Option” (page 23)).
To record stdout and stderr, consider using the -stdio=files option (see “Using
the -stdio=files Option” (page 22)) when using -ha:infra.
Because the mpirun and mpid processes do not persist for the length of the application
run, some features are not supported with -ha:infra. These include -spawn, -commd,
-1sided.
Using -ha:infra does not allow a convenient way to terminate all ranks associated
with the application. It is the responsibility of the user to have a mechanism for
application teardown.
The -ha:infra option is available only on HP hardware. Usage on third-party
hardware will result in an error message.
3.8.3 Using MPI_Comm_connect and MPI_Comm_accept
MPI_Comm_connect and MPI_Comm_accept can now be used without the -spawn
option to mpirun. This allows applications launched using the -ha:infra option to
call these routines. When using high availability mode, these routines do not deadlock
even if the remote process exits before, during, or after the call.
18 New or Changed Features in V2.3