Product specifications
Table Of Contents
- Table of Contents
- 1 Introduction
- 2 Feature Overview
- 3 Step-by-Step Cluster Setup and MPI Usage Checklists
- 4 InfiniPath Cluster Setup and Administration
- Introduction
- Installed Layout
- Memory Footprint
- BIOS Settings
- InfiniPath and OpenFabrics Driver Overview
- OpenFabrics Drivers and Services Configuration and Startup
- Other Configuration: Changing the MTU Size
- Managing the InfiniPath Driver
- More Information on Configuring and Loading Drivers
- Performance Settings and Management Tips
- Host Environment Setup for MPI
- Checking Cluster and Software Status
- 5 Using QLogic MPI
- Introduction
- Getting Started with MPI
- QLogic MPI Details
- Use Wrapper Scripts for Compiling and Linking
- Configuring MPI Programs for QLogic MPI
- To Use Another Compiler
- Process Allocation
- mpihosts File Details
- Using mpirun
- Console I/O in MPI Programs
- Environment for Node Programs
- Environment Variables
- Running Multiple Versions of InfiniPath or MPI
- Job Blocking in Case of Temporary InfiniBand Link Failures
- Performance Tuning
- MPD
- QLogic MPI and Hybrid MPI/OpenMP Applications
- Debugging MPI Programs
- QLogic MPI Limitations
- 6 Using Other MPIs
- A mpirun Options Summary
- B Benchmark Programs
- C Integration with a Batch Queuing System
- D Troubleshooting
- Using LEDs to Check the State of the Adapter
- BIOS Settings
- Kernel and Initialization Issues
- OpenFabrics and InfiniPath Issues
- Stop OpenSM Before Stopping/Restarting InfiniPath
- Manual Shutdown or Restart May Hang if NFS in Use
- Load and Configure IPoIB Before Loading SDP
- Set $IBPATH for OpenFabrics Scripts
- ifconfig Does Not Display Hardware Address Properly on RHEL4
- SDP Module Not Loading
- ibsrpdm Command Hangs when Two Host Channel Adapters are Installed but Only Unit 1 is Connected to the Switch
- Outdated ipath_ether Configuration Setup Generates Error
- System Administration Troubleshooting
- Performance Issues
- QLogic MPI Troubleshooting
- Mixed Releases of MPI RPMs
- Missing mpirun Executable
- Resolving Hostname with Multi-Homed Head Node
- Cross-Compilation Issues
- Compiler/Linker Mismatch
- Compiler Cannot Find Include, Module, or Library Files
- Problem with Shell Special Characters and Wrapper Scripts
- Run Time Errors with Different MPI Implementations
- Process Limitation with ssh
- Number of Processes Exceeds ulimit for Number of Open Files
- Using MPI.mod Files
- Extending MPI Modules
- Lock Enough Memory on Nodes When Using a Batch Queuing System
- Error Creating Shared Memory Object
- gdb Gets SIG32 Signal Under mpirun -debug with the PSM Receive Progress Thread Enabled
- General Error Messages
- Error Messages Generated by mpirun
- MPI Stats
- E Write Combining
- F Useful Programs and Files
- G Recommended Reading
- Glossary
- Index
QLogic Host Channel Adapter and QLogic OFED Software Users Guide
QLogic OFED Version 1.4
Index-6 IB6054601-00 H
S
performance improvement over IB Verbs
6-12
Platform (Scali) 6-9
programming documentation G-1
using 3-2
MPI
mpi_stress F-3
MPI.mod files, using D-21
NPROCS 5-19
runscript-xqa-14.0: ssh -x>
Cannot detect InfiniPath
interconnect error message D-13
SHELL 5-19
MPI-2, supported features in ROMIO 5-2
MPICH Glossary-3
CC 5-19
CCC 5-19
F90 5-19
ROOT 5-18
mpiexec with PBS C-1
MPIHOSTS 5-19
mpihosts file Glossary-3
creating 5-3
formats of 5-14
generating using SLURM C-3
MPIRUN
see also mpirun, mpirun command
.up001: Warning: ulimit for the
number of open files… error
message D-20
<nodename>:Warning:Couldn’t
resolve listen address ’foo’
on head node error message D-14
All node programs ended
prematurely without connecting
to mpirun error message D-29
Cannot obtain IP address of /...
error message D-29
mpirun from the 2.3 software
distribution requires all node
processes to be running 2.3
software error message D-13
No connection received from 1
node process on node error
message D-29
No connection received from 1
node process... error message D-29
Node program(s) exitted during
connection setup error message
D-20
<nodename> node program
unexpectedly quit: Exiting error
message
D-29
Some node programs ended
prematurely... error message D-29
Waiting at most another 60
seconds for the remaining
ranks... error message D-5
mpirun F-12
see also MPIRUN, mpirun command
Not all node programs have
connected error message D-14
Please install mpirun error message
D-13
error message format of D-26
options A-1
mpirun command F-3
console I/O 5-17
executable missing D-13
measuring latency between two nodes B-2
measuring MPI bandwidth between two
nodes B-3
measuring MPI latency in host rings B-5
microbenchmarking the messaging rate B-4
options 5-22
running QLogic MPI programs 5-15
setting environment variables 5-18
specifying the mpihosts file 5-14
using with strace 5-25
with -ppn option 5-16
mpi-selector utility 6-6
MR Glossary-4
MTRR F-10, Glossary-4
editing BIOS settings to fix E-2
mapping D-9
mapping and write combining E-2
using ipath_mtrr script to fix issues E-3
MTU Glossary-4
changing the size 4-18
size 4-22