Product specifications
Table Of Contents
- Table of Contents
- 1 Introduction
- 2 Feature Overview
- 3 Step-by-Step Cluster Setup and MPI Usage Checklists
- 4 InfiniPath Cluster Setup and Administration
- Introduction
- Installed Layout
- Memory Footprint
- BIOS Settings
- InfiniPath and OpenFabrics Driver Overview
- OpenFabrics Drivers and Services Configuration and Startup
- Other Configuration: Changing the MTU Size
- Managing the InfiniPath Driver
- More Information on Configuring and Loading Drivers
- Performance Settings and Management Tips
- Host Environment Setup for MPI
- Checking Cluster and Software Status
- 5 Using QLogic MPI
- Introduction
- Getting Started with MPI
- QLogic MPI Details
- Use Wrapper Scripts for Compiling and Linking
- Configuring MPI Programs for QLogic MPI
- To Use Another Compiler
- Process Allocation
- mpihosts File Details
- Using mpirun
- Console I/O in MPI Programs
- Environment for Node Programs
- Environment Variables
- Running Multiple Versions of InfiniPath or MPI
- Job Blocking in Case of Temporary InfiniBand Link Failures
- Performance Tuning
- MPD
- QLogic MPI and Hybrid MPI/OpenMP Applications
- Debugging MPI Programs
- QLogic MPI Limitations
- 6 Using Other MPIs
- A mpirun Options Summary
- B Benchmark Programs
- C Integration with a Batch Queuing System
- D Troubleshooting
- Using LEDs to Check the State of the Adapter
- BIOS Settings
- Kernel and Initialization Issues
- OpenFabrics and InfiniPath Issues
- Stop OpenSM Before Stopping/Restarting InfiniPath
- Manual Shutdown or Restart May Hang if NFS in Use
- Load and Configure IPoIB Before Loading SDP
- Set $IBPATH for OpenFabrics Scripts
- ifconfig Does Not Display Hardware Address Properly on RHEL4
- SDP Module Not Loading
- ibsrpdm Command Hangs when Two Host Channel Adapters are Installed but Only Unit 1 is Connected to the Switch
- Outdated ipath_ether Configuration Setup Generates Error
- System Administration Troubleshooting
- Performance Issues
- QLogic MPI Troubleshooting
- Mixed Releases of MPI RPMs
- Missing mpirun Executable
- Resolving Hostname with Multi-Homed Head Node
- Cross-Compilation Issues
- Compiler/Linker Mismatch
- Compiler Cannot Find Include, Module, or Library Files
- Problem with Shell Special Characters and Wrapper Scripts
- Run Time Errors with Different MPI Implementations
- Process Limitation with ssh
- Number of Processes Exceeds ulimit for Number of Open Files
- Using MPI.mod Files
- Extending MPI Modules
- Lock Enough Memory on Nodes When Using a Batch Queuing System
- Error Creating Shared Memory Object
- gdb Gets SIG32 Signal Under mpirun -debug with the PSM Receive Progress Thread Enabled
- General Error Messages
- Error Messages Generated by mpirun
- MPI Stats
- E Write Combining
- F Useful Programs and Files
- G Recommended Reading
- Glossary
- Index

QLogic Host Channel Adapter and QLogic OFED Software Users Guide
QLogic OFED Version 1.4
Index-2 IB6054601-00 H
S
chkconfig F-2
Cluster 1-2
checker, Intel 4-31
checking status 4-29
documentation G-2
set up 3-1
Command line options for wrapper scripts 5-6
Compiler
and linker variables 5-10
compiling MPI programs, troubleshooting
D-12
cross-compilation issues D-14
include, module, or library files cannot be
found D-15
Intel 5-9
linker mismatch D-15
mpixx 5-7
on development nodes D-16
PathScale 5-8
PGI 5-8
support 2-5
supported by QLogic MPI 5-8
Compute node Glossary-1
Configuration files, summary F-17
Configuration, VNIC 4-11
Connected mode Glossary-1
Context sharing 5-10, Glossary-1
error messages 5-13
software 5-12
Contexts, hardware, software 5-10
--continue F-8
Couldn’t connect to error message
D-28
CPU affinity, setting 5-21
D
DAPL Glossary-1
Debug
-d F-8
--debug F-8
-debug A-6
-debugger A-6
Debuggers supported 5-25
-debug-no-pause A-6
Development node Glossary-1
Development nodes D-16
DHCP Glossary-1
-disable-mpi-progress-check A-3
-display A-6
-distributed 5-16, A-2
Distributions supported 2-4
dmesg F-2, F-3
Documentation conventions 1-4
Documentation for InfiniPath 1-5
Driver
see also ib_ipath
configuration, IPoIB 4-6
error messages D-30
filesystem 4-21
InfiniPath and OpenFabrics overview 4-5
InfiniPath driver state 4-19
ipath_ether 4-1
loading with unsupported kernel D-3
rebuilding or reinstalling if a different kernel
is installed D-3
starting, stopping, and restarting 4-20
unloading manually 4-21
E
eager array full after overflow...
error message D-27
EE Glossary-2
EEC Glossary-2
Environment Modules documentation G-2
Environment variables 5-10, 5-17, 5-18
Error
attaching to shared memory error
message D-28
creating shared memory object error
message D-28
creating shared memory object in
shm_open... error message C-5
mmapping shared memory error
message D-28