Product specifications
Table Of Contents
- Table of Contents
- 1 Introduction
- 2 Feature Overview
- 3 Step-by-Step Cluster Setup and MPI Usage Checklists
- 4 InfiniPath Cluster Setup and Administration
- Introduction
- Installed Layout
- Memory Footprint
- BIOS Settings
- InfiniPath and OpenFabrics Driver Overview
- OpenFabrics Drivers and Services Configuration and Startup
- Other Configuration: Changing the MTU Size
- Managing the InfiniPath Driver
- More Information on Configuring and Loading Drivers
- Performance Settings and Management Tips
- Host Environment Setup for MPI
- Checking Cluster and Software Status
- 5 Using QLogic MPI
- Introduction
- Getting Started with MPI
- QLogic MPI Details
- Use Wrapper Scripts for Compiling and Linking
- Configuring MPI Programs for QLogic MPI
- To Use Another Compiler
- Process Allocation
- mpihosts File Details
- Using mpirun
- Console I/O in MPI Programs
- Environment for Node Programs
- Environment Variables
- Running Multiple Versions of InfiniPath or MPI
- Job Blocking in Case of Temporary InfiniBand Link Failures
- Performance Tuning
- MPD
- QLogic MPI and Hybrid MPI/OpenMP Applications
- Debugging MPI Programs
- QLogic MPI Limitations
- 6 Using Other MPIs
- A mpirun Options Summary
- B Benchmark Programs
- C Integration with a Batch Queuing System
- D Troubleshooting
- Using LEDs to Check the State of the Adapter
- BIOS Settings
- Kernel and Initialization Issues
- OpenFabrics and InfiniPath Issues
- Stop OpenSM Before Stopping/Restarting InfiniPath
- Manual Shutdown or Restart May Hang if NFS in Use
- Load and Configure IPoIB Before Loading SDP
- Set $IBPATH for OpenFabrics Scripts
- ifconfig Does Not Display Hardware Address Properly on RHEL4
- SDP Module Not Loading
- ibsrpdm Command Hangs when Two Host Channel Adapters are Installed but Only Unit 1 is Connected to the Switch
- Outdated ipath_ether Configuration Setup Generates Error
- System Administration Troubleshooting
- Performance Issues
- QLogic MPI Troubleshooting
- Mixed Releases of MPI RPMs
- Missing mpirun Executable
- Resolving Hostname with Multi-Homed Head Node
- Cross-Compilation Issues
- Compiler/Linker Mismatch
- Compiler Cannot Find Include, Module, or Library Files
- Problem with Shell Special Characters and Wrapper Scripts
- Run Time Errors with Different MPI Implementations
- Process Limitation with ssh
- Number of Processes Exceeds ulimit for Number of Open Files
- Using MPI.mod Files
- Extending MPI Modules
- Lock Enough Memory on Nodes When Using a Batch Queuing System
- Error Creating Shared Memory Object
- gdb Gets SIG32 Signal Under mpirun -debug with the PSM Receive Progress Thread Enabled
- General Error Messages
- Error Messages Generated by mpirun
- MPI Stats
- E Write Combining
- F Useful Programs and Files
- G Recommended Reading
- Glossary
- Index
xx IB6054601-00 H
QLogic Host Channel Adapter and QLogic OFED Software Users Guide
QLogic OFED Version 1.4
S
Performance Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-9
Unexpected Low Bandwidth or Poor Latency . . . . . . . . . . . . . . . . . . . D-9
Large Message Receive Side Bandwidth Varies with Socket Affinity on
Opteron Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-10
MVAPICH Performance Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-10
Erratic Performance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-11
Method 1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-11
Method 2. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-11
Performance Warning if ib_ipath Shares Interrupts with eth0 . . . D-12
QLogic MPI Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-12
Mixed Releases of MPI RPMs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-13
Missing mpirun Executable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-13
Resolving Hostname with Multi-Homed Head Node . . . . . . . . . . . . . . D-14
Cross-Compilation Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-14
Compiler/Linker Mismatch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-15
Compiler Cannot Find Include, Module, or Library Files . . . . . . . . . . . D-15
Compiling on Development Nodes . . . . . . . . . . . . . . . . . . . . . . . D-16
Specifying the Run-time Library Path . . . . . . . . . . . . . . . . . . . . . D-16
Problem with Shell Special Characters and Wrapper Scripts . . . . . . . D-17
Run Time Errors with Different MPI Implementations . . . . . . . . . . . . . D-18
Process Limitation with ssh . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-20
Number of Processes Exceeds ulimit for Number of Open Files . . D-20
Using MPI.mod Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-21
Extending MPI Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-21
Lock Enough Memory on Nodes When Using a Batch Queuing
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-23
Error Creating Shared Memory Object . . . . . . . . . . . . . . . . . . . . . . . . D-24
gdb Gets SIG32 Signal Under mpirun -debug with the PSM
Receive Progress Thread Enabled . . . . . . . . . . . . . . . . . . . . . . . . . . D-25
General Error Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-26
Error Messages Generated by mpirun . . . . . . . . . . . . . . . . . . . . . . . D-26
Messages from the QLogic MPI (InfiniPath) Library. . . . . . . . . . D-26
MPI Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-28
Driver and Link Error Messages Reported by MPI Programs. . . D-30
MPI Stats . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-31
E Write Combining
Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-1
Verify Write Combining is Working . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-1
PAT and Write Combining . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-2