User guide

3–InfiniBand
®
Cluster Setup and Administration
IB and OpenFabrics Driver Overview
IB0054606-02 A 3-3
IB and OpenFabrics Driver Overview
The ib_qib module provides low-level QLogic hardware support, and is the base
driver for both MPI/PSM programs and general OpenFabrics protocols such as
IPoIB and sockets direct protocol (SDP). The driver also supplies the Subnet
Management Agent (SMA) component.
The following is a list of the optional configurable OpenFabrics components and
their default settings:
 IPoIB network interface. This component is required for TCP/IP networking
for running IP traffic over the IB link. It is not running until it is configured.
 OpenSM. This component is disabled at startup. QLogic recommends using
the QLogic Fabric Manager (FM), which is included with the IFS or optionally
available within the QLogic switches. QLogic FM or OpenSM can be
installed on one or more nodes with only one node being the master SM.
 SRP (OFED and QLogic modules). SRP is not running until the module is
loaded and the SRP devices on the fabric have been discovered.
 MPI over uDAPL (can be used by Intel MPI). IPoIB must be configured
before MPI over uDAPL can be set up.
Other optional drivers can now be configured and enabled, as described in “IPoIB
Network Interface Configuration” on page 3-3.
Complete information about starting, stopping, and restarting the QLogic OFED+
services are in “Managing the ib_qib Driver” on page 3-21.
IPoIB Network Interface Configuration
The following instructions show you how to manually configure your OpenFabrics
IPoIB network interface. QLogic recommends using the QLogic OFED+ Host
Software Installation package or the iba_config tool. For larger clusters,
FastFabric can be used to automate installation and configuration of many nodes.
These tools automate the configuration of the IPoIB network interface. This
example assumes that you are using
sh or bash as your shell, all required
QLogic OFED+ and OpenFabric’s RPMs are installed, and your startup scripts
have been run (either manually or at system boot).
For this example, the IPoIB network is 10.1.17.0 (one of the networks reserved for
private use, and thus not routable on the Internet), with a /8 host portion. In this
case, the netmask must be specified.