Product specifications

D – Multi-Subnet Fabrics
Overlapping Subnets
D-4 D000006-000 Rev A
Q
fabric operation. Follow the installation instructions outlined in “Getting Started” on
page 3-1 with the following adjustments:
From “Design the Fabric” on page 3-1, design the cabling such that the Fast Fabric
node will be connected to each IB subnet it will manage. The Fast Fabric node
must also have a management network path to all the nodes in all the subnets it
will manage. As part of the design consider where routes between subnets are
desired, between IB routers, IPoIB routers, etc.
“Set Up the Fabric” on page 3-2 can be performed as per the instuctions. When
installing the Fabric Access software on the IB Management node, IPoIB will need
to be configured such that each IB subnet is an independent IPoIB network interface,
typically with different IP subnets. Consult the QuickSilver Fabric Access Software
Users Guide for more information on configuring IPoIB.
NOTE: When managing a cluster where compute nodes are not running the
QuickSilver host stack or where the IPoIB settings on the compute nodes
are incompatible with the IB management node (e.g., when a 4K MTU is
used on the compute nodes), it is recommended not to run IPoIB on the
IB management node(s).
“Installing and Verifying Firmware on the SilverStorm IB Chassis” on page 3-6 can
be performed as per the instructions. When creating the chassis file, list all
SilverStorm 9000 series internally-managed IB switches in all subnets. If desired,
additional files may also be created per subnet that list only the SilverStorm chassis
in each subnet.
“Installing and Configuring the Subnet Manager” on page 3-9 can be performed as
per the instructions. At least one subnet manager is required per IB subnet. Consult
the QuickSilver Fabric Manager and Fabric Viewer Users Guide for more information
on how to configure a host-based SM node to manage more than one IB subnet.
“Installing and Verifying Firmware on the IB Switches” on page 3-10. At this time
this operation is not supported for IB management nodes connected to more than
one IB subnet.
“Installing InfiniBand on the Remaining Servers” on page 3-12 can be performed
as per the instructions. When creating the hosts file, list all the hosts in all subnets
except the IB management node where Fast Fabric is being run. If desired,
additional files may also be created per subnet that list the hosts in each subnet
(except the IB management node).
For hosts that are connected to more than one IB subnet, IPoIB will need to be
configured such that each IB subnet is an independent IPoIB network interface,
typically with different IP subnets. Consult the QuickSilver Fabric Access Software
Users Guide for more information on configuring IPoIB.
“Verifying InfiniBand on the Remaining Servers” on page 3-16 has the following
adjustments from the instructons.