User guide
3–InfiniBand
®
Cluster Setup and Administration
QLogic Distributed Subnet Administration
IB0054606-02 A 3-17
Second, the Distributed SA handles overlaps by taking advantage of the fact that
Virtual Fabrics have unique numeric indexes. These indexes are assigned by the
QLogic Fabric Manager in the order which the Virtual Fabrics appear in the
configuration file. These indexes can be seen by using the command
iba_saquery -o vfinfo command. The Distributed SA will always assign a
SID to the Virtual Fabric with the lowest index, as shown in Figure 3-8. This
ensures that all copies of the Distributed SA in the IB fabric will make the same
decisions about assigning SIDs. However, it also means that the behavior of your
fabric can be affected by the order you configured the virtual fabrics.
Figure 3-8. Virtual Fabrics with Unique Numeric Indexes
In Figure 3-8, the Distributed SA assigns all overlapping SIDs to the “PSM_MPI”
fabric because it has the lowest Index
Distributed SA Configuration File
The Distributed SA configuration file is
/etc/sysconfig/iba/qlogic_sa.conf. It has several settings, but normally
administrators will only need to deal with two or three of them.
NOTE
The Distributed SA makes these assignments not because they are right,
but because they allow the fabric to work even though there are
configuration ambiguities. The correct solution in these cases is to redefine
the fabric so that no node will ever be a member of two Virtual Fabrics that
service the same SID.
9LUWXDO)DEULF³'HIDXOW´
3NH\[IIII
6,'5DQJH[[IIIIIIIIIIIIIIII
,QILQLEDQG)DEULF
9LUWXDO)DEULF³'HIDXOW´
3NH\[IIII
6,'5DQJH[[I
6,'5DQJH[
[I
'LVWULEXWHG6$
9LUWXDO)DEULF³'HIDXOW´3NH\[IIII
6,'5DQJH[[IIIIIIIIIIIIIIII
9LUWXDO)DEULF³360B03,´
,'3NH\[
6,'5DQJH[[I
6,'5DQJH
[
[I
9LUWXDO)DEULF³5HVHUYHG´
,'3NH\[
6,'5DQJH[[I
9LUWXDO)DEULF³360B03,´
3NH\[
6,'5DQJH[[I
6,'5DQJH[
[I