User guide

Chapter 2. InfiniBand products for BladeCenter 17
management modules) to facilitate setup and management. After you set up a switch module
and bring it online, the on-board Cisco Subnet Manager brings distributed intelligence to the
InfiniBand network.
Within the BladeCenter chassis, Cisco InfiniBand switch modules manage traffic to and from
HCA expansion cards on the BladeCenter hosts. Each HCA expansion card adds two
InfiniBand ports to a BladeCenter host. Each HCA port connects through the unit backplane
to a particular switch module slot. The first InfiniBand port of each HCA card (ib0) connects to
the Cisco InfiniBand switch module in I/O slot 7, and the second InfiniBand port of each HCA
card (ib1) connects to I/O slot 9.
Figure 2-2 shows the InfiniBand and Management module port connections in the
BladeCenter H.
Figure 2-2 Internal BladeCenter InfiniBand connectivity
0
B
S
S
1
1
0
B
S
S
1
4
1
0
B
S
S
2
1
0
B
S
S
3
1
0
B
S
S
4
1
0
B
S
S
5
1
0
B
S
S
6
1
0
B
S
S
7
1
0
B
S
S
8
1
0
B
S
S
9
1
0
B
S
S
1
0
1
0
B
S
S
1
1
1
0
B
S
S
1
2
1
0
B
S
S
1
3
1
1 2 3 4 5 6 7 8 9 10 11 12 13 14 Mgmt Mgmt 17
Eth Eth 18
15 19
16 20
21
22
23
Bottom Cisco 4x InfiniBand Switch Module (bay 9) 24
MM1
MM2
Top Cisco 4x InfiniBand Switch module (bay 7) 17
18
19
16 20
15 21
22
Mgmt Mgmt 23
1 2 3 4 5 6 7 8 9 10 11 12 13 14 Eth Eth 24
External
IB
Uplinks
MM1
Ethernet
Uplink
MM2
Ethernet
Uplink
BladeCenter Chassis
(BSS = Blade Server Slot)
External
IB
Uplinks
Green = 4x InfiniBand
Blue = Ethernet Management
Bridge
Module
Slot 5
Bridge
Module
Slot 3
Ports 19/20/21 and
22/23/24 are bundled
into 12x connectors
Ports 19/20/21 and
22/23/24 are bundled
into 12x connectors
Ports 17 and 18 are 4x
connectors
Ports 17 and 18 are 4x
connectors