HP-MPI Version 2.2.7 for Linux Release Note
fw_ver: 4.7.0
node_guid: 0008:f104:0396:a56c
....
max_pkeys: 64
local_ca_ack_delay: 15
port: 1
state: PORT_ACTIVE (4)
max_mtu: 2048 (4)
....
phys_state: LINK_UP (5)
GID[ 0]: fe80:0000:0000:0000:0008:f104:0396:a56d
port: 2
state: PORT_ACTIVE (4)
max_mtu: 2048 (4)
....
phys_state: LINK_UP (5)
GID[ 0]: fe80:0000:0000:0001:0008:f104:0396:a56e
The subnet ID is contained in the first 16 digits of the GID. The second 16 digits of the GID are
the interface ID. In this example, port 1 on both nodes is on the same subnet and has the subnet
prefix fe80:0000:0000:0000. By default, HP-MPI makes connections between nodes using the port
1. This port selection is only for the initial InfiniBand connection setup.
In this second example, the default connection cannot be made. The following is the first node
configuration:
$ ibv_devinfo -v
hca_id: mthca0
fw_ver: 4.7.0
node_guid: 0008:f104:0396:62b4
....
max_pkeys: 64
local_ca_ack_delay: 15
port: 1
state: PORT_ACTIVE (4)
max_mtu: 2048 (4)
....
phys_state: LINK_UP (5)
GID[ 0]: fe80:0000:0000:0001:0008:f104:0396:62b5
port: 2
state: PORT_ACTIVE (4)
max_mtu: 2048 (4)
....
phys_state: LINK_UP (5)
GID[ 0]: fe80:0000:0000:0000:0008:f104:0396:62b6
The following is the second node configuration:
$ ibv_devinfo -v
hca_id: mthca0
fw_ver: 4.7.0
node_guid: 0008:f104:0396:6270
....
max_pkeys: 64
local_ca_ack_delay: 15
port: 1
state: PORT_ACTIVE (4)
max_mtu: 2048 (4)
....
phys_state: LINK_UP (5)
GID[ 0]: fe80:0000:0000:0000:0008:f104:0396:6271
port: 2
state: PORT_ACTIVE (4)
max_mtu: 2048 (4)
....
phys_state: LINK_UP (5)
GID[ 0]: fe80:0000:0000:0001:0008:f104:0396:6272
In this case, the subnet with prefix fe80:0000:0000:0001 includes port 1 on the first node and port
2 on the second node. The second subnet with prefix fe80:0000:0000:0000 includes port 2 on the
first node and port 1 on the second.
To make the connection using the fe80:0000:0000:0001 subnet, pass this option to mpirun:
-e MPI_IB_PORT_GID=fe80:0000:0000:0001
If the MPI_IB_PORT_GID environment variable is not supplied to mpirun, HP-MPI checks the
subnet prefix for the first port it chooses, determines that the subnet prefixes do not match, prints
the following message, and exits:
16 Information About This Release