HP StorageWorks Scalable File Share Release Notes - Version 2.3

New and changed features in HP SFS Version 2.31–26
The LNETS configured on each node would be as follows:
Consequently, the client node would use the o2ib1(ib1) LNET to communicate with even ranked server nodes
[2,4,6] since o2ib1 appears first in the LNET options on the client side. And would use o2ib0(ib0) to
communicate with the other SFS nodes.
1.8 . 2. 6 Section 7.11. 2 Set t ing l ustre.ln e t
Add a third bullet:
• If additional interfaces are configured and the default network option isn't satisfactory
1.8 . 2. 7 Section 7.11.2a Setting lnet.ip2nets
Alternatively, the Lustre Networks (LNETs) configuration can be controlled by another system parameter
called options lnet ip2nets. It allows to defined LNETs conditionally based on node's IP addresses, but using
an identical ip2nets option across all nodes. See section 7.11.1a.1 above for its syntax.
HP SFS normally doesn't set this parameter, but automatically sets options LNET networks based on the
interconnect information defined in the system configuration.
You can override the default settings of options lnet networks using the SFS lnet.ip2nets
attribute. By default, this attribute is not defined and HP SFS sets the options LNET networks parameter
automatically. However, if you define lnet.ip2nets using the set attribute command, then the new
value will override the value automatically set by HP SFS.
For example, you may want to override the default in the following case:
• If clients nodes need to use multiple InfiniBand rails (interfaces).
WARNING! Once the lnet.ip2nets attribute is set, all subsequent changes to the HP SFS server
network configuration have no effect on the Lustre options LNET networks setting, nor on the options lnet
ip2nets setting. If the network configuration changes, it is necessary to manually update the
lnet.ip2nets attribute, or delete it altogether using the delete attribute command.
The following example shows the lnet.ip2nets attribute on a server with a complex connectivity:
Interface ib0 is connected to a set of single-rail clients; Interface ib1 is connected to a set of dual-rail clients.
Nodes LNET #1 LNET #2
Client node o2ib1(ib1) o2ib0(ib0)
SFS node #1 o2ib0(ib0)
SFS node #2 o2ib0(ib0) o2ib1(ib0:0)
SFS node #3 o2ib0(ib0)
SFS node #4 o2ib0(ib0) o2ib1(ib0:0)
SFS node #5 o2ib0(ib0)
SFS node #6 o2ib0(ib0) o2ib1(ib0:0)
sfs> show attribute lnet.ip2nets
Attribute Value/Description
--------------- -------------------------------------
lnet.ip2nets
o2ib0(ib0) 172.22.184.[72-77]; o2ib1(ib1) 172.23.184.[72-77];
o2ib2(ib1:0) 172.23.185.72 172.23.185.[74-77/2];
tcp0(eth1) 16.16.184.[72-77]
Lustre lnet options