White Papers

17 Dell HPC Omni-Path Fabric: Supported Architecture and Application Study June 2016
Figure 9 Starting Embedded Subnet Manager
Controlling Subnet Manager using Switch CLI
The default login credentials for the switch is admin/adminpass. From the switch CLI, use the following
commands to manage the SM.
 smcontrol start
 smcontrol stop
 smcontrol restart
 smcontrol status
3.5.2 Host-Based Fabric Manager
Host-based Fabric Manager can run on a compute node/host. This package is available in the Intel Fabric
Suite. It can be used to manage both small and large scale clusters; however, host-based fabric manager is
recommended for cluster sizes greater than 128 nodes. Upon installation, the configuration file is located at
/etc/sysconfig/opafm.xml. The opafm service can be managed using the standard Linux systemctl
command. Fabric manager needs at least 1GB of physical memory and one CPU core for each Fabric
Manager instance. The physical memory needed varies with the size of the cluster. For example, when
managing a cluster of 10,000 nodes or more, 5GB of memory per fabric instance is required. For very large
clusters with more than 16,000 nodes, 15GB of memory is required per fabric manager instance. When
running multiple Fabric Manager Instances on a single management node, the physical memory
requirements should be multiplied by the number of fabric manager instances. When multiple Fabric
managers are running on the fabric, master subnet manager will be assigned to the host with lowest Host
Fabric Interface GUID.
Controlling Fabric Manager
 systemctl start opafm.service
 systemctl stop opafm.service
 systemctl restart opafm.service
 systemctl status opafm.service