User Manual

Rev 2.0-3.0.0
Mellanox Technologies
107
Please note, the binary distribution of ScalableUPC is compiled with the following defaults:
FCA support. FCA is disabled at runtime by default and must be configured prior to
using it from the ScalableUPC. For further information, please refer to FCA User Man-
ual.
MXM support enabled by default
5.5.2 Runtime Parameters
The following parameters can be passed to “upcrun” in order to change FCA support behavior:
5.5.2.1 Enabling FCA Operations through Environment Variables in ScalableUPC
This method can be used to control UPC FCA offload from environment using job scheduler srun
utility. The valid values are: 1 - enable, 0 - disable.
To enable a specific operation with shell environment variables in ScalableUPC:
5.5.2.2 Controlling FCA Offload in ScalableUPC using Environment Variables
To enable FCA module under ScalableUPC:
To set FCA verbose level:
To set the minimal number of processes threshold to activate FCA:
Table 8 - Runtime Parameters
Parameter Description
-fca_enable <0|1>
Disables/Enables FCA support at runtime (default: disable).
-fca_np <value>
Enables FCA support for collective operations if the number
of processes in the job is greater than the
fca_np value
(default: 64).
-fca_verbose <level>
Sets verbosity level for the FCA modules
-fca_ops <+/->[op_list]
op_list
- comma separated list of collective operations.
-fca_ops <+/->[op_list] - Enables/disables only the
specified operations
-fca_ops <+/-> - Enables/disables all operations
By default all operations are enabled. Allowed operation names are:
barrier (br), bcast (bt), reduce (rc), allgather (ag). Each operation can
be also enabled/disabled via environment variable:
GASNET_FCA_ENABLE_BARRIER
GASNET_FCA_ENABLE_BCAST,
GASNET_FCA_ENABLE_REDUCE,
Note: All the operations are enabled by default.
% export GASNET_FCA_ENABLE_BARRIER=1
% export GASNET_FCA_ENABLE_BCAST=1
% export GASNET_FCA_ENABLE_REDUCE=1
% export GASNET_FCA_ENABLE_CMD_LINE=1
% export GASNET_FCA_VERBOSE_CMD_LINE=10
% export GASNET_FCA_NP_CMD_LINE=1