User Manual

Rev 2.1-1.0.6
Mellanox Technologies
123
5.5.1 Installing ScalableUPC
Mellanox ScalableUPC is installed as part of MLNX_OFED package.
Mellanox ScalableUPC is distributed as source RPM as well and can be downloaded from the
Mellanox website.
Please note, the binary distribution of ScalableUPC is compiled with the following defaults:
• FCA support. FCA is disabled at runtime by default and must be configured prior to
using it from the ScalableUPC. For further information, please refer to FCA User Man-
ual.
• MXM support enabled by default
5.5.2 FCA Runtime Parameters
The following parameters can be passed to “upcrun” in order to change FCA support behavior:
5.5.2.1 Enabling FCA Operations through Environment Variables in ScalableUPC
This method can be used to control UPC FCA offload from environment using job scheduler srun
utility. The valid values are: 1 - enable, 0 - disable.
 To enable a specific operation with shell environment variables in ScalableUPC:
Mellanox OFED 1.8.5 includes ScalableUPC Rev 2.2, which is installed under:
/opt/mellanox/bupc.
If you have installed OFED 1.8.5, you do not need to download and install ScalableUPC.
Table 15 - Runtime Parameters
Parameter Description
-fca_enable <0|1>
Disables/Enables FCA support at runtime (default: disable).
-fca_np <value>
Enables FCA support for collective operations if the number
of processes in the job is greater than the
fca_np value
(default: 64).
-fca_verbose <level>
Sets verbosity level for the FCA modules
-fca_ops <+/->[op_list]
op_list
- comma separated list of collective operations.
• -fca_ops <+/->[op_list] - Enables/disables only the
specified operations
• -fca_ops <+/-> - Enables/disables all operations
By default all operations are enabled. Allowed operation names are:
barrier (br), bcast (bt), reduce (rc), allgather (ag). Each operation can
be also enabled/disabled via environment variable:
• GASNET_FCA_ENABLE_BARRIER
• GASNET_FCA_ENABLE_BCAST,
• GASNET_FCA_ENABLE_REDUCE,
Note: All the operations are enabled by default.
% export GASNET_FCA_ENABLE_BARRIER=1
% export GASNET_FCA_ENABLE_BCAST=1
% export GASNET_FCA_ENABLE_REDUCE=1