Platform LSF Reference Version 6.2
Parameters
Platform LSF Reference
516
LSB_DEFAULT_PJLTYPE
Syntax
LSB_DEFAULT_PJLTYPE="
pjl_type [pjl_type] ..."
Description
Contains the list of all PJL types as Boolean resources that are intended to be
autodetected.
The order of MPI types in the list defines the preference of one type over another within
the same host group, but not the host group order itself.
For heterogeneous HPC environments, bsub -a auto recognizes the actual PJL type at
execution time. esub.auto checks the value of LSB_DEFAULT_PJLTYPE in lsf.conf.
esub.auto creates an additional -R ’same[]’ clause in the job submission string. All PJL
types that are listed in the LSB_DEFAULT_PJLTYPE variable are added to the clause,
preserving the original order.
The job is scheduled according to its requirements and the additional same[] clause.
Each host in the cluster is assigned one or more Boolean resources that correspond to
the PJL types (MPI implementations) supported by the host. The hosts are broken into
the host groups according to LSF policies. When a suitable group is found, the job is
dispatched for execution.
mpirun.lsf determines the appropriate PJL and assigns the value to LSF_PJL_TYPE,
based on the values of the Boolean resources assigned to a chosen host group and the
preference order specified in LSB_DEFAULT_PJLTYPE.
The Boolean resources for MPI autodection are defined in
lsf.shared at installation.
For example:
Begin Resource
RESOURCENAME TYPE INTERVAL INCREASING DESCRIPTION
...
lammpi Boolean () () (LAM MPI)
mpich_gm Boolean () () (MPICH GM MPI)
mpichp4 Boolean () () (MPICH P4 MPI)
mvapich Boolean () () (Infiniband MPI)
ibmmpi Boolean () () (IBM POE MPI)
hpmpi Boolean () () (HP MPI)
sgimpi Boolean () () (SGI MPI)
intelmpi Boolean () () (Intel MPI)
...
End Resource
You must assign appropriate Boolean resources for MPI type to each host in the Host
section of
lsf.cluster.cluster_name. For example:
Begin Host
HOSTNAME model type server r1m mem swp RESOURCES
Linux-01 ! ! 1 3.5 () () (mpich_gm lammpi)
Linux-02 ! ! 1 3.5 () () (mpich_gm lammpi)
Linux-03 ! ! 1 3.5 () () (lammpi)
sierraA ! ! 1 3.5 () () (rms)
sierraB ! ! 1 3.5 () () (rms)
End Host
Example
LSB_DEFAULT_PJLTYPE="mpich_gm lammpi rms"