HP-MPI User's Guide (11th Edition)

Understanding HP-MPI
Running applications on HP-UX and Linux
Chapter 3 69
Including and excluding specific nodes can be accomplished by
passing arguments to SLURM as well. For example, to make sure a job
includes a specific node and excludes others, use something like the
following. In this case, n9 is a required node and n10 is specifically
excluded:
% bsub -I -n8 -ext "SLURM[nodelist=n9;exclude=n10]" \
mpirun -srun ./hello_world
Job <1892> is submitted to default queue <interactive>.
<<Waiting for dispatch ...>>
<<Starting on lsfhost.localdomain>>
Hello world! I'm 0 of 8 on n8
Hello world! I'm 1 of 8 on n8
Hello world! I’m 6 of 8 on n12
Hello world! I’m 2 of 8 on n9
Hello world! I’m 4 of 8 on n11
Hello world! I’m 7 of 8 on n12
Hello world! I’m 3 of 8 on n9
Hello world! I’m 5 of 8 on n11
In addition to displaying interconnect selection information, the
mpirun -prot option can be used to verify that application ranks
have been allocated in the desired manner:
% bsub -I -n12 $MPI_ROOT/bin/mpirun -prot -srun \
-n6 -N6 ./a.out
Job <1472> is submitted to default queue <interactive>.
<<Waiting for dispatch ...>>
<<Starting on lsfhost.localdomain>>
Host 0 -- ip 172.20.0.8 -- ranks 0
Host 1 -- ip 172.20.0.9 -- ranks 1
Host 2 -- ip 172.20.0.10 -- ranks 2
Host 3 -- ip 172.20.0.11 -- ranks 3
Host 4 -- ip 172.20.0.12 -- ranks 4
Host 5 -- ip 172.20.0.13 -- ranks 5
host | 0 1 2 3 4 5
======|===============================
0 : SHM VAPI VAPI VAPI VAPI VAPI
1 : VAPI SHM VAPI VAPI VAPI VAPI
2 : VAPI VAPI SHM VAPI VAPI VAPI
3 : VAPI VAPI VAPI SHM VAPI VAPI
4 : VAPI VAPI VAPI VAPI SHM VAPI
5 : VAPI VAPI VAPI VAPI VAPI SHM
Hello world! I'm 0 of 6 on n8
Hello world! I'm 3 of 6 on n11
Hello world! I’m 5 of 6 on n13
Hello world! I’m 4 of 6 on n12
Hello world! I’m 2 of 6 on n10
Hello world! I’m 1 of 6 on n9
• Use LSF on non-XC systems