Installing Standard LSF on a Subset of HP XC Nodes

these files look for an XC-specific file: /etc/hptc-release. If found, these files assume that
the LSF daemons should be interfacing with SLURM.
For the fat nodes running standard LSF, this is not true. To work around this, we need to create
an "identity" file that only exists on the thin nodes, and have the setup files for standard LSF look
for this "identity" file.
The "identity" file will be /var/lsf/lsfslurm. Use the pdsh command to create this file on
all nodes except the fat nodes. For our example the pdsh command is as follows:
# pdsh -a -x xc[1-6] touch /var/lsf/lsfslurm
6. Change the file name in the setup files by using the following sed commands:
# sed -e "s?/etc/hptc-release?/var/slurm/lsfslurm?g" <
profile.lsf.notxc > profile.tmp
# sed -e "s?/etc/hptc-release?/var/slurm/lsfslurm?g" < cshrc.lsf.notxc
> cshrc.tmp
7. Confirm that the only change was the filename:
# diff profile.tmp profile.lsf.notxc
120c120
< # Currently we only check for HP-hptc: /var/slurm/lsfslurm
---
> # Currently we only check for HP-hptc: /etc/hptc-release
127c127
< _slurm_signature_file="/var/slurm/lsfslurm"
---
> _slurm_signature_file="/etc/hptc-release"
# diff cshrc.tmp cshrc.lsf.notxc
266c266
< if ( -f /var/slurm/lsfslurm ) then
---
> if ( -f /etc/hptc-release ) then
8. Replace the old file with the new file:
# mv -f profile.tmp profile.lsf.notxc
# mv -f cshrc.tmp cshrc.lsf.notxc
9. Add the new LSF execution host(s) to LSF_SERVER_HOSTS in the lsf.conf file. In our
example the new LSF_SERVER_HOSTS entry is as follows
:
LSF_SERVER_HOSTS="lsfhost.localdomain xc1 xc2 xc3 xc4 xc5 xc6"
Create a custom startup script for standard LSF
This startup script will be run on every node, so it needs to be selective and only operate on the nodes
on which standard LSF is desired.
1. Create the following script in /opt/hptc/lsf/etc/slsf and edit it to contain your "fat" nodes:
#!/bin/bash
#
# chkconfig: 345 99 01
# description: standard LSF daemon management
# processname: slsf