LSF Version 7.3 - Administering Platform LSF

Configure Chunk Job Dispatch
484 Administering Platform LSF
Configuring a special high-priority queue for short jobs is not desirable because
users may be tempted to send all of their jobs to this queue, knowing that it has high
priority.
Configure Chunk Job Dispatch
CHUNK_JOB_SIZE (lsb.queues)
By default, CHUNK_JOB_SIZE is not enabled.
1 To configure a queue to dispatch chunk jobs, specify the CHUNK_JOB_SIZE
parameter in the queue definition in
lsb.queues.
For example, the following configures a queue named
chunk, which dispatches
up to 4 jobs in a chunk:
Begin Queue
QUEUE_NAME = chunk
PRIORITY = 50
CHUNK_JOB_SIZE = 4
End Queue
Postrequisites: After adding CHUNK_JOB_SIZE to lsb.queues, use badmin
reconfig
to reconfigure your cluster.
Chunk jobs and job
throughput
Throughput can deteriorate if the chunk job size is too big. Performance may
decrease on queues with CHUNK_JOB_SIZE greater than 30. You should evaluate
the chunk job size on your own systems for best performance.
CHUNK_JOB_SIZE (lsb.applications)
By default, CHUNK_JOB_SIZE is not enabled. Enabling application-level job
chunking overrides queue-level job chunking.
1 To configure an application profile to chunk jobs together, specify the
CHUNK_JOB_SIZE parameter in the application profile definition in
lsb.applications.
Specify CHUNK_JOB_SIZE=1 to disable job chunking for the application.
This value overrides chunk job dispatch configured in the queue.
Postrequisites: After adding CHUNK_JOB_SIZE to lsb.applications, use
badmin reconfig to reconfigure your cluster.
CHUNK_JOB_DURATION (lsb.params)
If CHUNK_JOB_DURATION is defined in the file lsb.params, a job submitted to
a chunk job queue is chunked under the following conditions:
◆ A job-level CPU limit or run time limit is specified (bsub -c or -W), or
◆ An application-level CPU limit, run time limit, or run time estimate is specified
(CPULIMIT, RUNLIMIT, or RUNTIME in
lsb.applications), or