cluster properties#
The cluster.*
properties are ONLY relevant if pipeline.env=cluster
.
BioLockJ was originally designed to optimize effeciency on a cluster system, specifically one with a torque scheduler.
We recomend chaining configuration properties across multiple files. The cluster.*
properties would go in the configuration file for you environement.
Property | Description |
---|---|
cluster.batchCommand | string Terminal command used to submit jobs on the cluster default: null |
cluster.host | string The remote cluster host URL (used for ssh, scp, rsync, etc) default: null |
cluster.jobHeader | string Header written at top of worker scripts default: null |
cluster.modules | list List of cluster modules to load at start of worker scripts default: null |
cluster.prologue | string To run at the start of every script after loading cluster modules (if any) default: null |
cluster.returnsBatchIds | boolean Options Y/N. Does the cluster.batchCommand return a job id. If Y, if a job is submitted and no id is returned, that will be treated as a failure and the pipeline will stop. default: Y |
cluster.statusCommand | string Terminal command used to check the status of jobs on the cluster default: null |
For example, the following values are used for a torque scheduler in the file: cluster.properties
pipeline.env=cluster
cluster.batchCommand=qsub -q copperhead
cluster.host=hpc.uncc.edu
cluster.statusCommand=qstat
Each project's indicidule configuration file includes
pipeline.defaultProps = cluster.properties