Typical HTCondor Commands¶
HTCondor has been configured on the local LSST cluster, and can be used to submit jobs to local resources, or to remote (XSEDE) systems.
There are several commands to be aware of, outlined below:
- :condor_q
The command shows which jobs are in the queue. When specified without arguments, it shows only jobs submitted from the machine on which the command was executed. Here’s an example, run on the machine “lsst-dev”:
$ condor_q -- Schedd: lsst-dev.ncsa.illinois.edu : <141.142.225.160:37253> ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD 7092.0 srp 8/21 09:04 0+03:40:23 R 0 0.3 condor_dagman 7094.0 srp 8/21 09:05 0+00:43:04 I 0 97.7 matrix.sh visit=88 7095.0 srp 8/21 09:05 0+00:42:54 I 0 97.7 matrix.sh visit=88 7096.0 srp 8/21 09:05 0+00:42:54 I 0 97.7 matrix.sh visit=88 4 jobs; 0 completed, 0 removed, 3 idle, 1 running, 0 held, 0 suspended
- condor_rm
You can use condor_rm to remove jobs from the queue. If you want to remove job 7096, run:
$ condor_rm 7096 Cluster 7096 has been marked for removal. $ condor_q -- Submitter: lsst-dev.ncsa.illinois.edu : <141.142.225.160:37253> : lsst-dev.ncsa.illinois.edu ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD 7092.0 srp 8/21 09:04 0+03:48:26 R 0 0.3 condor_dagman 7094.0 srp 8/21 09:05 0+00:43:04 I 0 97.7 matrix.sh visit=88 7095.0 srp 8/21 09:05 0+00:42:54 I 0 97.7 matrix.sh visit=88 3 jobs; 0 completed, 0 removed, 2 idle, 1 running, 0 held, 0 suspended
Usually the condor_rm command doesn’t instantaneously remove the job from the queue; it may take several seconds for it to be removed.
To remove all the jobs you submitted, use the
-alloption:$ condor_rm -all All jobs marked for removal. $ condor_q -- Submitter: lsst-dev.ncsa.illinois.edu : <141.142.225.160:37253> : lsst-dev.ncsa.illinois.edu ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD 0 jobs; 0 completed, 0 removed, 0 idle, 0 running, 0 held, 0 suspended
- condor_status
The condor_status command shows the status of machines in your Condor pool.
$ condor_status Name OpSys Arch State Activity LoadAv Mem ActvtyTime slot1@lsst-run1.nc LINUX X86_64 Unclaimed Idle 0.000 1916 0+23:05:16 slot2@lsst-run1.nc LINUX X86_64 Unclaimed Idle 0.000 1916 0+23:05:19 slot1@lsst-run2.nc LINUX X86_64 Unclaimed Idle 0.000 1916 11+01:31:35 slot2@lsst-run2.nc LINUX X86_64 Unclaimed Idle 0.000 1916 11+01:31:58 Total Owner Claimed Unclaimed Matched Preempting Backfill X86_64/LINUX 4 0 0 4 0 0 0 Total 4 0 0 4 0 0 0
Further details on Condor, and other commands are available from the HTCondor manual.