Wiki‎ > ‎

Job submission using multiple nodes and cores

posted Feb 9, 2011, 4:59 PM by Dong Xu   [ updated Jun 9, 2011, 9:54 PM ]
GNU Parallel

Youtube intro:


ls -d */ |parallel -W /home/lab/usr/dxu/Downloads/dhfr/CPU  --sshloginfile /home/apps/bin/hosts.parallel  'echo $HOSTNAME; cd {}; pwd'

on chili:
nohup sh -c 'ls hc*.namd|parallel --load 0.6 -j 1 "namd2_mc +p48 {} > {}.log"' >& parallel.nohup.log &


GNU Sem: When the number of jobs are running in the background, GNU sem will wait for one of these to complete before starting another command. sem --wait will wait for all jobs to complete.

Backgroud jobs scripts


xargs -P