mpiexec smp runs.

[Glen Beane]

The way we deal with this is we define each node as 2 ppn, but if someone wants one processor on a node and still exclusive use of the node then they 'ask pbs' for 2 processors per node and only use one.  
The nodes appear in the PBS nodefile like this:
node1
node2
node3
noden
node1
node2
node3
noden

if you do a qsub -l nodes=1:ppn=2 script_name  for a serial job, then in the script just do mpiexec -n 1 executable_name you can run a serial job on a node and still have PBS not scedule any other jobs on that node.


Glen Beane
UMaine Supercomputing Facilities
www.clusters.umaine.edu
  ----- Original Message ----- 
  From: Amitoj Singh 
  To: mpiexec at osc.edu 
  Sent: Thursday, August 28, 2003 6:27 PM
  Subject: mpiexec smp runs.


  Hi,
     We are running OpenPBS 2.3.16 with mpiexec Version 0.74. 
  Non-smp jobs run fine. But for smp runs i gather we need to launch a jobs as follows ..

     qsub -l nodes=4:ppn=2 <pbsscript>

    If yes, then we have a problem because we define our nodes as single processor "np=1"  nodes. The reason behind this is that we wish to restrict PBS from trying to launch more than one different process per node. For eg. if job xyz is using 4 nodes then we wish the nodes to be job-exclusive to job xyz. And so the above qsub command fails. 

     We are currently using mpirun to launch jobs at our site. We had changed the mpirun script to launch smp jobs at our site (by editing the file PBS_NODEFILE to have each node appear twice for an smp job), but with mpiexec this seems impossible. Any help in this regard will be much appreciated.

  Amitoj Singh,
  Fermilab/CD/CCF/FTP
  Location : WH 8 East
  Phone : (630)-840-5020


  ---
  Outgoing mail is certified Virus Free.
  Checked by AVG anti-virus system (http://www.grisoft.com).
  Version: 6.0.489 / Virus Database: 288 - Release Date: 6/10/2003
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://email.osc.edu/pipermail/mpiexec/attachments/20030828/b0673f76/attachment.htm