ulimit of programs run by mpiexec?

[Charland, Denis]

Hi,

I had the same problem trying to set the core file size limit to be able to debug each process.
The .bashrc was executed on the first node but not on the other nodes where the process is spawned
through mpiexec. A simple solution to that problem is to use mpiexec to start a script file that
sets the core file limit then starts the program. Here's an example of what I did:

This is the file that is used to submit the job through PBS (qsub)

   #!/bin/bash

   cd $PBS_O_WORKDIR

   /usr/mpiexec/bin/mpiexec -comm mpich-mx  ./test

   exit


This is the script that is executed on each node through mpiexec (the ./test script above):


   #!/bin/bash

   ulimit -c unlimited

   ./y60-new -PS quantum_dots_InAs_InP_865K.out

   exit


The only problem with this procedure is that you won't get any cpu time information for your
job from PBS because the script file doesn't do anything after starting the program. Anyway,
to monitor the execution of our jobs, we "tail -f" the .OU file generated by PBS (our program
writes regularly to stdout).


Denis Charland, ing. | P. Eng.
Administrateur de Systèmes UNIX | UNIX Systems Administrator
Institut des matériaux industriels | Industrial Materials Institute
Conseil national de recherches Canada | National Research Council Canada