mpiexec with PBSPro

[Pete Wyckoff]

eder at altair.com said on Wed, 23 Jul 2003 08:10 -0400:
> Good morning.  I have been working with Jim Giuliani for several years
> as a student at OSU and now in industry.  I am trying to implement
> mpiexec at Honda R&D in Marysville for a new Linux cluster.  We are
> using PBSPro.  Everything seems to be going well except for one part.
> Redirection of files does not work (i.e. mpiexec lsdyna_970 >
> lsdyna.out).  Instead of redirecting to the file lsdyna.out, the output
> from LS-DYNA gets put into the stdout file for PBS.  I noticed in the
> documentation that there is a patch for OpenPBS to get this type of
> redirection to work but I am curious if anyone knows a way to get it to
> work for PBSPro.  Thanks.

The way this works is that mpiexec users apply a patch to their OpenPBS
code which modifies the start_exec routine of the pbs_mom to connect
sockets for stdin, stdout, and stderr back to the remote process which
caused the processes to spawn using the TM library, i.e. mpiexec.

With PBSPro, and without source, it is not possible to modify the MOM
like this obviously.  You instead see the default behavior of PBS which
is to send all stdout to the job output file.

Working for altair, you may be in a good position to tell the PBSPro
developers that they should apply a similar patch to PBSPro so that it
too can provide this handy stdout redirection feature.  Or you could
switch to OpenPBS. :)

		-- Pete