mpiexec with OpenPBS

[Pete Wyckoff]

gestionlinux at hotmail.com said:
> Just one additional note: I installed OpenPBS first without any
> intention to use mpiexec. Than after exploring the world of
> OpenPBS, I discovered that I can use MPICH, LAM/MPI and mpiexec.
> I didn't recompile my OpenPBS. Should I? If the response is yes,
> what are the needed options  with 'configure' of OpenPBS 2.2.16,
> for my smp machines :
> I have 2 AMD athlon biprocessor and one front end server machine.

If you look around, you will find lots of opinion on this matter.
The starting place for the OSC config is:

    http://www.osc.edu/~troy/pbs/

which will describe our patches and point to other sites.  At the
very least you should apply the patch that comes with mpiexec to
allow it to give you all the functionality regarding standard input
and output streams redirection.

My config command is roughly:

      ./configure --prefix=/usr/local/pbs-2.3.12 \
        --set-server-home=/var/spool/pbs

but you should think about what those do, and if it's right for you.
Go check out the Oxford patches from the OpenPBS Public Home page too.

> What about the option with mpiexec?

Please tell me if it's not obvious from the mpiexec README and I'll
try to have that explain better.  You should just need the
--with-smp-size flag I mentioned in the previous mail, unless your PBS
install isn't found.  Give it a try.

> Should I do that on every node
> and on the front end machine? My cluster should execute serial and
> parallel jobs.

I don't know what you've got for disk sharing.  You will need the
mpiexec binary on each compute node, and PBS wants some files on each
compute and some on the server.  You will have to read up on that.

		-- Pete