Mpiexec release 0.77: poll scalability, new MPI/IB, Torque PBS

Pete Wyckoff pw at osc.edu
Tue Sep 21 11:02:53 EDT 2004


Over the last 5 months, one big scalability improvement appeared.  Also
support was added for a new version of MPI on InfiniBand and for the
Torque distribution of PBS.

Poll scalability

    No part of mpiexec uses select() any more, thanks to Alex Korobka
    who supplied a patch to convert to using poll() instead.  The main
    advantage of poll() is that it can scale to much larger processor
    count; select() was effectively limited to 1024 processes on x86
    machines.  While the poll() code is in production use here at OSC,
    there is a configure option --disable-poll if it causes problems for
    anyone.

New MPI on InfiniBand version and fix

    The MVAPICH implementation of MPICH on InfiniBand from Ohio State
    University was updated to version 0.9.4 and includes a different,
    much more streamlined, startup protocol.  The previous version 0.9.2
    caused problems with mpiexec because some installations did not
    supply a version number at startup leading to protocol mismatches.
    This mpiexec 0.77 release both fixes that old problem and supports
    the new MVAPICH code, auto-detecting at runtime which protocol to
    use.

Included Torque PBS patch

    Torque, another free version of PBS, is sufficiently different from
    its parent OpenPBS 2.3.12 code base that the usual mpiexec patch
    does not apply.  However, there may be relief on two fronts:  first,
    Brett Pemberton contributed a patch (included) that may work with
    some versions of Torque; and second, some pre-releases of Torque do
    have this patch applied.  I'm not sure exactly what versions of
    Torque qualify in either category (patchable or patched), but
    inspection of the included torque patch and the source files should
    show what is needed.

Other little fixes.

    The Intel compiler lies and claims it is GCC but it doesn't accept
    all of GCC's options.  Now the configure script detects that and
    adds some Intel-specific options too.  Two big source files were
    becoming unmanageable (start_tasks.c and stdio.c) and were split up
    into three new source files (ib.c, gm.c, and pmi.c).


Full changelog and downloads at:  http://www.osc.edu/~pw/mpiexec/
Send bug reports, comments and suggestions to the mailing list.

		-- Pete




More information about the mpiexec mailing list