mpiexec and mvapich with InfiniBand Multicast-based MPI Broadcast

[Thomas Zeiser]

Dear All!

mvapich (0.9.4) has a compile-time option (MCST_SUPPORT) to
activate "InfiniBand Multicast-based MPI Broadcast". 

When I starting a MCST_SUPPORT-enabled MPI-executable with the
mpirun_rsh from mvapich everything is fine. When mpiexec is used
instead, I get the following error message

   mpiexec -comm ib ./pi3
   [1]pmgr_exchange_mcs_group_sync: read grp info 0(expected:8)
   [2]pmgr_exchange_mcs_group_sync: read grp info 0(expected:8)
   [3]pmgr_exchange_mcs_group_sync: read grp info 0(expected:8)
   pmgr_exchange_mcs_group_sync: root read: Success
   mpiexec: Warning: tasks 0-3 exited with status 1.

It seems that mvapich uses some additional initialisation sequences
in this case ... (see also mpid/vapi/process/mpirun_rsh.c and
mpid/vapi/process/pmgr_client_mpirun_rsh.c in the mvapich sources).

Can anyone confirm my observations?


Kind regards,

thomas

-- 
Dipl.-Ing. Thomas ZEISER
Regionales Rechenzentrum Erlangen / HPC-Gruppe
Martensstr. 1, 91058 Erlangen, GERMANY