mpich-gm shmem with mpiexec-0.70

Marc Michelsen marc at atmos.washington.edu
Wed Sep 4 00:21:17 EDT 2002


Hi,

It looks like shared memory mpich-gm isnt working when I use mpiexec-0.70
on my cluster and I was wondering if anyone else gets the same behavior
or knows what my problem is.

First, if I run without mpiexec 
/usr/local/mpich-gm/bin/mpirun.ch_gm -np 16 -machinefile machs atm < atm.parm

I see the mmaped shmem file:
103 husky01% cat /proc/31465/maps 
...
4007a000-4027c000 rw-s 00000000 01:00 5738       /tmp/gmpi_shmem-9218837.tmp (deleted)
...
104 husky01% ls -l /proc/31465/fd
...
lrwx------    1 marc     wheel          64 Sep  3 20:27 4 -> /tmp/gmpi_shmem-9218837.tmp (deleted)

If I run with -gm-no-shmem like this
/usr/local/mpich-gm/bin/mpirun.ch_gm --gm-no-shmem -np 16 -machinefile machs atm < atm.parm
I dont see the shmem file in the above.

If I submit a pbs job using mpiexec like this
mpiexec -comm mpich-gm atm < atm.parm

I dont see the shmem file either but I do see GMPI_SHMEM=1 in /proc/31489/environ
which seems to be the switch to turn it on by looking at the mpich-gm code.
I'm using the latest mpich-gm, gm too. Thanks

Marc



More information about the mpiexec mailing list