ch_p4 / shmem on SMP linux cluster

[Frank Eisenmenger]

Hi Pete,

> I added:
> 
> diff -u -r1.46 README
> --- README      21 Sep 2004 14:19:19 -0000      1.46
> +++ README      14 Feb 2005 19:06:46 -0000
> @@ -197,6 +197,14 @@
>         "-mpich-p4-shmem" can be used to specify MPICH/P4 configuration
>         information explicitly at runtime, overriding this compile option.
>  
> +       To summarize, configure lines should match as follows:
> +           mpich/configure --with-device=p4 --with-comm=shared ...
> +           mpiexec/configure --with-default-comm=mpich-p4 ...
> +       Or
> +           mpich/configure --with-device=p4 ...
> +           mpiexec/configure --with-default-comm=mpich-p4
> +             --disable-p4-shmem ...
> +

With mpich-1.2.6 '--with-device=p4' not accepted.
Changed to '--with-device=ch_p4'

>>Sorry, but could you, please, add lines for 'ifort', too, and tell what the patch command should look like.

> Try it first.  If it doesn't work I'm sure you can figure it out or
> fall back on the changes to amber.

I went:

MPICH
------

cd mpich-1.2.6; patch -p1 -N < <path>/mpich-fargs.diff

export CC="gcc -m32"
export CFLAGS="-m32"
export CCFLAGS="-m32"
export CLINKER="gcc -m32"
export CCLINKER="g++ -m32"
export FC=ifort
export F90=ifort

source /usr/local/intel/bin/ifortvars.sh

./configure --with-device=ch_p4 -prefix=/usr/local/mpich-32 
--without-mpe -opt="-O3" -optf77="-static -tpp7"

make; make install

MPIEXEC
-------

./configure --disable-p4-shmem --with-default-comm=mpich-p4 
--with-pbs=/usr/local/encap/torque-1.1.0p0

make

Test for C:

		/usr/local/mpich-32/bin/mpicc -m32 -o hello hello.c
		./runtests.pl
	-> o.k.

for F77(ifort 8.1 as backend):

	source /usr/local/intel/bin/ifortvars.sh
	/usr/local/mpich-32/bin/mpif77 -static-libcxa -o hello hellof.f	
	./runtests.pl

Lots of errors like:

...
forrtl: error (78): process killed (SIGTERM)

hellof from 7/8 hostname node21 with 16 args: -p4wd hellof from 0/8 
hostname node24 with 31 args: -p4wd hellof from 4/8 hostname node22 with 
16 args: -p4wd hellof from 2/8 hostname node23 with 16 args: -p4wd 
hellof from 1/8 hostname node24 with 16 args: -p4wd hellof from 5/8 
hostname node22 with 16 args: -p4wd hellof from 3/8 hostname node23 with 
16 args: -p4wd mpiexec: Warning: tasks 0-7 exited with status 62.

-- Frank --

-- 
Dr. Frank Eisenmenger
Forschungsinstitut für Molekulare Pharmakologie
Abt. NMR-unterstützte Strukturforschung
Tel.    +49/0-30-94793-278
FAX     +49/0-30-94793-169
Web     www.fmp-berlin.de/NMR
E-Mail  eisenmenger at fmp-berlin.de