Thanks for the info. I tried mvapich, but it didn't compile against the voltaire udapl. I'm giving up on this for now. I'll try openmpi when I get the time, it's only for one application we have that doesn't seem to work with the commercial mpi library that we use. r.