installation problems

[Troy Baer]

On Thu, 2007-10-04 at 16:50 -0400, rcbord at wm.edu wrote: 
>    Still unable to run mpiexec tests but it is now because of a system 
> error.
> 
> libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
>      This will severely limit memory registrations.
> 
> Was able to fix this for csh/tcsh envrionments. I am able run
> with qsub scripts using mpirun_rsh (mvapich) however it appears mpiexec
> is not picking up the ulimit in my .bashrc file.  If I rsh
> into a compute node it shows the memorylocked as 3512148.
> 
> Any suggestion?

Processes spawned on a remote host through the tm interface -- which is
what mpiexec is doing in the covers -- will inherit any process-level
resource limits on the pbs_mom process on that host.  You'll need to
restart the pbs_moms on your compute nodes with a ulimit command in the
startup script (e.g. /etc/init.d/pbs_mom in most Linux distros) to
increase the memorylocked limit before starting the actual pbs_mom
daemon.

	--Troy
-- 
Troy Baer                       troy at osc.edu
Science & Technology Support    http://www.osc.edu/supercomputing/
Ohio Supercomputer Center       614-292-9701