ulimit of programs run by mpiexec?

Glen Beane beaneg at umcs.maine.edu
Fri Apr 28 14:06:50 EDT 2006


you can create a wrapper around pbs_mom that increases the ulimit prior to 
launching pbs_mom.  mpiexec will inherit the ulimit of pbs_mom.  That way 
you can increase the ulimit for anything spawned from pbs_mom/mpiexec but 
you don't have to change the system default



On Fri, 28 Apr 2006, Aquarijen wrote:

> Hey Garrick,
> Thank you for your help!
> I added a default memory size of 2gb to the queue and it really didn't
> do anything regarding the stack size.  If I do something silly ;) and
> launch a shell to launch mpiexec, the program only runs on one node...
>
> Maybe I'm not doing this right?
> I did:
> set server resources_default.pmem = 2gb
>
> Should I set something else ?
>
> or should I give up and set the system ulimit higher? :}
>
> Thanks so much!
> Jen
>
> On 4/26/06, Garrick Staples <garrick at usc.edu> wrote:
>> On Wed, Apr 26, 2006 at 06:35:03PM -0400, Aquarijen alleged:
>> > Hi,
>> > I am the admin of a cluster and we use mpiexec and so far, other than
>> > this one problem, we love it!  I am having a preoblem though...
>> > How do I change the ulimit of the programs I run using mpiexec or how
>> > do I source the environment?  PBS seems to realize the correct ulimit
>> > that I have set in my .bashrc, but the programs launched from mpiexec
>> > within pbs do not. Let me see if I can explain better
>> 
>> Processes spawn through TM don't necessarily use a shell, much less a
>> login shell, so mpiexec would have to do something silly like spawn
>> '$SHELL -l -c $command'.
>> 
>> The ulimit problem should be solved within PBS by setting default or max
>> memory limits at the server or queue.
>> 
>> 
>> --
>> Garrick Staples, Linux/HPCC Administrator
>> University of Southern California
>> 
>> 
>> _______________________________________________
>> mpiexec mailing list
>> mpiexec at osc.edu
>> http://email.osc.edu/mailman/listinfo/mpiexec
>> 
>> 
>> 
>> 
> _______________________________________________
> mpiexec mailing list
> mpiexec at osc.edu
> http://email.osc.edu/mailman/listinfo/mpiexec
>


More information about the mpiexec mailing list