ulimit of programs run by mpiexec?
Glen Beane
beaneg at umcs.maine.edu
Fri Apr 28 14:06:50 EDT 2006
you can create a wrapper around pbs_mom that increases the ulimit prior to
launching pbs_mom. mpiexec will inherit the ulimit of pbs_mom. That way
you can increase the ulimit for anything spawned from pbs_mom/mpiexec but
you don't have to change the system default
On Fri, 28 Apr 2006, Aquarijen wrote:
> Hey Garrick,
> Thank you for your help!
> I added a default memory size of 2gb to the queue and it really didn't
> do anything regarding the stack size. If I do something silly ;) and
> launch a shell to launch mpiexec, the program only runs on one node...
>
> Maybe I'm not doing this right?
> I did:
> set server resources_default.pmem = 2gb
>
> Should I set something else ?
>
> or should I give up and set the system ulimit higher? :}
>
> Thanks so much!
> Jen
>
> On 4/26/06, Garrick Staples <garrick at usc.edu> wrote:
>> On Wed, Apr 26, 2006 at 06:35:03PM -0400, Aquarijen alleged:
>> > Hi,
>> > I am the admin of a cluster and we use mpiexec and so far, other than
>> > this one problem, we love it! I am having a preoblem though...
>> > How do I change the ulimit of the programs I run using mpiexec or how
>> > do I source the environment? PBS seems to realize the correct ulimit
>> > that I have set in my .bashrc, but the programs launched from mpiexec
>> > within pbs do not. Let me see if I can explain better
>>
>> Processes spawn through TM don't necessarily use a shell, much less a
>> login shell, so mpiexec would have to do something silly like spawn
>> '$SHELL -l -c $command'.
>>
>> The ulimit problem should be solved within PBS by setting default or max
>> memory limits at the server or queue.
>>
>>
>> --
>> Garrick Staples, Linux/HPCC Administrator
>> University of Southern California
>>
>>
>> _______________________________________________
>> mpiexec mailing list
>> mpiexec at osc.edu
>> http://email.osc.edu/mailman/listinfo/mpiexec
>>
>>
>>
>>
> _______________________________________________
> mpiexec mailing list
> mpiexec at osc.edu
> http://email.osc.edu/mailman/listinfo/mpiexec
>
More information about the mpiexec
mailing list