File descriptor limits with mpiexec and pbs/torque

[Maestas, Christopher Daniel]

Hello,

We recently discovered when launching > 504 processes on a system you
hit a file descriptor limit.
If you add the following to the startup script of your pbs_mom:
----
ulimit -n 4096
----

And ensure that the fs.file-max parameter is high enough in sysctl.conf
---
fs.file-max = 65536
---

You can launch job sizes > 504.  This is tested with torque 1.1.0p4 and
mpiexec-0.77 ....
We modified the pbs_mom startup script from a modified Nico rpm for
1.1.0p4. :-)

-- Chris
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://email.osc.edu/pipermail/mpiexec/attachments/20041103/fb8cd9c0/attachment.htm