Cannot run jobs more than on two nodes
 

We are running OpenFoam with Thirdparty openMPI 1.5.3.
We can only sign jobs upto two nodes.
If we sign jobs to 3 or more nodes job never starts and command just hangs.

This is our command :
(/mirror is NFS share visible on all nodes)

/mirror/OpenFOAM/ThirdParty-2.1.x/platforms/linux64Gcc/openmpi-1.5.3/bin/mpirun -np 12 -hostfile machines /mirror/OpenFOAM/OpenFOAM-2.1.x/bin/foamExe c -prefix /mirror/OpenFOAM interFoam -parallel | tee log

Any ideas why this does not work on more than two nodes (4 cores per node)?

Hi,

Did you resolve your problem? Because it's happening the same thing with my cluster.

Regards,
Felipe Magazoni

we use command like

#mpirun -machinefile $PBS_NODEFILE -mca plm_rsh_agent rsh -np 16 interFoam -parallel >& output.$PBS_JOBID.txt

and it works well.