CFD Online Discussion Forums

CFD Online Discussion Forums (http://www.cfd-online.com/Forums/)
-   OpenFOAM (http://www.cfd-online.com/Forums/openfoam/)
-   -   Intel_mpirun and LSF (http://www.cfd-online.com/Forums/openfoam/113012-intel_mpirun-lsf.html)

ehsankf February 10, 2013 00:36

Intel_mpirun and LSF
 
Does anyone have any experience running OF from LSF?
If so, could you let me know how it is possible to run parallel job through mpirun.lsf command, which is an LSF version of "mpirun". Thanks.

wyldckat February 10, 2013 08:42

Greetings ehsankf,

Quote:

Originally Posted by ehsankf (Post 406928)
Does anyone have any experience running OF from LSF?
If so, could you let me know how it is possible to run parallel job through mpirun.lsf command, which is an LSF version of "mpirun". Thanks.

I did a quick search with Google looking for:
Code:

OpenFOAM lsf
and found this post: http://www.cfd-online.com/Forums/ope...tform-lsf.html

edit: in fact, Google showed me several pages that explain how to this...

Best regards,
Bruno

ehsankf February 13, 2013 02:07

Bruno, thank you very much for that information!
The mpirun.lsf is very like this:
bsub -a mpichp4 -n 8 -q p mpirun.lsf ./job.exe
As it is seen, the number of processors passed before mpirun command whch is not compatible with openFoam in which it is

mpirun -
n 8 -mycase -parallel.

wyldckat February 13, 2013 05:41

Hi ehsankf,

It looks like you need to build OpenFOAM to link with the MPI your system has. I say this because "mpichp4" is not likely to be compatible with Open-MPI, which is why you're unable to launch a parallel run.

Since you mentioned Intel's MPI, check this thread for ideas: http://www.cfd-online.com/Forums/ope...intel-mpi.html

Best regards,
Bruno

ehsankf February 13, 2013 15:03

Bruno,
I have already built OF with icc and intel_mpi. Since the platform is LSF, mpirun may launch lsf trough the following command:
mpirun.lsf ./job.exe. When I run OF, e.g,
mpirun.lsf interFoam -parallel
OF looks for the number of processors and complains that can not run on 1 processor.
it seems that this problem has already been fixed as it is seen here:
http://umbc.rnet.missouri.edu/resour...nOpenFOAM.html
but I do not have idea how it has been done.

wyldckat February 13, 2013 17:18

Hi ehsankf,

:confused: Your description seems very incomplete. That very same link indicates that you need the whole script... possibly something like:
Code:

# Set job parameters
#BSUB -a openmpi
#BSUB -J jobname
#BSUB -oo jobname.o%J
#BSUB -eo jobname.e%J

# Set number of CPUs
#BSUB -n 4

# Start OpenFOAM job
mpirun.lsf interFoam -parallel > log.interFoam 2>&1

Running only with "mpirun.lsf interFoam -parallel" is not enough.

And the reference to "#BSUB -a openmpi" seems to indicate that it's something dependent on the configuration of your job scheduler. Have you asked your cluster's administrator?

Best regards,
Bruno

ehsankf February 13, 2013 17:33

Actually it is never possible to run mpirun.lsf in command line since the variable LSF_PJL_TYPE can get value only through bsub script.


All times are GMT -4. The time now is 23:54.