|
[Sponsors] |
February 9, 2013, 23:36 |
Intel_mpirun and LSF
|
#1 |
Member
ehk
Join Date: Sep 2012
Posts: 30
Rep Power: 13 |
Does anyone have any experience running OF from LSF?
If so, could you let me know how it is possible to run parallel job through mpirun.lsf command, which is an LSF version of "mpirun". Thanks. |
|
February 10, 2013, 07:42 |
|
#2 | |
Retired Super Moderator
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,975
Blog Entries: 45
Rep Power: 128 |
Greetings ehsankf,
Quote:
Code:
OpenFOAM lsf edit: in fact, Google showed me several pages that explain how to this... Best regards, Bruno
__________________
Last edited by wyldckat; February 10, 2013 at 07:44. Reason: see "edit:" and refactored the google search line |
||
February 13, 2013, 01:07 |
|
#3 |
Member
ehk
Join Date: Sep 2012
Posts: 30
Rep Power: 13 |
Bruno, thank you very much for that information!
The mpirun.lsf is very like this: bsub -a mpichp4 -n 8 -q p mpirun.lsf ./job.exe As it is seen, the number of processors passed before mpirun command whch is not compatible with openFoam in which it is mpirun -n 8 -mycase -parallel. |
|
February 13, 2013, 04:41 |
|
#4 |
Retired Super Moderator
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,975
Blog Entries: 45
Rep Power: 128 |
Hi ehsankf,
It looks like you need to build OpenFOAM to link with the MPI your system has. I say this because "mpichp4" is not likely to be compatible with Open-MPI, which is why you're unable to launch a parallel run. Since you mentioned Intel's MPI, check this thread for ideas: http://www.cfd-online.com/Forums/ope...intel-mpi.html Best regards, Bruno
__________________
|
|
February 13, 2013, 14:03 |
|
#5 |
Member
ehk
Join Date: Sep 2012
Posts: 30
Rep Power: 13 |
Bruno,
I have already built OF with icc and intel_mpi. Since the platform is LSF, mpirun may launch lsf trough the following command: mpirun.lsf ./job.exe. When I run OF, e.g, mpirun.lsf interFoam -parallel OF looks for the number of processors and complains that can not run on 1 processor. it seems that this problem has already been fixed as it is seen here: http://umbc.rnet.missouri.edu/resour...nOpenFOAM.html but I do not have idea how it has been done. |
|
February 13, 2013, 16:18 |
|
#6 |
Retired Super Moderator
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,975
Blog Entries: 45
Rep Power: 128 |
Hi ehsankf,
Your description seems very incomplete. That very same link indicates that you need the whole script... possibly something like: Code:
# Set job parameters #BSUB -a openmpi #BSUB -J jobname #BSUB -oo jobname.o%J #BSUB -eo jobname.e%J # Set number of CPUs #BSUB -n 4 # Start OpenFOAM job mpirun.lsf interFoam -parallel > log.interFoam 2>&1 And the reference to "#BSUB -a openmpi" seems to indicate that it's something dependent on the configuration of your job scheduler. Have you asked your cluster's administrator? Best regards, Bruno
__________________
|
|
February 13, 2013, 16:33 |
|
#7 |
Member
ehk
Join Date: Sep 2012
Posts: 30
Rep Power: 13 |
Actually it is never possible to run mpirun.lsf in command line since the variable LSF_PJL_TYPE can get value only through bsub script.
|
|
|
|