CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM

Intel_mpirun and LSF

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   February 10, 2013, 00:36
Default Intel_mpirun and LSF
  #1
Member
 
ehk
Join Date: Sep 2012
Posts: 30
Rep Power: 13
ehsankf is on a distinguished road
Does anyone have any experience running OF from LSF?
If so, could you let me know how it is possible to run parallel job through mpirun.lsf command, which is an LSF version of "mpirun". Thanks.
ehsankf is offline   Reply With Quote

Old   February 10, 2013, 08:42
Default
  #2
Retired Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,974
Blog Entries: 45
Rep Power: 128
wyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to all
Greetings ehsankf,

Quote:
Originally Posted by ehsankf View Post
Does anyone have any experience running OF from LSF?
If so, could you let me know how it is possible to run parallel job through mpirun.lsf command, which is an LSF version of "mpirun". Thanks.
I did a quick search with Google looking for:
Code:
OpenFOAM lsf
and found this post: http://www.cfd-online.com/Forums/ope...tform-lsf.html

edit: in fact, Google showed me several pages that explain how to this...

Best regards,
Bruno
__________________

Last edited by wyldckat; February 10, 2013 at 08:44. Reason: see "edit:" and refactored the google search line
wyldckat is offline   Reply With Quote

Old   February 13, 2013, 02:07
Default
  #3
Member
 
ehk
Join Date: Sep 2012
Posts: 30
Rep Power: 13
ehsankf is on a distinguished road
Bruno, thank you very much for that information!
The mpirun.lsf is very like this:
bsub -a mpichp4 -n 8 -q p mpirun.lsf ./job.exe
As it is seen, the number of processors passed before mpirun command whch is not compatible with openFoam in which it is

mpirun -
n 8 -mycase -parallel.
ehsankf is offline   Reply With Quote

Old   February 13, 2013, 05:41
Default
  #4
Retired Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,974
Blog Entries: 45
Rep Power: 128
wyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to all
Hi ehsankf,

It looks like you need to build OpenFOAM to link with the MPI your system has. I say this because "mpichp4" is not likely to be compatible with Open-MPI, which is why you're unable to launch a parallel run.

Since you mentioned Intel's MPI, check this thread for ideas: http://www.cfd-online.com/Forums/ope...intel-mpi.html

Best regards,
Bruno
__________________
wyldckat is offline   Reply With Quote

Old   February 13, 2013, 15:03
Default
  #5
Member
 
ehk
Join Date: Sep 2012
Posts: 30
Rep Power: 13
ehsankf is on a distinguished road
Bruno,
I have already built OF with icc and intel_mpi. Since the platform is LSF, mpirun may launch lsf trough the following command:
mpirun.lsf ./job.exe. When I run OF, e.g,
mpirun.lsf interFoam -parallel
OF looks for the number of processors and complains that can not run on 1 processor.
it seems that this problem has already been fixed as it is seen here:
http://umbc.rnet.missouri.edu/resour...nOpenFOAM.html
but I do not have idea how it has been done.
ehsankf is offline   Reply With Quote

Old   February 13, 2013, 17:18
Default
  #6
Retired Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,974
Blog Entries: 45
Rep Power: 128
wyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to all
Hi ehsankf,

Your description seems very incomplete. That very same link indicates that you need the whole script... possibly something like:
Code:
# Set job parameters
#BSUB -a openmpi
#BSUB -J jobname
#BSUB -oo jobname.o%J
#BSUB -eo jobname.e%J

# Set number of CPUs
#BSUB -n 4

# Start OpenFOAM job
mpirun.lsf interFoam -parallel > log.interFoam 2>&1
Running only with "mpirun.lsf interFoam -parallel" is not enough.

And the reference to "#BSUB -a openmpi" seems to indicate that it's something dependent on the configuration of your job scheduler. Have you asked your cluster's administrator?

Best regards,
Bruno
__________________
wyldckat is offline   Reply With Quote

Old   February 13, 2013, 17:33
Default
  #7
Member
 
ehk
Join Date: Sep 2012
Posts: 30
Rep Power: 13
ehsankf is on a distinguished road
Actually it is never possible to run mpirun.lsf in command line since the variable LSF_PJL_TYPE can get value only through bsub script.
ehsankf is offline   Reply With Quote

Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 23:39.