CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM

Intel_mpirun and LSF

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   February 10, 2013, 00:36
Default Intel_mpirun and LSF
  #1
New Member
 
ehk
Join Date: Sep 2012
Posts: 21
Rep Power: 4
ehsankf is on a distinguished road
Does anyone have any experience running OF from LSF?
If so, could you let me know how it is possible to run parallel job through mpirun.lsf command, which is an LSF version of "mpirun". Thanks.
ehsankf is offline   Reply With Quote

Old   February 10, 2013, 08:42
Default
  #2
Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 8,253
Blog Entries: 34
Rep Power: 84
wyldckat is just really nicewyldckat is just really nicewyldckat is just really nicewyldckat is just really nice
Greetings ehsankf,

Quote:
Originally Posted by ehsankf View Post
Does anyone have any experience running OF from LSF?
If so, could you let me know how it is possible to run parallel job through mpirun.lsf command, which is an LSF version of "mpirun". Thanks.
I did a quick search with Google looking for:
Code:
OpenFOAM lsf
and found this post: Running OpenFOAM from Platform LSF

edit: in fact, Google showed me several pages that explain how to this...

Best regards,
Bruno

Last edited by wyldckat; February 10, 2013 at 08:44. Reason: see "edit:" and refactored the google search line
wyldckat is offline   Reply With Quote

Old   February 13, 2013, 02:07
Default
  #3
New Member
 
ehk
Join Date: Sep 2012
Posts: 21
Rep Power: 4
ehsankf is on a distinguished road
Bruno, thank you very much for that information!
The mpirun.lsf is very like this:
bsub -a mpichp4 -n 8 -q p mpirun.lsf ./job.exe
As it is seen, the number of processors passed before mpirun command whch is not compatible with openFoam in which it is

mpirun -
n 8 -mycase -parallel.
ehsankf is offline   Reply With Quote

Old   February 13, 2013, 05:41
Default
  #4
Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 8,253
Blog Entries: 34
Rep Power: 84
wyldckat is just really nicewyldckat is just really nicewyldckat is just really nicewyldckat is just really nice
Hi ehsankf,

It looks like you need to build OpenFOAM to link with the MPI your system has. I say this because "mpichp4" is not likely to be compatible with Open-MPI, which is why you're unable to launch a parallel run.

Since you mentioned Intel's MPI, check this thread for ideas: Compile OF2.1 with Intel Icc and Intel MPI

Best regards,
Bruno
wyldckat is offline   Reply With Quote

Old   February 13, 2013, 15:03
Default
  #5
New Member
 
ehk
Join Date: Sep 2012
Posts: 21
Rep Power: 4
ehsankf is on a distinguished road
Bruno,
I have already built OF with icc and intel_mpi. Since the platform is LSF, mpirun may launch lsf trough the following command:
mpirun.lsf ./job.exe. When I run OF, e.g,
mpirun.lsf interFoam -parallel
OF looks for the number of processors and complains that can not run on 1 processor.
it seems that this problem has already been fixed as it is seen here:
http://umbc.rnet.missouri.edu/resour...nOpenFOAM.html
but I do not have idea how it has been done.
ehsankf is offline   Reply With Quote

Old   February 13, 2013, 17:18
Default
  #6
Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 8,253
Blog Entries: 34
Rep Power: 84
wyldckat is just really nicewyldckat is just really nicewyldckat is just really nicewyldckat is just really nice
Hi ehsankf,

Your description seems very incomplete. That very same link indicates that you need the whole script... possibly something like:
Code:
# Set job parameters
#BSUB -a openmpi
#BSUB -J jobname
#BSUB -oo jobname.o%J
#BSUB -eo jobname.e%J

# Set number of CPUs
#BSUB -n 4

# Start OpenFOAM job
mpirun.lsf interFoam -parallel > log.interFoam 2>&1
Running only with "mpirun.lsf interFoam -parallel" is not enough.

And the reference to "#BSUB -a openmpi" seems to indicate that it's something dependent on the configuration of your job scheduler. Have you asked your cluster's administrator?

Best regards,
Bruno
wyldckat is offline   Reply With Quote

Old   February 13, 2013, 17:33
Default
  #7
New Member
 
ehk
Join Date: Sep 2012
Posts: 21
Rep Power: 4
ehsankf is on a distinguished road
Actually it is never possible to run mpirun.lsf in command line since the variable LSF_PJL_TYPE can get value only through bsub script.
ehsankf is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 06:08.