CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Installation

Problems with MPI implementation

Register Blogs Members List Search Today's Posts Mark Forums Read

Like Tree1Likes
  • 1 Post By wyldckat

Reply
 
LinkBack Thread Tools Display Modes
Old   January 20, 2012, 11:49
Default Problems with MPI implementation
  #1
Member
 
Francesco Capuano
Join Date: May 2010
Posts: 78
Rep Power: 7
francesco_capuano is on a distinguished road
Hi everybody,

I'm having some problems running OpenFOAM v 2.1.0 in parallel mode. In particular, I need to update the PStream library to switch from OpenMPI to Intel MPI, which is actually installed on the cluster I'm using.

I have followed the instructions in

http://openfoamwiki.net/index.php/HowTo_Pstream

but they refer to old versions of OpenFOAM (v. 1.XXX) and I cannot figure out what's the problem.

Is there anyone who has successfully switched from OpenMPI to other MPI implementations?
francesco_capuano is offline   Reply With Quote

Old   January 21, 2012, 14:57
Default
  #2
Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 8,253
Blog Entries: 34
Rep Power: 84
wyldckat is just really nicewyldckat is just really nicewyldckat is just really nicewyldckat is just really nice
Greetings Francesco,

The wiki page isn't very out of date, the instructions there still apply to the latest versions of OpenFOAM... with a few minor adjustments...

Basically, there are 3 places that need attention (OpenFOAM version number is just a reference):
  1. "OpenFOAM-2.1.0/etc/bashrc" - check where it says:
    Code:
    #- MPI implementation:
    #    WM_MPLIB = SYSTEMOPENMPI | OPENMPI | MPICH | MPICH-GM | HPMPI
    #               | GAMMA | MPI | QSMPI
    export WM_MPLIB=OPENMPI
    Change "WM_MPLIB=OPENMPI" to "WM_MPLIB=INTELMPI"
  2. "OpenFOAM-2.1.0/etc/config/settings.sh" - search for the code that starts with:
    Code:
    # Communications library
    # ~~~~~~~~~~~~~~~~~~~~~~
    
    unset MPI_ARCH_PATH MPI_HOME FOAM_MPI_LIBBIN
    
    case "$WM_MPLIB" in
    OPENMPI)
    Wait... you will find in 2.1.0 on this file, near the end, the entry for "INTELMPI)". It assumes that "MPI_ROOT" is properly defined before you source "OpenFOAM-2.1.0/etc/bashrc".
  3. "OpenFOAM-2.1.0/wmake/rules/linux64Gcc/mplibINTELMPI" - this is the rules file for the "INTELMPI" option.
And that's pretty much it!

Best regards,
Bruno
francesco_capuano likes this.
wyldckat is offline   Reply With Quote

Old   January 21, 2012, 16:57
Default
  #3
Member
 
Francesco Capuano
Join Date: May 2010
Posts: 78
Rep Power: 7
francesco_capuano is on a distinguished road
Thanks Bruno for your quick and clear reply!

As soon as I get back to work I will try and let you know!

Regards,
Francesco
francesco_capuano is offline   Reply With Quote

Old   January 24, 2012, 05:06
Default
  #4
Member
 
Francesco Capuano
Join Date: May 2010
Posts: 78
Rep Power: 7
francesco_capuano is on a distinguished road
Dear Bruno,

I get the following message:


Warning in /u2/capuanf/OpenFOAM/OpenFOAM-2.0.1/etc/config/settings.csh:
MPI_ROOT not a valid mpt installation directory.
Please set MPI_ROOT to the mpt installation directory.
(usually done by loading the mpt module)
MPI_ROOT currently set to '/dummy'

MPI_ROOT is not properly set! How can I fix this?

Problem solved! I just defined the MPI_ROOT variable properly in my .bashrc file and it worked!

Thanks in advance!

Last edited by francesco_capuano; January 24, 2012 at 14:33. Reason: Problem solved
francesco_capuano is offline   Reply With Quote

Old   September 19, 2012, 05:21
Default
  #5
Senior Member
 
Sandy Lee
Join Date: Mar 2009
Posts: 207
Rep Power: 9
sandy is on a distinguished road
Hi Francesco,

I met the same problem. Could you give a detailed list how to set the MPI_ROOT variable in .bashrc ?? Thanks
sandy is offline   Reply With Quote

Old   September 19, 2012, 11:09
Default
  #6
Member
 
Francesco Capuano
Join Date: May 2010
Posts: 78
Rep Power: 7
francesco_capuano is on a distinguished road
Quote:
Originally Posted by sandy View Post
Hi Francesco,

I met the same problem. Could you give a detailed list how to set the MPI_ROOT variable in .bashrc ?? Thanks
Hi Sandy,

you can define the MPI_ROOT variable by adding the line

export MPI_ROOT=mpipath

at the end of the your .bashrc file. mpipath is the mpi installation path of your computer/cluster. You can either try to find it yourself or ask it to your cluster technician. Just to give you a clue, in my case the installation path is

/cm/shared/apps/intel/ics/impi/4.0.3.008/

In case you have further questions, please don't hesitate to ask.

Regards,
Francesco
francesco_capuano is offline   Reply With Quote

Old   January 15, 2013, 21:46
Default MPI version and OpenFOAM 2.1
  #7
Member
 
,...
Join Date: Apr 2011
Posts: 92
Rep Power: 5
mahdiiowa is an unknown quantity at this point
Hi FOAMERS
I am using OpenFOAM 2.1,and have LAM/MPI already installed (LAM 7.1.4/MPI 2 C++/ROMIO - Indiana University). When I am trying to rum icofoam on 3 processors I get this error

------------
It seems that [at least] one of the processes that was started with
mpirun did not invoke MPI_INIT before quitting (it is possible that
more than one process did not invoke MPI_INIT -- mpirun was only
notified of the first one, which was on node n0).

mpirun can *only* be used with MPI programs (i.e., programs that
invoke MPI_INIT and MPI_FINALIZE). You can use the "lamexec" program
to run non-MPI programs over the lambooted nodes.
------------
Any idea why i get this error?
I have already run some cases on parallel with OpenFOAM 1.7 and mpirun (Open MPI) 1.3.2. Can I used LAM/MPI instead of OpenMPI? If yes, is there a certain version of LAM/MPI which is compatible with OpenFOAM 2.1?
mahdiiowa is offline   Reply With Quote

Old   January 16, 2013, 02:53
Default
  #8
Senior Member
 
Nima Sam
Join Date: Sep 2009
Location: Tehran, Iran
Posts: 1,123
Blog Entries: 1
Rep Power: 14
nimasam is on a distinguished road
Send a message via Yahoo to nimasam
i dont know what the error is, but there is a suggestion in error line
Quote:
You can use the "lamexec" program
did you try this program?
__________________
Training Course on OpenFOAM at (http://www.isme.ir/)
My Weblog (http://openfoam.blogfa.com/)
nimasam is offline   Reply With Quote

Reply

Tags
mpi, pstream library

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
MPI InterFoam metro OpenFOAM Running, Solving & CFD 7 March 27, 2013 04:24
Problem with MPI? cwang5 OpenFOAM Running, Solving & CFD 3 July 12, 2010 10:38
Code Saturne mass sources MPI problem Pat84 Main CFD Forum 9 April 21, 2010 08:02
non-linear k-epsilon model implementation problems Saidi Main CFD Forum 2 March 4, 2010 14:23
MPI PROBLEMS gtg627e OpenFOAM Running, Solving & CFD 20 October 5, 2007 04:02


All times are GMT -4. The time now is 02:19.