CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Running, Solving & CFD

Parallel runs using LAM

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   October 25, 2007, 13:46
Default Did I have to get LAm from som
  #1
sek
Member
 
Sung-Eun Kim
Join Date: Mar 2009
Posts: 76
Rep Power: 8
sek is on a distinguished road
Did I have to get LAm from somehwere? When I type lamboot -v .. it says lamboot coomand not found.
sek is offline   Reply With Quote

Old   October 25, 2007, 14:30
Default OpenFOAM now uses OpenMPI. Ple
  #2
Senior Member
 
Srinath Madhavan (a.k.a pUl|)
Join Date: Mar 2009
Location: Edmonton, AB, Canada
Posts: 698
Rep Power: 12
msrinath80 is on a distinguished road
OpenFOAM now uses OpenMPI. Please refer to the latest user guide for details. If you choose to use LAM, you will need to build it.
msrinath80 is offline   Reply With Quote

Old   October 25, 2007, 17:36
Default It is well documented on pages
  #3
New Member
 
Gabriel Barroso
Join Date: Mar 2009
Posts: 23
Rep Power: 8
gabriel is on a distinguished road
It is well documented on pages 62 and 63 of the user guide. decompose the domain using decomposePar <root> <case>. The decomposParDict you can take from the brake of a dam tutorial case. After that you can run on a multiple processor/core machine with the command

mpirun -np <numberofprocessors> <solver> <root> <case> -parallel > log &
gabriel is offline   Reply With Quote

Old   October 27, 2007, 06:25
Default Hello there. Does anyone know
  #4
New Member
 
Joseph Dawes
Join Date: Mar 2009
Posts: 1
Rep Power: 0
sunny is on a distinguished road
Hello there. Does anyone know how to implement parallel processing with the mpich2sub command in OpenFOAM? I tried it but it doesn't seem to work with the -parallel option.

Thanks
sunny is offline   Reply With Quote

Old   February 8, 2008, 13:12
Default Hi, due to my openmpi probl
  #5
Senior Member
 
Fabian Braennstroem
Join Date: Mar 2009
Posts: 407
Rep Power: 10
braennstroem is on a distinguished road
Hi,

due to my openmpi problems I would like to try 'lam' for 1.4.1 version.
Do I have to to recompile the whole OpenFoam src directory after I changed the WM_MPILIB variable? Maybe there is a chance to use the existing lam as well?

Regards!
Fabian
braennstroem is offline   Reply With Quote

Old   February 9, 2008, 05:49
Default Hi Fabian, which openMPI-Pr
  #6
New Member
 
Thomas Gallinger
Join Date: Mar 2009
Posts: 28
Rep Power: 8
thomas is on a distinguished road
Hi Fabian,

which openMPI-Problems do you have? I have used lam, mpich and now openmpi, and with openmpi I had nearly no problems. Also notice that lammpi is no longer developed and openmpi is the official follower - so maybe your problems will not vanish by using lam.

For using lam: As far as I know you just have to reompile the Pstream library after changing the corresponding switch to lam.

Regards,
Thomas
thomas is offline   Reply With Quote

Old   February 11, 2008, 10:47
Default Hi Thomas, thanks for your
  #7
Senior Member
 
Fabian Braennstroem
Join Date: Mar 2009
Posts: 407
Rep Power: 10
braennstroem is on a distinguished road
Hi Thomas,

thanks for your help. My openmpi-PBS system run call
looks like:
mpirun np 4 simpleFoam . E1_SEHR_SST -parallel > log

It runs all 4 processes on one cpu; which happens due the missing hostfile, I think.

But the other call:

mpirun -hostfile $PBS_NODEFILE -np 4 simpleFoam . E1_SEHR_SST -parallel > log

does not work at all...!? I actually do not have any idea anymore and have to wait for an answer of my administrator. In the meanwhile I wanted to try lam. By the way, how do I recompile the 'Pstream library'? Is it the whole src directory with the Allwmake call and the corresponding MPILIB switch or is there a shorter way?

Would be nice, if you have an idea :-)
Thanks!
Fabian
braennstroem is offline   Reply With Quote

Old   February 11, 2008, 13:22
Default Hi Fabian, are you using th
  #8
New Member
 
Thomas Gallinger
Join Date: Mar 2009
Posts: 28
Rep Power: 8
thomas is on a distinguished road
Hi Fabian,

are you using the newest OF-version 1.4.1 together with a queuing system?

If yes, try to get rid of -hostfile $PBS_NODEFILE in your call. Don't ask why, this worked with openmpi 1.2.1, but not with 1.2.3. Also at the end exchange > log with >& log, so you also stream the error output into your log file.

As far as I remember you just have to change the WM_MPLIB-Switch under OpenFOAM-1.4.1/.OpenFOAM-1.4.1/bashrc
in line 126 and if you type Allwmake in your src directory only the necessary libraries are rebuild.


Thomas
thomas is offline   Reply With Quote

Old   February 11, 2008, 13:25
Default Hi, me again... The lam comp
  #9
Senior Member
 
Fabian Braennstroem
Join Date: Mar 2009
Posts: 407
Rep Power: 10
braennstroem is on a distinguished road
Hi,
me again...
The lam compilation and pstream works on my local machine with no problem. Is it possible to clean the directory and copy the working openfoam from local machine to the cluster. I am afraid that some path settings could make trouble!?

Fabian
braennstroem is offline   Reply With Quote

Old   February 11, 2008, 14:00
Default Hi Thomas, yes, the newest
  #10
Senior Member
 
Fabian Braennstroem
Join Date: Mar 2009
Posts: 407
Rep Power: 10
braennstroem is on a distinguished road
Hi Thomas,

yes, the newest 1.4.1 with a pbs queuing system. I actually tried to get rid of the 'hostfile', but how does openfoam/openmpi then know, how to distribute the domains? As mentioned above, all processes run on one node!?
The compilation on the cluster does not work due to disk quota problems :-((

Fabian
braennstroem is offline   Reply With Quote

Old   February 11, 2008, 14:25
Default I think I found a hint on tis
  #11
New Member
 
Thomas Gallinger
Join Date: Mar 2009
Posts: 28
Rep Power: 8
thomas is on a distinguished road
I think I found a hint on tis startup problem somewhere in google.

But as I said, I don' know. I think openmpi recognizes to be run within a queueing systems and is somewhat compatible to it - that's just a suggestion.


But it works, distribution of all processes is fine, so just try - hop it works!

Thomas
thomas is offline   Reply With Quote

Old   February 13, 2008, 08:36
Default Hi Thomas, now it works :-)
  #12
Senior Member
 
Fabian Braennstroem
Join Date: Mar 2009
Posts: 407
Rep Power: 10
braennstroem is on a distinguished road
Hi Thomas,

now it works :-)
I had to recompile openmpi with the "--with-tm" Option and defining the pbs binary directory. Unfortunately, it did not work as hoped in the begining due to a compiling error with gcc (see: http://www.cfd-online.com/OpenFOAM_D...tml?1196851788 )

Thanks for your help!
Fabian
braennstroem is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Trouble with parallel runs cfdmarkus OpenFOAM Running, Solving & CFD 9 February 27, 2009 04:59
Differences between serial and parallel runs carsten OpenFOAM Bugs 11 September 12, 2008 11:16
Data storage for parallel runs nordborg OpenFOAM Running, Solving & CFD 1 October 9, 2007 04:19
parallel runs Andy F CFX 1 March 5, 2006 17:32
Distributed parallel runs on ANSYS CFX 10 Manoj Kumar CFX 4 January 25, 2006 09:00


All times are GMT -4. The time now is 11:38.