CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM

Cluster hardware and distros

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   June 28, 2005, 22:07
Default I'd like to pose a question co
  #1
jvn
New Member
 
John Van Norman
Join Date: Mar 2009
Posts: 9
Rep Power: 8
jvn is on a distinguished road
I'd like to pose a question concerning preferred platforms and Linux distros. What would you consider optimal, very well posed, or definitively validated for a parallel implementation of OpenFOAM? When I search on-line, I'm inundated with Intel vs. AMD, SuSe vs. Redhat, etc. I figured that the code authors would be the authority on this. For reference, I'm thinking about cases on the order of 5-10 million cells. What have you found agreeable in these respects?
Thanks again,
JVN
jvn is offline   Reply With Quote

Old   June 29, 2005, 06:29
Default Re. hardware the AMD Opteron s
  #2
Super Moderator
 
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,416
Rep Power: 16
mattijs is on a distinguished road
Re. hardware the AMD Opteron seems to be really good. Because of the nature of the code it is quite dependent on random memory access speed and the AMD seems to behave quite well.

For 5-10M cells you'd probably run 8 processors each with say 2Gb of memory. You'll need one machine with lots of memory to do the decomposition / reconstruction (ca. 2k per cell).
Make sure that you have lots and lots of swap space - not because we're running such big jobs but because it is very convenient to suspend jobs to run something more urgent inbetween.

We have no recent experience with any other interconnect than standard 100M/giga ethernet. If you're going for any specialist hardware make sure their MPI links with OpenFOAM (since their stuff usually comes precompiled and you don't get the sources)

As for Linux distros we stick with Suse since that is what we know but I guess any fairly recent one is ok.

This is only our experience. We would love to hear from other peoples experience.
mattijs is offline   Reply With Quote

Old   June 29, 2005, 07:25
Default Not much experience with FOAM,
  #3
Member
 
sergei shulepov
Join Date: Mar 2009
Posts: 37
Rep Power: 8
sergei is on a distinguished road
Not much experience with FOAM, but with other CFD & FEM codes fairly enough.
At the moment, AMD 64 seems to be faster (but again, this may be code and problem dependent) and cheeper than Intel.
We have used (and still using) SuSE and RedHat (enterprise)recent distros (don't see principal difference), in cluster (beowulf-like) and sun grid enviroment (latter seems to be slower) running mpich,lam. 100m/Gigabit network
At the moment have 4Gb per node (2 processors).(didn't run problems over 2 mln cells yet).
However, looking for upgrade, with a bit more memory because of pre-processing (mesh generation can be cpu & memory intensive)
sergei is offline   Reply With Quote

Old   June 29, 2005, 09:51
Default I've just bought a 2x2GHz Opte
  #4
Senior Member
 
Gavin Tabor
Join Date: Mar 2009
Posts: 181
Rep Power: 8
grtabor is on a distinguished road
I've just bought a 2x2GHz Opteron machine, 8GB RAM, produced by the company DNUK. Installation - no problems. I did my usual trick of running icoFoam on the lid driven cavity case, blinked, and missed the calculation. Very impressive machine - I look forward to using it for real!
grtabor is offline   Reply With Quote

Old   July 3, 2005, 04:14
Default We are also in the process of
  #5
New Member
 
A. Gel
Join Date: Mar 2009
Posts: 1
Rep Power: 0
aike is on a distinguished road
We are also in the process of evaluating OpenFOAM and conducting some benchmarks to determine parallel performance and speedup on Linux clusters. We have tested a problem (VOF surface capturing) mostly ~ 1.3 million cells up to 16 processors and also 1.9 million on 4 procs. These tests were conducted on IA32 systems, currently investigating performance on 64 bit platforms(AMD Opterons) and dual processor IA32 nodes.
aike is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
ANSYS Workbench on "Uncertified" Linux Distros hsr CFX 238 August 19, 2015 11:46
hardware for cfd max Main CFD Forum 8 November 10, 2007 13:58
Hardware for Serious Use Justin CFX 6 January 3, 2007 01:15
OpenFOAM and linux distros billy OpenFOAM 8 September 8, 2005 01:43
cfd-hardware chris Main CFD Forum 12 August 28, 2000 23:40


All times are GMT -4. The time now is 08:25.