CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Installation

[OpenFOAM.org] OpenFOAM Cluster Setup for Beginners

Register Blogs Members List Search Today's Posts Mark Forums Read

Like Tree1Likes
  • 1 Post By derekm

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   September 7, 2014, 05:21
Default OpenFOAM Cluster Setup for Beginners
  #1
Member
 
Julian Langowski
Join Date: May 2011
Location: Bremen, Germany
Posts: 91
Rep Power: 15
Ruli is on a distinguished road
Dear Foamers,

I have a new question for you. I would like to set up a small cluster for OpenFOAM simulations. I do know Ubuntu basics and how to install and run on a single PC, but I have no experience in cluster setup. Therefore I hope for help. If this thread should get a big general feedback, I could imagine extracting some kind of step-for-step "Beginners guide to server setup for OpenFOAM simulations" out of it, which I unfortunately did not find in the internet.

Some information about the hardware:
- 8 Cluster blades
- 1 Xeon Quad Core per blade
- 12 GB RAM per blade
- Gigabit Ethernet Switch, 1 Gb/s

I would like to install:
- Ubuntu 12.04 LTS
- OpenFOAM 2.3.0 Dep Pack

At this point, I have a lot of questions (in the following marked with numbers).
1.) How is the general procedure of Ubuntu cluster setup?
I imagine the following steps:
A) Set up one blade normally (install Ubuntu + OpenFOAM)
B) Clone the installed blade on all the other blades
2.) Do I really have to install OF on all blades or only on the master node?
C) Physically connect the cluster blades
D) Set up the general network in Ubuntu
3.) How does network setup in Ubuntu work? Do I have to use certain software/settings?
E) Install control software (I read about TORQUE for example and I already used qsub) on master node
4.) Which control software for parallel computing is recommended?
F) Change OF settings for parallel computing
5.) What exactly do I have to do here?
G) Voilá, it works and he used the OF cluster happily ever after...
6.) Did I forget anything?
I thank all you guys thousand times for any help!

Best regards
Julian
__________________
πάντα ῥεῖ - Heraclitus
Ruli is offline   Reply With Quote

Old   September 7, 2014, 07:53
Default
  #2
Senior Member
 
linnemann's Avatar
 
Niels Nielsen
Join Date: Mar 2009
Location: NJ - Denmark
Posts: 556
Rep Power: 27
linnemann will become famous soon enough
Hi

I highly urge you to use this instead of rolling your own setup.

http://www.rocksclusters.org/wordpress/

It has all the tools you need to get up and running and managing all the machines etc.

When the hardware is installed I can have it up and running in 4-6 hours using Rocks.

Also its based on CentOS which is derived from RedHat so stability is impeccable.

Their documentation is great and have a large community to help.
__________________
Linnemann

PS. I do not do personal support, so please post in the forums.
linnemann is offline   Reply With Quote

Old   September 8, 2014, 09:04
Default
  #3
Member
 
Julian Langowski
Join Date: May 2011
Location: Bremen, Germany
Posts: 91
Rep Power: 15
Ruli is on a distinguished road
Dear Niels,

thanks for the reply. I looked though the manual and it seems managable.

Anyhow, I also found a detailed for a Beowulf cluster. Thus, I have new questions:
2.1) Is there a relevant difference between a Rocks Cluster and a Beowulf Cluster?
2.2) If yes, which is to prefere?
Best regards
Julian
__________________
πάντα ῥεῖ - Heraclitus
Ruli is offline   Reply With Quote

Old   September 8, 2014, 09:12
Default
  #4
Senior Member
 
linnemann's Avatar
 
Niels Nielsen
Join Date: Mar 2009
Location: NJ - Denmark
Posts: 556
Rep Power: 27
linnemann will become famous soon enough
Short answer

No, http://en.wikipedia.org/wiki/Beowulf_cluster

Quote:
No particular piece of software defines a cluster as a Beowulf
So a Beowulf cluster is just a description of what Rocks Cluster does automatically for you.
__________________
Linnemann

PS. I do not do personal support, so please post in the forums.
linnemann is offline   Reply With Quote

Old   September 8, 2014, 10:25
Default
  #5
Member
 
Julian Langowski
Join Date: May 2011
Location: Bremen, Germany
Posts: 91
Rep Power: 15
Ruli is on a distinguished road
Dear Niels,

thanks again!

I read through the Rocks manual and identified the following basic steps:

A) Set up master node (Rocks CDs for OS + addons,...)
B) Set up slave nodes one by one (Rocks CDs for OS + addons,...)
C) Install OpenFOAM on master
D) Modify OpenFOAM

Does this sound about right?

Best regards
Julian
__________________
πάντα ῥεῖ - Heraclitus
Ruli is offline   Reply With Quote

Old   September 8, 2014, 13:36
Default
  #6
Senior Member
 
linnemann's Avatar
 
Niels Nielsen
Join Date: Mar 2009
Location: NJ - Denmark
Posts: 556
Rep Power: 27
linnemann will become famous soon enough
Hi

yes but in B use pxe boot instead of CD's its much easier.
__________________
Linnemann

PS. I do not do personal support, so please post in the forums.
linnemann is offline   Reply With Quote

Old   July 21, 2016, 21:25
Default
  #7
New Member
 
Colombia
Join Date: Jul 2013
Posts: 4
Rep Power: 13
maem93 is on a distinguished road
Hi Ruli and Niels,

I recently installed OpenFOAM in a Rocks Cluster 6.2, but I cannt run a parallel simulation using all the nodes. Do you know what kind of modifications I need to do in OpenFOAM to run a parallel simulation using all the nodes?

Thank you.
maem93 is offline   Reply With Quote

Old   July 22, 2016, 04:14
Default
  #8
Senior Member
 
Derek Mitchell
Join Date: Mar 2014
Location: UK, Reading
Posts: 172
Rep Power: 13
derekm is on a distinguished road
see the discussion on this thread it contains an example.
http://www.cfd-online.com/Forums/ope...dless-ssh.html

note with current openmpi you need to make the passwordless ssh node to every node rather than headnode to slave slave to headnode.

with 32 cores on 8 node you probably should go infiniband + Gbe rather than just Gbe

Derek
arvindpj likes this.
__________________
A CHEERING BAND OF FRIENDLY ELVES CARRY THE CONQUERING ADVENTURER OFF INTO THE SUNSET
derekm is offline   Reply With Quote

Reply

Tags
cluster, hardware, installation of open foam, parallel computation, setup

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Frequently Asked Questions about Installing OpenFOAM wyldckat OpenFOAM Installation 3 November 14, 2023 11:58
OpenFOAM Training Jan-Jul 2017, Virtual, London, Houston, Berlin CFDFoundation OpenFOAM Announcements from Other Sources 0 January 4, 2017 06:15
OpenFOAM Training Jan-Apr 2017, Virtual, London, Houston, Berlin cfd.direct OpenFOAM Announcements from Other Sources 0 September 21, 2016 11:50
[Other] OpenFOAM on a windows run cluster jfournier OpenFOAM Installation 1 August 20, 2016 17:07
New OpenFOAM Forum Structure jola OpenFOAM 2 October 19, 2011 06:55


All times are GMT -4. The time now is 00:39.