CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Running, Solving & CFD

OpenFOAM on Amazon Elastic Compute Cloud (Amazon EC2)

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   October 28, 2009, 03:04
Default OpenFOAM on Amazon Elastic Compute Cloud (Amazon EC2)
  #1
New Member
 
anonymous
Join Date: Oct 2009
Posts: 1
Rep Power: 0
piina is on a distinguished road
Has anyone experience in running Open FOAM on Amazon Elastic Compute Cloud (Amazon EC2)?
piina is offline   Reply With Quote

Old   July 13, 2010, 12:02
Default EC2 HPC instances announced!
  #2
bjr
Member
 
Ben Racine
Join Date: Mar 2009
Location: Seattle, WA, USA
Posts: 62
Rep Power: 8
bjr is on a distinguished road
Send a message via AIM to bjr Send a message via Skype™ to bjr
Not yet, but Amazon just announced their HPC EC2 instances today! Let's get cracking team!
bjr is offline   Reply With Quote

Old   November 24, 2010, 17:08
Default Opensource CFD on Amazon EC2
  #3
New Member
 
Joel Cugnoni
Join Date: Nov 2010
Posts: 4
Rep Power: 6
jcugnoni is on a distinguished road
Quote:
Originally Posted by bjr View Post
Not yet, but Amazon just announced their HPC EC2 instances today! Let's get cracking team!
Hi guys,

actually the CFD/FEA oriented distro CAELinux has been ported to Amazon EC2 infrastructure, so now you can run OpenFOAM or Code-Saturne jobs in MPI using EC2 infrastructure.

CAELinux contains also a long list of pre/post processors like Salome, GMSH, Netgen, EnGrid, Discretizer as well as Paraview. And other CFD solvers like Code-Saturne, Gerris or Elmer plus a number of FE solvers like Code-Aster, Calculix or Impact.

For more information please look at http://www.caelinux.com
jcugnoni is offline   Reply With Quote

Old   November 25, 2010, 04:53
Default
  #4
Senior Member
 
Elvis
Join Date: Mar 2009
Location: Sindelfingen, Germany
Posts: 577
Blog Entries: 5
Rep Power: 13
elvis is on a distinguished road
Hi Joel,

I adore your work on CAELinux, however unfortunatly you leave out OpenFOAM 1.5-dev, this leads to lack of features like GGI, RBF, viscoelastic fluids etc. Can't find ggi tools in the version 1.7.0

But it would be easy to offer both (1.5-dev&1.7.x) versions so the users can dicide
startOF15dev / startOF17

alias startOF15dev='source /usr/lib/OpenFOAM-1.5-dev/etc/bashrc'
alias startOF17='source /usr/lib/OpenFOAM-1.7.x ....'
ready to use debian packages of 1.5-dev can be found at https://launchpad.net/~cae-team/+archive/ppa

thx
elvis
elvis is offline   Reply With Quote

Old   November 26, 2010, 14:51
Default
  #5
New Member
 
Joel Cugnoni
Join Date: Nov 2010
Posts: 4
Rep Power: 6
jcugnoni is on a distinguished road
Hi Elvis,

thank you for your feedback, I did not know that openfoam 1.5 dev had so many improvement compared to vanilla 1.7.

I will try to integrate both in the next release of CAELinux!
jcugnoni is offline   Reply With Quote

Old   January 14, 2011, 11:10
Default OpenFOAM on Amazon EC2 - A simple test of performance
  #6
New Member
 
Jens Johansson
Join Date: Mar 2009
Posts: 2
Rep Power: 0
jensjo is on a distinguished road
Quote:
Originally Posted by piina View Post
Has anyone experience in running Open FOAM on Amazon Elastic Compute Cloud (Amazon EC2)?

I thought I would share my experience with OpenFOAM on Amazon Elastic Compute Cloud (EC2).

I have just tested the performance of Amazon's “High-CPU Extra Large Instance”, and compared the performance to my own cluster. I know my comparison below is not excatly scientific, but maybe you could enjoy it as a bedtime story. :-)

This Amazon instance used has: 7 GB of memory, 20 EC2 Compute Units* (8 virtual cores with 2.5 EC2 Compute Units each), 1690 GB of local instance storage, 64-bit platform.

I am running a 40+ nodes ROCKS cluster build partly from old Pentium 4@3GHz machines, generally with 1GB RAM, 32-bit platform. My cluster nodes is connected through a 100Mbit network. (Nothing fancy here)

I have tested the performance with an OpenFOAM (1.6 / 1.7) simulation based on my own solver (related to the icoFoam solver). My computational domain holds approximately 800,000 elements.

In my test I used two nodes i my cluster and used the Hyper-treathing of the Pentium 4 to have 4 threads total. On my AMI (Amazon Machine Image) I tested with 1,2,4 and 8 of the virtual cores in this instance. Results are normalized to 1 for the AMI @2 core case. Here are my results: (Inverse of the time spent, i.e. smaller i better)

AMI @ 1 core = 1.51 (slow)
My cluster @ 2x2 threats = 1.14
AMI @ 2 cores = 1.0
AMI @ 4 cores = 0.87
AMI @ 8 cores = 0.83 (faster)

As seen there is not much speedup when using more than 2 cores. This could be related to the limited size of the problem(?). My cluster setup is far from ideal. My network is slow, and all data is stored on a NAS accesses through this network. Hence I would have expected more speedup from my cluster to Amazon. I am a little disappointed.

With that being said I am very impressed with the Amazon EC2 service. It found I quite easy to; register, choose an available AMI, modify it to my needs (install my own solver etc), create a new AMI and store it in my newly created Amazon S3 bucket, register my AMI, and finally run the AMI on an instance type of my choice. Sweet!

Hint: If you want to get started. 1. Search google/youtube for a basic tutorial 2. Register to Amazon AWS, than EC2 and S3. 3. When starting an instance search for OpenFOAM. There is AMI's with OpenFOAM already installed.

I have yet to test the Amazon Cluster instances, perhaps they will perform better.

Has anyone else tested OpenFOAM on Amazon Elastic Compute Cloud (EC2)?

Kind regards

Jens Johansson

*http://aws.amazon.com/ec2/faqs/#What...u_introduce_it : “One EC2 Compute Unit provides the equivalent CPU capacity of a 1.0-1.2 GHz 2007 Opteron or 2007 Xeon processor.”
jensjo is offline   Reply With Quote

Old   January 17, 2011, 07:31
Default
  #7
Member
 
alexey2petrov's Avatar
 
Alexey
Join Date: Feb 2010
Posts: 33
Blog Entries: 1
Rep Power: 8
alexey2petrov is on a distinguished road
Quote:
Originally Posted by piina View Post
Has anyone experience in running Open FOAM on Amazon Elastic Compute Cloud (Amazon EC2)?
There is a SourceForge project dedicated to the "Cloud Computing for OpenFOAM (R) users" - CloudFlu

Corresponding documentation could be found at http://sourceforge.net/apps/mediawiki/cloudflu page
alexey2petrov is offline   Reply With Quote

Old   June 7, 2011, 07:25
Default Problem in accessing the ami-8f5761fb
  #8
Member
 
Maruthamuthu Venkatraman
Join Date: Mar 2009
Location: Norway
Posts: 80
Rep Power: 8
maruthamuthu_venkatraman is on a distinguished road
Hi,
Did anyone succeed in connecting the AMI ami-8f5761fb ?
- I use putty and winscp for data transfer.
- Using puttygen I converted the keypair file.pem to .ppk format.
- This file path was set to putty and specfied the DNS server name to the sessions ( obtained form amazon console once the instance started to run.)

PUTTY is not connecting to the server. The whole window is blank. After sometime it says connection timed out... However I am able to connect to OPENSUSE AMI by the same method without any problem.

Could anyone give some hint ??

Thanks
maruthamuthu_venkatraman is offline   Reply With Quote

Old   June 9, 2011, 05:33
Default
  #9
Member
 
alexey2petrov's Avatar
 
Alexey
Join Date: Feb 2010
Posts: 33
Blog Entries: 1
Rep Power: 8
alexey2petrov is on a distinguished road
Hi Maruthamuthu,
Quote:
Originally Posted by maruthamuthu_venkatraman View Post
Did anyone succeed in connecting the AMI ami-8f5761fb
I see your problem in the way you are trying to connect to this AMI - from Windows, not Linux.
My suggestion is, that you had better use Linux (as it was initially supposed by OpenCFD) to interact with this AMI.
To do so in Windows you can use Linux running under VirtualBox (or something of that sort).

P.S. Of course, it is possible to find the real problem - the question is in how much time you are willing to spend for it. When you use Linux & VirtualBox - the time is predictable at least.

Best regards,
Alexey
alexey2petrov is offline   Reply With Quote

Old   July 6, 2011, 18:24
Default
  #10
Member
 
Kevin
Join Date: May 2011
Posts: 32
Rep Power: 6
murrdpirate is on a distinguished road
Has anyone had any success with EC2 yet? I'm interested in testing it out, but I'm having the same problem as maruthamuthu in that I can't seem to connect to my running instance (ami-8f5761fb). Unlike maruthamuthu, I am using Linux, but I'm using version 10.04 as opposed to the machine image using 10.10, so I guess that could be the problem.
murrdpirate is offline   Reply With Quote

Old   November 30, 2011, 20:05
Default
  #11
Member
 
Kai
Join Date: May 2010
Location: Stockholm
Posts: 39
Rep Power: 7
kaifu is on a distinguished road
Hi Kevin

I am also using ubuntu 10.04. And I can see a lot of available AMIs in my browsers but also couldnt find ami-8f5761fb. The problem shouldnt come from the local linux system. Did u solve the problem? Thanks

Quote:
Originally Posted by murrdpirate View Post
Has anyone had any success with EC2 yet? I'm interested in testing it out, but I'm having the same problem as maruthamuthu in that I can't seem to connect to my running instance (ami-8f5761fb). Unlike maruthamuthu, I am using Linux, but I'm using version 10.04 as opposed to the machine image using 10.10, so I guess that could be the problem.
__________________
Kai
kaifu is offline   Reply With Quote

Old   November 30, 2011, 23:06
Default
  #12
Member
 
Kevin
Join Date: May 2011
Posts: 32
Rep Power: 6
murrdpirate is on a distinguished road
Hi Kaifu

I'm afraid not. But don't let that discourage you too much. I'm a novice when it comes to both Linux and EC2, and I sort of got away from the CFD field before I spent too much time on this issue.
murrdpirate is offline   Reply With Quote

Old   February 13, 2013, 13:19
Default
  #13
New Member
 
Join Date: Jan 2013
Posts: 7
Rep Power: 4
secondlaw is on a distinguished road
I've run OpenFOAM jobs on Rescale - I'm not sure who their cloud provider is, but I found their service to be pretty fast and easy to use.
secondlaw is offline   Reply With Quote

Old   February 20, 2013, 13:01
Default
  #14
New Member
 
Thanasis
Join Date: Mar 2010
Location: Greece
Posts: 8
Rep Power: 7
thanz is on a distinguished road
Does anyone knows, if it is possible to compile his own modifications in the openfoam, or more general to compile the openfoam from scratch?
I am asking for Europe region.

Thanks

[Edit] I will appreciate if someone could pass info about cloud services for large openfoam cases.

Last edited by thanz; February 20, 2013 at 13:05. Reason: add some text
thanz is offline   Reply With Quote

Reply

Tags
amazon, ec2

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Superlinear speedup in OpenFOAM 13 msrinath80 OpenFOAM Running, Solving & CFD 18 March 3, 2015 06:36
Modified OpenFOAM Forum Structure and New Mailing-List pete Site News & Announcements 0 June 29, 2009 05:56
64bitrhel5 OF installation instructions mirko OpenFOAM Installation 2 August 12, 2008 18:07
Adventure of fisrst openfoam installation on Ubuntu 710 jussi OpenFOAM Installation 0 April 24, 2008 14:25
OpenFOAM Debian packaging current status problems and TODOs oseen OpenFOAM Installation 9 August 26, 2007 13:50


All times are GMT -4. The time now is 06:48.