OpenFOAM on SiCortex

egp · April 1, 2009, 09:25

FoamHeads,

Does anyone have experience running OpenFOAM on a SiCortex machines (http://sicortex.com/) that they would be willing to share? I'm particularly looking for:

1. performance metrics
2. installation & optimization

I've noticed that 1.5-dev has an entry in the wmake directory, $WM_PROJECT_DIR/wmake/rules/SiCortex64Gcc. Therefore, someone is using a SiCortex machine in the OpenFOAM world.

Thanks,

Eric

mattijs · April 6, 2009, 14:24

2. We did the port a little while ago. Since it is based on Linux it was quite easy - the only major change we had to make was in enforcing 4 byte alignment for mpi transfers. It should just compile/run out of the box. We just linked in their native mpi - didn't do any specific optimisation.

1. We only ran some tiny testcases to make sure it was running. I'd be interested in seeing some performance metrics as well - especially scaling on lots of processors.

egp · April 6, 2009, 15:09

Hi Mattijs,

Yeah, the wmake/rules looked pretty straight forward, so I expected it to compile without much problem.

I have access to a SiCortex SC1458 which has 1458 cores (http://sicortex.com/products/entry_m..._system_sc1458). Once I have some scaling performance numbers, I'll post them.

Eric

mattijs · April 7, 2009, 04:51

We found a big benefit from turning off runTimeModifiable (checks all registered dictionaries for change every time step). The nfs performance is not spectacular.

kwardle · July 15, 2009, 10:14

I have access to a SiCortex with 5832 cores. I will try to compile and runs some tests on this one too.

April 1, 2009, 09:25	OpenFOAM on SiCortex	#1
egp Senior Member Eric Paterson Join Date: Mar 2009 Location: Blacksburg, VA Posts: 197 Blog Entries: 1 Rep Power: 18	FoamHeads, Does anyone have experience running OpenFOAM on a SiCortex machines (http://sicortex.com/) that they would be willing to share? I'm particularly looking for: 1. performance metrics 2. installation & optimization I've noticed that 1.5-dev has an entry in the wmake directory, $WM_PROJECT_DIR/wmake/rules/SiCortex64Gcc. Therefore, someone is using a SiCortex machine in the OpenFOAM world. Thanks, Eric

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Superlinear speedup in OpenFOAM 13	msrinath80	OpenFOAM Running, Solving & CFD	18	March 3, 2015 05:36
64bitrhel5 OF installation instructions	mirko	OpenFOAM Installation	2	August 12, 2008 18:07
Adventure of fisrst openfoam installation on Ubuntu 710	jussi	OpenFOAM Installation	0	April 24, 2008 14:25
The OpenFOAM extensions project	mbeaudoin	OpenFOAM	16	October 9, 2007 09:33
OpenFOAM Debian packaging current status problems and TODOs	oseen	OpenFOAM Installation	9	August 26, 2007 13:50

April 6, 2009, 14:24		#2
mattijs Senior Member Mattijs Janssens Join Date: Mar 2009 Posts: 1,419 Rep Power: 26	2. We did the port a little while ago. Since it is based on Linux it was quite easy - the only major change we had to make was in enforcing 4 byte alignment for mpi transfers. It should just compile/run out of the box. We just linked in their native mpi - didn't do any specific optimisation. 1. We only ran some tiny testcases to make sure it was running. I'd be interested in seeing some performance metrics as well - especially scaling on lots of processors.

April 6, 2009, 15:09		#3
egp Senior Member Eric Paterson Join Date: Mar 2009 Location: Blacksburg, VA Posts: 197 Blog Entries: 1 Rep Power: 18	Hi Mattijs, Yeah, the wmake/rules looked pretty straight forward, so I expected it to compile without much problem. I have access to a SiCortex SC1458 which has 1458 cores (http://sicortex.com/products/entry_m..._system_sc1458). Once I have some scaling performance numbers, I'll post them. Eric

April 7, 2009, 04:51		#4
mattijs Senior Member Mattijs Janssens Join Date: Mar 2009 Posts: 1,419 Rep Power: 26	We found a big benefit from turning off runTimeModifiable (checks all registered dictionaries for change every time step). The nfs performance is not spectacular.

July 15, 2009, 10:14		#5
kwardle Senior Member Kent Wardle Join Date: Mar 2009 Location: Illinois, USA Posts: 219 Rep Power: 21	I have access to a SiCortex with 5832 cores. I will try to compile and runs some tests on this one too.