CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM

OpenFOAM and gpgpu

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   December 18, 2009, 16:17
Default
  #21
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
Hi Vincent,

Sounds interesting! We are looking for good testing scenarios where for example our BiCGStab could be validated. Later we will have also CG and preconditioners: Jakobi and DILU.
OpenFoam demos include mostly relative small and sparse matrices. Also "the solver" part takes only about 10-20% of the overall time (probably OF uses SIMPLE algorithm, that's why).

Let me know if you have the application that could benefit from such solver.

Best wishes,
Lukasz
Lukasz is offline   Reply With Quote

Old   December 27, 2009, 10:46
Default
  #22
Member
 
Maxim Loginov
Join Date: Mar 2009
Posts: 33
Rep Power: 8
zeliboba is on a distinguished road
Quote:
Originally Posted by Lukasz View Post
We want to make the installation as easy as possible
I would suggest to try freefoam distribution, it closely follows upstream development and has cmake based build system.
zeliboba is offline   Reply With Quote

Old   January 21, 2010, 16:36
Thumbs up a little more info would be appreciated
  #23
New Member
 
Jerry Lee
Join Date: Jul 2009
Posts: 17
Rep Power: 8
leejc is on a distinguished road
How very exciting. Could you let us know more about this effort such as the scope and test cases, where it will be released? Also, the double precision boards from Nvidea is coming out in April, any thoughts/plans on using this? Many thanks. J.

Quote:
Originally Posted by Lukasz View Post
Well, we have been working on a plugin to OpenFOAM that allows easily for replacing existing solvers with their CUDA versions, such as BiCGStab or CG. It should be ready in 1Q of 2010. We want to make the installation as easy as possible (1. run wmake compilation script with our plugin 3. change two OF configuration files 3. run the simulation). I hope this is simple enough but as we are still in the development process any comments will be appreciated.
leejc is offline   Reply With Quote

Old   January 26, 2010, 17:52
Default
  #24
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
Dear Jerry,

Right now we are in the testing phase. The testing matrices were collected from University of Florida Sparse Matrix Collection. Since 90% of the solving process is devoted to Sparce Matrix Vector Multiplication we focused on testing this operation in the first place. For around 20 different matrices with different size, number of NNZ and the structure the average performance is about 7-8 GFLOPS in average (>10 GFLOPS peak performance) in double precision and 9-10 GFLOPS (13 GFLOPS) in single precision. Of course, everything depends on the matrix structure. The denser the matrix the better. Please also note that because of the memory transfers / PCIe bottleneck it is not worth to use our solvers only for few iterations. The more iterations are needed the better performance we can get.

If you give me your personal email address I could send you more diagrams with preliminary results and more information about the scope of the library.

Best wishes, Lukasz
Lukasz is offline   Reply With Quote

Old   February 19, 2010, 23:00
Default
  #25
New Member
 
chris knopp
Join Date: Mar 2009
Posts: 10
Rep Power: 8
cknopp is on a distinguished road
Hello! I am very new to using openFOAM, and I was reading about the Live-SUSE USB drive version for my win7 based computer. I have been following the gpgpu.org site for quite some time, and being an AMD solutions provider, I came across this in an email released a few weeks ago:

http://developer.amd.com/Assets/ACML-GPUreadme.pdf

http://developer.amd.com/GPU/ACMLGPU/Pages/default.aspx


1. Is it even possible to compile this lib into OF as a replacement?

2. If it is possible, would it even help?

3. If it is possible, is there anyone out there that can direct me to how to implement it into a Live-USB build to run on my desktop?

I have a AMD 955BE quad core CPU, 8GB DDR3 1600 RAM, dual 4870x2 ATI video cards with 3200 double precision stream cores and 4GB DDR5 RAM. If anyone can make this happen, I would be MORE THAN HAPPY to test it out!

PS: With the new cards and motherboards, it would be possible to scale this distro to run on 12800 double precision paralell Stream processors in a single desktop. I'm sure that anyone can see where that would take the possibilities of todays CFD solver times.

PPS: With this, would it also be possible to include a fractal turbulence modeler? Maybe that would be a bit more accurate than the common "guesstimate" models?

THANKS!

I can be reached at cknopp@gmail.com if anyone would like to contact me directly about this!

Thanks again!

Chris
cknopp is offline   Reply With Quote

Old   March 3, 2010, 16:39
Default
  #26
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
Hi,

You asked me once about the plugin for OpenFOAM with CUDA-based solvers.

Drop me a line and I will send you the documentation (Reference Manual + Programming Guide). We have just finished the implementation and testing (flow in human aorta).

We also have a GPL version for playing around.

Best wishes,
Lukasz
Lukasz is offline   Reply With Quote

Old   March 4, 2010, 11:30
Default
  #27
New Member
 
chris knopp
Join Date: Mar 2009
Posts: 10
Rep Power: 8
cknopp is on a distinguished road
With the release of OpenCL, I suspect that all GPU accelerated applications (especially commercial code) will be ported due to its multi-manufacturer support, including the Linux/Windows/MacOS operating system support.

I would like to try your plugin as well, and I would LOVE to try any OpenCL implemetation of OpenFOAM that some developers may be working on!

OpenCL is the way of the future. If you are not sold yet, check out the LuxRender forums. They are seeing a 1600% speedup in some cases, and that is utterly rediculous for a software that has been optimized for the last few years. The first CFD solution that is written in CL is going to dominate the commercial market... Especially since the F1 teams that are currently CPU FLOPS limited by regulation could add GPU's and still get around the regulations!

I hope to see more soon!
cknopp is offline   Reply With Quote

Old   March 4, 2010, 11:48
Default
  #28
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
Please introduce yourself and send me your private email address.
Lukasz is offline   Reply With Quote

Old   March 4, 2010, 11:52
Default
  #29
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
Quote:
Originally Posted by cknopp View Post
With the release of OpenCL, I suspect that all GPU accelerated applications (especially commercial code) will be ported due to its multi-manufacturer support, including the Linux/Windows/MacOS operating system support.

I would like to try your plugin as well, and I would LOVE to try any OpenCL implemetation of OpenFOAM that some developers may be working on!
We also considered OpenCL as a potential programming platform. However, they don't support STL which is a serious limitation for optimal programming.

We will wait for the next release.
Lukasz is offline   Reply With Quote

Old   March 4, 2010, 12:12
Default
  #30
New Member
 
chris knopp
Join Date: Mar 2009
Posts: 10
Rep Power: 8
cknopp is on a distinguished road
Can you clarify what STL is? I know that there are a few devs out there that are using CL for CFD (COMSOL, SYMSCAPE). I have word from members of both teams that they are working on a CL implemetation.

If STL is a limiting factor, can you explain how? Maybe I can ask my contacts to see how they are working around it!

THANKS!
cknopp is offline   Reply With Quote

Old   March 23, 2010, 16:57
Default
  #31
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
STL makes your code look more optimal:
http://pl.wikipedia.org/wiki/Standard_Template_Library

If you have some contacts with OpenCL developers let them know this is a feature request.
Lukasz is offline   Reply With Quote

Old   April 14, 2010, 02:34
Default Hi ,Lukas, could you please send me a copy of documents ,Thank you
  #32
New Member
 
allon jackson
Join Date: Apr 2010
Posts: 1
Rep Power: 0
gundamhero is on a distinguished road
I'm doing research in CFD about Openfoam and CUDA, Thanks.
my email address is :
mengweichao999@gmail.com



Quote:
Originally Posted by Lukasz View Post
Hi,

You asked me once about the plugin for OpenFOAM with CUDA-based solvers.

Drop me a line and I will send you the documentation (Reference Manual + Programming Guide). We have just finished the implementation and testing (flow in human aorta).

We also have a GPL version for playing around.

Best wishes,
Lukasz
gundamhero is offline   Reply With Quote

Old   June 16, 2010, 05:44
Default
  #33
New Member
 
Gaurav
Join Date: Jun 2010
Location: Bangalore, India
Posts: 12
Rep Power: 7
PaGgiE is on a distinguished road
Hi Lukasz,

I am working upon accelerating OpenFOAM on heterogenious systems with OpenCL. And I would like to have a look upon the plug-in to OpenFOAM that allows replacing existing solvers with their CUDA versions.
It will be nice if you could send me the manual and programmers guide for that.

And can you tell me how much progress has been made by other people, who are working on the same thing as me, like, porting OpenFOAM to OpenCL? If you have some information about it.

Regards,
Gaurav
PaGgiE is offline   Reply With Quote

Old   July 15, 2010, 05:06
Default
  #34
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
Hi Gaurav,

After registration at speedit.vratis.com you can download the OpenFOAM plugin that allows to replace the standard solvers with their GPU versions. Also, see the documentation about the performance of our CG and BCGSTAB solvers. To my knowledge we are the fastest so far.

Best wishes,
Lukasz
Lukasz is offline   Reply With Quote

Old   August 16, 2010, 13:08
Default
  #35
New Member
 
Jerry Lee
Join Date: Jul 2009
Posts: 17
Rep Power: 8
leejc is on a distinguished road
Lukasz,

Do I just sign up at speedit.vratis.com to test out the openfoam plugin? Is it part of the eXtreme package? Also, the eXtreme package Is there a tutorial or a test case I can use to try out the openforam plugin? Also, I am intersted in using it to accelerate the Lagrangian solver in openform (for particle tracking). So, is there a plugin for that?

Jerry


Quote:
Originally Posted by leejc View Post
How very exciting. Could you let us know more about this effort such as the scope and test cases, where it will be released? Also, the double precision boards from Nvidea is coming out in April, any thoughts/plans on using this? Many thanks. J.
leejc is offline   Reply With Quote

Old   September 14, 2010, 09:58
Default
  #36
Senior Member
 
Andrea Pasquali
Join Date: Sep 2009
Location: Germany
Posts: 142
Rep Power: 7
andrea.pasquali is on a distinguished road
Hi,
I'm interesting to GPU for OpenFOAM.
I installed the SpeedIT Classic version but I have a problem you can see here:

SpeedIT Classic and OpenFOAM

Could anyone help me?

Thanks


Andrea
__________________
Andrea Pasquali
andrea.pasquali is offline   Reply With Quote

Old   November 19, 2010, 14:49
Default
  #37
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
Dear All,

We are happy to announce a new release of the OpenFOAM plugin 1.1 (GPL License).
Here is the list of features:

-Multi-GPU support.
-Tested on Fermi architecture (GTX460 and Tesla C2050).
-Automated submission of the domain to the GPU cards (using decomposePar from OpenFOAM).
-Optimized submission of computational tasks to the best GPU card in the system for any number of computational threads.
-Plugin picks the most powerful GPU card for a single thread cases.

You can freely download it at speedit.vratis.com. Enjoy!
Lukasz is offline   Reply With Quote

Old   August 29, 2014, 09:32
Default simple and piso on GPU
  #38
Member
 
Lukasz Miroslaw
Join Date: Dec 2009
Location: Poland
Posts: 64
Rep Power: 7
Lukasz is on a distinguished road
Send a message via Skype™ to Lukasz
Now we solve selected industry-relevant OpenFOAM cases on GPU ca. x3 faster vs. Intel Xeon E5649 running 12 cores, e.g. external aero in motorbike, 6m cells.

See this presentation for the latest results.
Lukasz is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
OpenFoam vs CFX5 mass balance in OpenFoam tangd OpenFOAM Running, Solving & CFD 33 May 23, 2010 16:36
CheckMesh error using a tutorial from OpenFOAM 114 with openFOAM 13 martapajon OpenFOAM Native Meshers: blockMesh 7 January 21, 2008 13:52
OpenFOAM users in Munich OpenFOAM benutzer in M%c3%bcnchen jaswi OpenFOAM 0 August 3, 2007 13:11
New Nvidia gpu aimed at gpgpu bmeagle OpenFOAM 0 November 9, 2006 10:41
A new Howto on the OpenFOAM Wiki Compiling OpenFOAM under Unix mbeaudoin OpenFOAM Installation 2 April 28, 2006 08:54


All times are GMT -4. The time now is 22:13.