CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > SU2

SU2 High Memory Footprint-CGNS Reader

Register Blogs Community New Posts Updated Threads Search

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   March 23, 2016, 01:11
Default SU2 High Memory Footprint-CGNS Reader
  #1
Member
 
Dominic Chandar
Join Date: Mar 2009
Location: United Kingdom
Posts: 31
Rep Power: 17
dominic is on a distinguished road
Send a message via Skype™ to dominic
Guys,

I'm observing a very high memory footprint/processor basis on running SU2_CFD.

nElements: 85Million
nNodes: 20 Million
Case: NASA CRM Model (CGNS MESH)

nProcs: 24

memory per process ~ 10GB

Looks like the CGNS reader reads the entire mesh onto all Partitions ? Also I can not use more than 32 processors for this mesh size. It exits while it is reading a particular section.

Any comments ?

Cheers,
Dominic
dominic is offline   Reply With Quote

Old   March 23, 2016, 05:43
Default
  #2
Member
 
Amit
Join Date: May 2013
Posts: 85
Rep Power: 12
aero_amit is on a distinguished road
Hi Dominic,

I am also facing the same issue. I attempted solution for 40 million cells grid.
Memory taken per node is very high.
I was also trying if CGNS grid can be written in SU2 format and see if situation can be improved. In earlier version there was an option to convert and write grid from CGNSTOSU2 format, in later versions it has been removed i.e. it is converting the grid but write option is not
available.
Hope this issue will be resolved in next release.

Best.
aero_amit is offline   Reply With Quote

Old   March 24, 2016, 03:56
Default
  #3
Member
 
Amit
Join Date: May 2013
Posts: 85
Rep Power: 12
aero_amit is on a distinguished road
Hi,

I checked the same problem with a commercial code, Memory requirement for that is similar to as of SU2.
Actually memory taken by SU2 is on higher side only. I was going through another thread in SU2 forum, other guys have similar experience.
Also developers pointed that this issue is bieng continuously improved.

Regards
Amit

Last edited by aero_amit; March 27, 2016 at 10:07.
aero_amit is offline   Reply With Quote

Old   March 24, 2016, 04:10
Default
  #4
New Member
 
Join Date: Dec 2013
Location: Italy
Posts: 29
Rep Power: 12
Jiba is on a distinguished road
Quote:
Originally Posted by aero_amit View Post
Hi Dominic,

I am also facing the same issue. I attempted solution for 40 million cells grid.
Memory taken per node is very high.
I was also trying if CGNS grid can be written in SU2 format and see if situation can be improved. In earlier version there was an option to convert and write grid from CGNSTOSU2 format, in later versions it has been removed i.e. it is converting the grid but write option is not
available.
Hope this issue will be resolved in next release.

Best.
Hi,

if you are interested in converting the grid you can use SU2_MSH instead of CGNSTOSU2. To work properly you have to run it in serial.

Regards.
Jiba is offline   Reply With Quote

Old   March 31, 2016, 05:05
Default
  #5
Member
 
Dominic Chandar
Join Date: Mar 2009
Location: United Kingdom
Posts: 31
Rep Power: 17
dominic is on a distinguished road
Send a message via Skype™ to dominic
Jiba and Amit,

Thanks for your replies. I was able to use SU2_MSH to convert the cgns to su2 mesh format. I'm able to run it (currently) on 1536 cores and the memory footprint is

Partitioning state (ParMETIS): 1.5Gb per process
Communication Partitioning : 2.5Gb per process
Running state : 1.6b per process
Per step Time : 1.54s ( on 768 processes it is 2.5 s ).

However, OpenFOAM has relatively lower memory footprint for the exact same problem, about 3Gb per process during run time on 24 processes. But from the point of view of robustness/stability, SU2 is definitely better.

Cheers
Dominic
dominic is offline   Reply With Quote

Old   April 20, 2016, 16:00
Default
  #6
Super Moderator
 
Thomas D. Economon
Join Date: Jan 2013
Location: Stanford, CA
Posts: 271
Rep Power: 14
economon is on a distinguished road
Dominic, all,

I am glad to hear that you were able to get it working. Indeed, we have just recently put in even more fixes to the memory (especially during partitioning), so you might try with the current 'develop' branch on GitHub with your large cases.

Please keep us up to date on your findings so that we can keep improving the code.

Take care,
Tom
economon is offline   Reply With Quote

Reply

Tags
cgns, su2


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
SU2 High Memory Footprint-CGNS Reader dominic SU2 1 March 23, 2016 01:10
Official Release of SU2 V3.2 economon SU2 News & Announcements 6 April 17, 2015 23:28
Lenovo C30 memory configuration and discussions with Lenovo matthewe Hardware 3 October 17, 2013 10:23
High performance virtual memory tip connclark OpenFOAM Running, Solving & CFD 0 December 5, 2007 18:35
Multicomponent fluid Andrea CFX 2 October 11, 2004 05:12


All times are GMT -4. The time now is 15:28.