CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > SU2

Domain Decomposition Out-of-Memory

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   March 11, 2013, 14:33
Default Domain Decomposition Out-of-Memory
  #1
New Member
 
Greg Power
Join Date: Jan 2013
Posts: 9
Rep Power: 4
grjmpower is on a distinguished road
Hi,

I am running on a cluster with 12 cores/node and 16 MB per node. When running the Domain Decomposition on a reasonably large problem (21 million cells), I get an OOM (Out of Memory) message from the node. This seems to be happening during the write operation. (see attached output file).

When I reduce to 3.1 million cells, then the domain decomposition code runs and SU2_CFD starts.

Could SU2_DDC be using more that 16 GB with the 21 million cell grid? Why should the error occur during the write?

Thanks,

Greg
Attached Files
File Type: txt output.txt (9.5 KB, 6 views)
File Type: txt rev4_cfg.txt (8.3 KB, 5 views)
grjmpower is offline   Reply With Quote

Old   March 12, 2013, 15:43
Default
  #2
Super Moderator
 
Francisco Palacios
Join Date: Jan 2013
Location: Stanford, CA
Posts: 301
Rep Power: 5
fpalacios is on a distinguished road
Quote:
Originally Posted by grjmpower View Post
Hi,

I am running on a cluster with 12 cores/node and 16 MB per node. When running the Domain Decomposition on a reasonably large problem (21 million cells), I get an OOM (Out of Memory) message from the node. This seems to be happening during the write operation. (see attached output file).

When I reduce to 3.1 million cells, then the domain decomposition code runs and SU2_CFD starts.

Could SU2_DDC be using more that 16 GB with the 21 million cell grid? Why should the error occur during the write?

Thanks,

Greg
Hi Greg,
We are aware of the SU2_DDC and I/O limitations for a 21M cells grid, and the new monthly version of SU2 2.0.2 (next Tuesday) will include substantial improvements: binary outputs (tecplot, cgns) without python scripts for the merging process, and a new SU2_DDC. So please stay tuned.

Best,
Francisco
fpalacios is offline   Reply With Quote

Old   March 29, 2013, 07:52
Default
  #3
New Member
 
Greg Power
Join Date: Jan 2013
Posts: 9
Rep Power: 4
grjmpower is on a distinguished road
Francisco,

I am running v2.0.2 now and still run into the out-of-memory problem. The grid is over 25 million elements. The code stops while writing the grid partitions as with the earlier version. A 3 million element grid does partition correctly, but has problems writing the flow files (see separate post).

The computer I am using has 16GB per node.

Unfortunately, this is a show stopper for using SU^2 for real problems.

Greg
grjmpower is offline   Reply With Quote

Old   April 11, 2013, 13:24
Default
  #4
New Member
 
Join Date: Dec 2011
Posts: 22
Rep Power: 5
aniketaranake is on a distinguished road
Quote:
Originally Posted by grjmpower View Post
Hi,

I am running on a cluster with 12 cores/node and 16 MB per node. When running the Domain Decomposition on a reasonably large problem (21 million cells), I get an OOM (Out of Memory) message from the node. This seems to be happening during the write operation. (see attached output file).

When I reduce to 3.1 million cells, then the domain decomposition code runs and SU2_CFD starts.

Could SU2_DDC be using more that 16 GB with the 21 million cell grid? Why should the error occur during the write?

Thanks,

Greg
Hi Greg,

Thank you for your post. We are aware of this memory leak, and it will be fixed in the next monthly release. Look for it at the beginning of next week.

Cheers,
Aniket
aniketaranake is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
An error has occurred in cfx5solve: volo87 CFX 5 June 14, 2013 17:44
Numerical errors in nested domain with pre-calculated boundary values Arnoldinho OpenFOAM Running, Solving & CFD 3 April 4, 2012 10:31
CFX Solver Memory Error mike CFX 1 March 19, 2008 08:22
CFX CPU time & real time Nick Strantzias CFX 8 July 23, 2006 17:50
Domain decomposition rajesh Main CFD Forum 2 August 31, 1999 04:22


All times are GMT -4. The time now is 04:55.