CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Running, Solving & CFD

DecomposePar

Register Blogs Members List Search Today's Posts Mark Forums Read

Like Tree1Likes
  • 1 Post By HPE

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   May 13, 2020, 17:58
Default DecomposePar
  #1
New Member
 
Sricharan S Veeturi
Join Date: Jun 2016
Posts: 5
Rep Power: 9
veeturi is on a distinguished road
Hello Foamers,

I have recently started using openFOAM and I use an HPC cluster to run my simulations. Since I am running the job on parallel cores, I am using the decomposePar file in which I specify the method of distribution (Simple, Hierarchical or scotch). Currently I am using scotch however, I see that the reconstruction of the distributed domain takes a lot of time.

In my specific case, I have a mesh of 5 million elements and I run this on 6 nodes with 40 cores each (a total of 240 cores). The simulation itself (running a pimpleFoam model) takes about 10 hours which is good however, the reconstructPar takes 5 hours! which is 30% of the total time. Am I missing something? Will it make a difference if I use Simple or the hierarchical method? I'm not exactly sure why the reconstruction takes so long.
Experts, please correct any misconception I may have on my part.

Thank you.

Last edited by veeturi; May 14, 2020 at 19:05.
veeturi is offline   Reply With Quote

Old   May 14, 2020, 01:58
Default
  #2
HPE
Senior Member
 
HPE's Avatar
 
Herpes Free Engineer
Join Date: Sep 2019
Location: The Home Under The Ground with the Lost Boys
Posts: 932
Rep Power: 12
HPE is on a distinguished road
Hi

- reconstructPar is a serial execution utility.
- please try to use 'mpirun -np X redistributePar -reconstruct -parallel -latestTime', to see if it helps.
cryabroad likes this.
HPE is offline   Reply With Quote

Old   May 14, 2020, 19:07
Default
  #3
New Member
 
Sricharan S Veeturi
Join Date: Jun 2016
Posts: 5
Rep Power: 9
veeturi is on a distinguished road
Yes. That helped. Actually I'm running a field average as well on the simulation hence, all the results I need are in the last time step.

Thank you!
veeturi is offline   Reply With Quote

Reply

Tags
openfoam v6 + centos 7, parallel calculation, pimplefoam, reconstructpar

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Problem with decomposePar (and mapFields) for large problem quarkz OpenFOAM Pre-Processing 2 February 21, 2019 09:51
decomposePar problem: Cell 0contains face labels out of range (Again)) limonegiallo OpenFOAM Pre-Processing 4 August 28, 2017 05:18
decomposePar error chia87 OpenFOAM Pre-Processing 1 May 28, 2017 15:23
decomposePar 4-core warning/error? Boloar OpenFOAM Bugs 23 April 8, 2014 08:57
decomposePar gives errors of_user_ OpenFOAM 1 July 4, 2011 05:27


All times are GMT -4. The time now is 20:57.