|
[Sponsors] |
Problems with very large IO dictionaries in parallel |
|
LinkBack | Thread Tools | Search this Thread | Display Modes |
May 11, 2021, 07:13 |
Problems with very large IO dictionaries in parallel
|
#1 |
New Member
Ace Ventura
Join Date: Nov 2017
Posts: 4
Rep Power: 8 |
Hello everyone,
I'm experiencing weird behavior with OF when it comes to very large IO dictionaries. Basically, I am interpolating a lot of my fluid variables from a large multidimensional table. Due to the number of dimensions these tables tend to get quite large (easily 10GB+). When running my case in serial everything is fine and the initial results look good. When running in parallel with smaller tables (< 2-3 GB) also everything is fine and the results are in agreement with experimental data. Now when I increase my table size above 2-3 GB and run the case in parallel the solver "hangs" when reading in the dictionary and does not advance nor give any kind of error message. Again on single core the large tables work fine, so the table file shouldn't be compromised. RAM requirement should also be fine on the machine I'm using, although I'm guessing that what I'm doing is terribly inefficient since I'm utilizing only MPI and no shared memory message passing (eg. openMP). The IO read in for the table as an IODictionary looks like the following: IOdictionary control ( IOobject ( fileName_, instance, obr, IOobject::MUST_READ, IOobject::NO_WRITE ) ); control.readEntry("fields", entries_); So basically a direct copy of the readIn method in "interpolationLookUpTable". For any hints on how to solve this issue I'd be really thankful |
|
May 21, 2021, 16:09 |
|
#2 |
Senior Member
Klaus
Join Date: Mar 2009
Posts: 281
Rep Power: 22 |
Maybe this helps:
There's a section called "OptimisationSwitches" in /home/.../OpenFOAM/OpenFOAM-8/etc/controlDict which deals with Parallel IO handling. It could help to set it to "collated" and set a buffer size... Here you can find a comprehensive explanation what it is about: https://github.com/OpenFOAM/OpenFOAM...ae435d4ab42e6f Basically, you'll run the case in parallel but now, IO is only done and managed through the master process. If you write your own IO code for your purposes, it might help to leverage this functionality. |
|
May 22, 2021, 10:20 |
|
#3 |
Senior Member
Herpes Free Engineer
Join Date: Sep 2019
Location: The Home Under The Ground with the Lost Boys
Posts: 931
Rep Power: 13 |
__________________
The OpenFOAM community is the biggest contributor to OpenFOAM: User guide/Wiki-1/Wiki-2/Code guide/Code Wiki/Journal Nilsson/Guerrero/Holzinger/Holzmann/Nagy/Santos/Nozaki/Jasak/Primer Governance Bugs/Features: OpenFOAM (ESI-OpenCFD-Trademark) Bugs/Features: FOAM-Extend (Wikki-FSB) Bugs: OpenFOAM.org How to create a MWE New: Forkable OpenFOAM mirror |
|
May 22, 2021, 14:13 |
|
#4 |
New Member
Ace Ventura
Join Date: Nov 2017
Posts: 4
Rep Power: 8 |
Hey,
they both seems like viable options, thank you very much for the quick replies I'll dig through it next week and will post my updates accordingly. |
|
September 28, 2021, 11:28 |
|
#5 |
New Member
Balaji
Join Date: May 2013
Posts: 21
Rep Power: 13 |
Hi kingdomkarl,
Any updates on the collated cluster run? Did it work on the cluster? Please post your script for decompose, runnning and reconstructing. I am trying the same on cluster to save some file limit. Would be nice if you could share your updates and how you overcome the issue Regards |
|
Thread Tools | Search this Thread |
Display Modes | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Partitioning problems in the parallel job | Neo | FLUENT | 5 | January 26, 2021 11:10 |
[OpenFOAM.com] problems running in parallel on Mac OS X and Windows: only 1 cpu | windscion | OpenFOAM Installation | 20 | June 5, 2020 17:27 |
directMapped + regionCoupling + parallel problems | elisabet | OpenFOAM Running, Solving & CFD | 15 | October 3, 2018 11:04 |
MPI parallel meet problems | jiaojiao | OpenFOAM | 1 | May 10, 2016 03:30 |
Search of large problems | Rashid Faizullin | Main CFD Forum | 0 | September 10, 1998 14:46 |