snappyhexmesh: Running out of memory (without reason?)
Hi,
I'm using SHM for OF 2.1.1 out of box on a VirtualBox machine on Windows 7 with 48 GB RAM and 8 physical cores. 40 GB and all cores are enabled for VirtualBox. My model runs fine with 2 or 4 cores. When I switch to 8 cores SHM aborts (while not even 10% RAM are used) randomly like this: Code:
Shell refinement iteration 1 Thanks Marco |
Hi Marco,
A few questions:
Bruno |
Hi Bruno,
thanks for your answer. 1. I tried ptscotch. with simple there is no such error. So finally this is an acceptable solution. 2. 2.1.1. 3. the ubuntu version this OF version was built on officially. Marco |
Hi Marco,
Which architecture of Ubuntu? i386/i686 or x86_64/amd64? You can check by running: Code:
uname -m Best regards, Bruno |
snappyHexMesh - ERROR: dgraphFold2: out of memory (2)
Well, now I have encountered the same problem. Trying to get the meshing with snappyHexMesh, I got:
[QUOTE]... Feature refinement iteration 24 ------------------------------ Marked for refinement due to explicit features : 92 cells. Determined cells to refine in = 13.28 s Selected for feature refinement : 136 cells (out of 10647165) Edge intersection testing: Number of edges : 36562736 Number of edges to retest : 8226 Number of intersected edges : 4230508 Refined mesh in = 2.76 s After refinement feature refinement iteration 24 : cells:10648117 faces:36562736 points:15512183 Cells per refinement level: 0 1149402 1 228530 2 967512 3 2859801 4 5442872 (14): ERROR: dgraphFold2: out of memory (2) (13): (16): ERROR: (9): (15): ERROR: dgraphFold2: out of memory (3) dgraphFold2: out of memory (2)ERROR: [17] dgraphFold2: out of memory (2)ERROR: dgraphFold2: out of memory (2)#[11] # 0 0 Foam::error: printStack(Foam::Ostream&)Foam::error: printStack(Foam::Ostream&)-------------------------------------------------------------------------- mpirun has exited due to process rank 9 with PID 23598 on ... [/QUOTE] The only available information seems to be related with the scotch library, but not much info really. In my case, I am running snappyHexMesh in a cluster using 64bit (x86_64), 36 cores, and requesting 4GB per core (way too decent for this type of mesh)... and still... ohh surprise, out of memory problem. Does anyone know how to solve this? Regards, |
Greetings caduqued,
If you ran in parallel, then the library "ptscotch" does have some limitations. By the way, which OpenFOAM version are you using? Because versions older than OpenFOAM 2.2.0 are using Scotch 5.1.1; while as of OpenFOAM 2.2.0, it uses Scotch 6.0.0, which is allegedly (missing reference ;)) a lot better! Best regards, Bruno |
Hi Bruno,
Thanks for your quick response. Yes, I am now using OpenFOAM 2.2.0, with (in fact) scotch 2.0.0. The parallelization method I am using is scotch (not ptscotch, as it used to be before), but I assume that is irrelevant, as it is just the name of the method (library being always scotch). With this hindsight, I can now (sadly !) confirm that it seems this new scotch version also exhibits some problems, although I must confess didn't know about them. So, in the meantime, waiting for a fix, I assume it will be safer to just stick to one of the traditional methods, right? Regards, Carlos |
Hi Carlos,
I forgot that they did rename "ptscotch" to "scotch" when used in parallel, so that the same dictionary could be used for the decomposition. The only other thing I can remember about is the "multilevel" decomposition strategy... I mentioned it some time ago here: http://www.cfd-online.com/Forums/ope...tml#post367979 - post #8. It's not the silver bullet, but if used correctly, it might help to get the best of both worlds... Best regards, Bruno |
Quote:
Thanks again. I did not know about the multilevel strategy, thanks a lot for bring my attention to it!!! (with openFOAM every day is a learning day!!!) I will try it... Regards, Carlos |
about dgraphFold2: out of memory
Hello, caduqued, about the dgraphFold2: out of memory error, have you solved it? I met this problem and couldn't find a solution.:(
|
Greetings Slanth,
You'll have to provide more specific details about the case you're meshing, because the error message: Code:
dgraphFold2: out of memory error It is even possible that the problem is:
Bruno |
I likewise encounter this error frequently. I'm meshing on a 32 core Opteron machine. I used 'scotch' for decomposition and I work with OF2.3.0. I get messages like:
Quote:
Other details: uname -a: Quote:
Quote:
|
Greetings capucsc,
Quote:
Any chance you have one of those examples that have this issue in a small file/case size and be allowed to share it with us, either publicly or privately? This way it would make it a lot easier to try and diagnose the source of this problem! Best regards, Bruno |
Hi Bruno,
The cases can be found here: https://www.dropbox.com/s/4u4jk2ps6o...es.tar.gz?dl=0 Thanks for taking a look! -Chris |
Same issue
Gentlemen,
I'm also seeing this same issue on a meshing case every once in a while. I'm on an Intel 16 core machine using OF 2.3.x and the scotch decomposition. Unfortunately, I don't have a case I can share at the moment, but please do let me know if a public bug report gets created for this so that I can keep an eye on it. If I come across a case I can share, I will do so! Thanks! Brock |
I believe, although I have little in way of evidence, that the occurrence of this error is tied to the number of cores used. I never encounter problems when running with 6 cores, but about 70% of runs fail when using 32 cores. If we were to make a bug report, where would it go? OpenFOAM or scotch or somewhere else?
|
The main place to report bugs for openfoam is here...
http://www.openfoam.org/mantisbt/ But if you report something, make sure you give the developer everything he needs to fix or at least diagnose the problem. It's best if you can isolate the problem down to a small model and then give them that model to debug with. I've had some good luck in reporting, one of the bugs I reported was fixed within 24 hrs! Brock |
Hey,
I encountered the same problem today while also using scotch decomposition with 32 processors on a 64bit cluster headnode. Before, I did a similiar case with the same geometry, but I split up the .stl-files and now I get this error every time. Case is running if i switch to 27 cores though. Code:
(16): ERROR: dgraphFold2: out of memory (2) |
I have yet to pinpoint the exact reason this happens, so I haven't submitted a bug report. Debugging this turns out to be rather tricky. I just use fewer processors to mesh.
|
I have tried many times and finally walk around. At first, you should use surfaceCheck utility to make sure your stl file is closed and does not have any unconneceted parts. Even the total stl file has been decomposed into several parts, it should be closed when combining all of them.
|
All times are GMT -4. The time now is 15:30. |