Event counter overflowed -> MPI crash

amanbearpig · April 12, 2019, 10:24

I've run into a problem that I can't seem to find any information on here, and is outside my area of knowledge. I'm working on a turbulent inflow generation code and am testing it out now. It (seems like it) works fine, however when I run in parallel, after running for awhile I get the following warning:

Code:

--> FOAM Warning :
    From function Foam::label Foam::objectRegistry::getEvent() const
    in file db/objectRegistry/objectRegistry.C at line 221
    Event counter has overflowed. Resetting counter on all dependent objects.

The code then crashes on the next iteration:

Code:

*** An error occurred in MPI_Waitall
 *** reported by process [3615162369,7]
 *** on communicator MPI_COMM_WORLD
 *** MPI_ERR_TRUNCATE: message truncated
 *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
 ***    and potentially your MPI job)

The counter warning occurs when running in serial as well, but with no crashes or noticeable errors.

Has anyone ran into this type of problem before, or have any suggestions on how to solve it?

This is using foam-extend-4.1.

blue8803 · June 21, 2020, 02:08

Do you have solved this problem? I also struggle with similar problem..

Running in serial and in parallel with few nodes are fine. However, in parallel with many nodes leads to crash or stuck somewhere.
(The solver i used is interDyMFoam and fe41 is version of OF)

April 12, 2019, 10:24	Event counter overflowed -> MPI crash	#1
amanbearpig Member Join Date: Apr 2011 Posts: 57 Rep Power: 15	I've run into a problem that I can't seem to find any information on here, and is outside my area of knowledge. I'm working on a turbulent inflow generation code and am testing it out now. It (seems like it) works fine, however when I run in parallel, after running for awhile I get the following warning: Code: --> FOAM Warning : From function Foam::label Foam::objectRegistry::getEvent() const in file db/objectRegistry/objectRegistry.C at line 221 Event counter has overflowed. Resetting counter on all dependent objects. The code then crashes on the next iteration: Code: * An error occurred in MPI_Waitall * reported by process [3615162369,7] * on communicator MPI_COMM_WORLD * MPI_ERR_TRUNCATE: message truncated * MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort, * and potentially your MPI job) The counter warning occurs when running in serial as well, but with no crashes or noticeable errors. Has anyone ran into this type of problem before, or have any suggestions on how to solve it? This is using foam-extend-4.1. Last edited by amanbearpig; April 12, 2019 at 10:25. Reason: Specifying OpenFOAM version

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
DPMFoam - Serious Error --particle-laden flow in simple geometric config	benz25	OpenFOAM Running, Solving & CFD	27	December 19, 2017 20:47
Event counter in OpenFOAM	adhiraj	OpenFOAM	3	February 10, 2012 11:56
Sgimpi	pere	OpenFOAM	27	September 24, 2011 07:57
Error using LaunderGibsonRSTM on SGI ALTIX 4700	jaswi	OpenFOAM	2	April 29, 2008 10:54
Is Testsuite on the way or not	lakeat	OpenFOAM Installation	6	April 28, 2008 11:12

June 21, 2020, 02:08		#2
blue8803 New Member Chaewoong Ban Join Date: Jun 2013 Posts: 18 Rep Power: 12	Do you have solved this problem? I also struggle with similar problem.. Running in serial and in parallel with few nodes are fine. However, in parallel with many nodes leads to crash or stuck somewhere. (The solver i used is interDyMFoam and fe41 is version of OF)