CFD Online Discussion Forums

CFD Online Discussion Forums (https://www.cfd-online.com/Forums/)
-   OpenFOAM Running, Solving & CFD (https://www.cfd-online.com/Forums/openfoam-solving/)
-   -   MPI error with simpleFoam (https://www.cfd-online.com/Forums/openfoam-solving/162288-mpi-error-simplefoam.html)

blaise November 7, 2015 15:01

MPI error with simpleFoam
 
Hello,

i am trying to start a simpleFoam simulation with OpenFOAM 2.3.x with a 14 Million cells grid on 96 CPUs on a Linux cluster running CentOS 6.4. I get the following error(s):

Code:


SIMPLE: no convergence criteria found. Calculations will run for 40000 steps.

Starting time loop

forces forces:
    Not including porosity effects

--> FOAM Warning :
    From function tetIndices polyMeshTetDecomposition::triangleTetIndices(const polyMesh&, label, label, label)
    in file meshes/polyMesh/polyMeshTetDecomposition/polyMeshTetDecomposition.C at line 643
    No base point for face 9127, 4(1430 3077 4521 3403), produces a valid tet decomposition.
--> FOAM Warning :
    From function tetIndices polyMeshTetDecomposition::triangleTetIndices(const polyMesh&, label, label, label)
    in file meshes/polyMesh/polyMeshTetDecomposition/polyMeshTetDecomposition.C at line 643
    No base point for face 10448, 5(3645 4427 3179 4128 2868), produces a valid tet decomposition.
--> FOAM Warning :

lots of this... (it is supposed to stop after 100 Warnings).
Then:
Code:

fieldAverage fieldAverage1:
    Starting averaging at time 0

Time = 1

[95] #0  Foam::error::printStack(Foam::Ostream&)--------------------------------------------------------------------------
An MPI process has executed an operation involving a call to the
"fork()" system call to create a child process.  Open MPI is currently
operating in a condition that could result in memory corruption or
other system errors; your MPI job may hang, crash, or produce silent
data corruption.  The use of fork() (or system() or other calls that
create child processes) is strongly discouraged. 

The process that invoked fork was:
...

and finally:
Code:

in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[95] #1  Foam::sigFpe::sigHandler(int) in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[95] #2 
[95]  at sigaction.c:0
[95] #3  Foam::GaussSeidelSmoother::smooth(Foam::word const&, Foam::Field<double>&, Foam::lduMatrix const&, Foam::Field<double> const&, Foam::FieldField<Foam::Field, double> const&, Foam::UPtrList<Foam::lduInterfaceField const> const&, unsigned char, int) in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[95] #4  Foam::GaussSeidelSmoother::smooth(Foam::Field<double>&, Foam::Field<double> const&, unsigned char, int) const in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[95] #5  Foam::smoothSolver::solve(Foam::Field<double>&, Foam::Field<double> const&, unsigned char) const in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[95] #6 
[95]  in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/bin/simpleFoam"
[95] #7 
[95]  in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/bin/simpleFoam"
[95] #8 
[95]  in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/bin/simpleFoam"
[95] #9 
[95]  in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/bin/simpleFoam"
[95] #10  __libc_start_main in "/lib64/libc.so.6"
[95] #11 
[95]  in "/usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/bin/simpleFoam"
[ofslave32:04863] *** Process received signal ***
[ofslave32:04863] Signal: Floating point exception (8)
[ofslave32:04863] Signal code:  (-6)
[ofslave32:04863] Failing at address: 0x1f4000012ff
[ofslave32:04863] [ 0] /lib64/libc.so.6() [0x35fd632920]
[ofslave32:04863] [ 1] /lib64/libc.so.6(gsignal+0x35) [0x35fd6328a5]
[ofslave32:04863] [ 2] /lib64/libc.so.6() [0x35fd632920]
[ofslave32:04863] [ 3] /usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so(_ZN4Foam19GaussSeidelSmoother6smoothERKNS_4wordERNS_5FieldIdEERKNS_9lduMatrixERKS5_RKNS_10FieldFieldIS4_dEERKNS_8UPtrListIKNS_17lduInterfaceFieldEEEhi+0x345) [0x7fe740acedb5]
[ofslave32:04863] [ 4] /usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so(_ZNK4Foam19GaussSeidelSmoother6smoothERNS_5FieldIdEERKS2_hi+0x2d) [0x7fe740acf01d]
[ofslave32:04863] [ 5] /usr/local/OpenFOAM/OpenFOAM-2.3.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so(_ZNK4Foam12smoothSolver5solveERNS_5FieldIdEERKS2_h+0x4f7) [0x7fe740ac8397]
[ofslave32:04863] [ 6] simpleFoam() [0x43561a]
[ofslave32:04863] [ 7] simpleFoam() [0x448d51]
[ofslave32:04863] [ 8] simpleFoam() [0x44903e]
[ofslave32:04863] [ 9] simpleFoam() [0x445481]
[ofslave32:04863] [10] /lib64/libc.so.6(__libc_start_main+0xfd) [0x35fd61ecdd]
[ofslave32:04863] [11] simpleFoam() [0x41b781]
[ofslave32:04863] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 95 with PID 4863 on node ofslave32 exited on signal 8 (Floating point exception).
--------------------------------------------------------------------------

Could someone point me in the right direction where to look for a solution?

Thank you!
Cheers,

Pascal.


All times are GMT -4. The time now is 02:46.