Parallel runs with sonicDyMFoam crashes (works fine with sonicFoam)
 

Hi!

I have problem with running my dynamic mesh case in parallel. Basically sonicFoam works fine for me in both parallel and serial, but sonicDyMFoam only works in serial. It crashes with a floating point exception. I'm running OF version 2.1.0 on Ubuntu. I have tried different decomposition methods (simple, scotch) and different number of partitions. I have also tried the preservePatches option when decomposing since my case contains cyclic patches but without success. It also appears to crash at the same step.

Below is a typical log of a crashing run.

Does anyone have any idea what causes this? Any help is welcome.

/ Johan




johan@construction-05:~/fsiKlaff/sixDoFKlaff_forts$ mpirun -np 2 sonicDyMFoam -parallel
/*---------------------------------------------------------------------------*\
| ========= | |
| \\ / F ield | OpenFOAM: The Open Source CFD Toolbox |
| \\ / O peration | Version: 2.1.0 |
| \\ / A nd | Web: www.OpenFOAM.org |
| \\/ M anipulation | |
\*---------------------------------------------------------------------------*/
Build : 2.1.0-0bc225064152
Exec : sonicDyMFoam -parallel
Date : Mar 09 2012
Time : 10:36:35
Host : "construction-05"
PID : 3945
Case : /home/johan/fsiKlaff/sixDoFKlaff_forts
nProcs : 2
Slaves :
1
(
"construction-05.3946"
)

Pstream initialized with:
floatTransfer : 0
nProcsSimpleSum : 0
commsType : nonBlocking
sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStampMaster
allowSystemOperations : Disallowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time

Create mesh for time = 0.0005

Reading thermophysical properties

Selecting thermodynamics package ePsiThermo<pureMixture<constTransport<specieThermo <eConstThermo<perfectGas>>>>>
Reading field U

Reading/calculating face flux field phi

Creating turbulence model

Selecting turbulence model type LESModel
Selecting LES turbulence model Smagorinsky
SmagorinskyCoeffs
{
ce 1.048;
Prt 1;
ck 0.02;
}


Starting time loop

Selecting motion solver: displacementLaplacian
Selecting motion diffusion: inverseDistance
Reading/calculating field UMean

Reading/calculating field pMean

Reading/calculating field UPrime2Mean

Reading/calculating field pPrime2Mean

fieldAverage: starting averaging at time 0.0005

Reading surface description:
walls

Time = 0.000501

Courant Number mean: 0.009630999165 max: 0.2013552009
Restraint axialSpring: angle -0.0004847864609 force (0 0 0) moment (0 20.31949299 0)
sixDoFRigidBodyMotion constraints converged in 1 iterations
Constraint force: (0 0 0)
Constraint moment: (0 0 0)
Centre of mass: (-0.04972414949 0.1 0.04312704369)
Linear velocity: (1.016357088 2.224534681e-07 -0.6465280553)
Angular velocity: (-0.0002948032262 5.050924264 -0.000191446746)
GAMG: Solving for cellDisplacementx, Initial residual = 0.002116384691, Final residual = 8.517207312e-06, No Iterations 1
GAMG: Solving for cellDisplacementy, Initial residual = 0.002498178439, Final residual = 7.214166316e-06, No Iterations 2
GAMG: Solving for cellDisplacementz, Initial residual = 0.001614054654, Final residual = 8.963706826e-06, No Iterations 1
[1] #0 Foam::error::printStack(Foam::Ostream&) in "/opt/openfoam210/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[1] #1 Foam::sigFpe::sigHandler(int) in "/opt/openfoam210/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[1] #2 in "/lib/libc.so.6"
[1] #3 Foam::volPointInterpolation::makeWeights() in "/opt/openfoam210/platforms/linux64GccDPOpt/lib/libfiniteVolume.so"
[1] #4 Foam::volPointInterpolation::updateMesh() in "/opt/openfoam210/platforms/linux64GccDPOpt/lib/libfiniteVolume.so"
[1] #5 Foam::volPointInterpolation::volPointInterpolation (Foam::fvMesh const&) in "/opt/openfoam210/platforms/linux64GccDPOpt/lib/libfiniteVolume.so"
[1] #6 Foam::MeshObject<Foam::fvMesh, Foam::volPointInterpolation>::New(Foam::fvMesh const&) in "/opt/openfoam210/platforms/linux64GccDPOpt/lib/libfiniteVolume.so"
[1] #7 Foam::displacementLaplacianFvMotionSolver::curPoin ts() const in "/opt/openfoam210/platforms/linux64GccDPOpt/lib/libfvMotionSolvers.so"
[1] #8 Foam::motionSolver::newPoints() in "/opt/openfoam210/platforms/linux64GccDPOpt/lib/libdynamicMesh.so"
[1] #9
[1] in "/opt/openfoam210/platforms/linux64GccDPOpt/bin/sonicDyMFoam"
[1] #10 __libc_start_main in "/lib/libc.so.6"
[1] #11
[1] in "/opt/openfoam210/platforms/linux64GccDPOpt/bin/sonicDyMFoam"
[construction-05:03946] *** Process received signal ***
[construction-05:03946] Signal: Floating point exception (8)
[construction-05:03946] Signal code: (-6)
[construction-05:03946] Failing at address: 0x3e800000f6a
[construction-05:03946] [ 0] /lib/libc.so.6(+0x33af0) [0x7f2f90b1baf0]
[construction-05:03946] [ 1] /lib/libc.so.6(gsignal+0x35) [0x7f2f90b1ba75]
[construction-05:03946] [ 2] /lib/libc.so.6(+0x33af0) [0x7f2f90b1baf0]
[construction-05:03946] [ 3] /opt/openfoam210/platforms/linux64GccDPOpt/lib/libfiniteVolume.so(_ZN4Foam21volPointInterpolation 11makeWeightsEv+0x521) [0x7f2f930da091]
[construction-05:03946] [ 4] /opt/openfoam210/platforms/linux64GccDPOpt/lib/libfiniteVolume.so(_ZN4Foam21volPointInterpolation 10updateMeshEv+0x9) [0x7f2f930da5d9]
[construction-05:03946] [ 5] /opt/openfoam210/platforms/linux64GccDPOpt/lib/libfiniteVolume.so(_ZN4Foam21volPointInterpolation C1ERKNS_6fvMeshE+0xae) [0x7f2f930da69e]
[construction-05:03946] [ 6] /opt/openfoam210/platforms/linux64GccDPOpt/lib/libfiniteVolume.so(_ZN4Foam10MeshObjectINS_6fvMesh ENS_21volPointInterpolationEE3NewERKS1_+0xf8) [0x7f2f9308a408]
[construction-05:03946] [ 7] /opt/openfoam210/platforms/linux64GccDPOpt/lib/libfvMotionSolvers.so(_ZNK4Foam35displacementLapla cianFvMotionSolver9curPointsEv+0x2c) [0x7f2f6177fbcc]
[construction-05:03946] [ 8] /opt/openfoam210/platforms/linux64GccDPOpt/lib/libdynamicMesh.so(_ZN4Foam12motionSolver9newPoints Ev+0x2a) [0x7f2f926e108a]
[construction-05:03946] [ 9] sonicDyMFoam() [0x41a607]
[construction-05:03946] [10] /lib/libc.so.6(__libc_start_main+0xfd) [0x7f2f90b06c4d]
[construction-05:03946] [11] sonicDyMFoam() [0x4174d9]
[construction-05:03946] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 1 with PID 3946 on node construction-05 exited on signal 8 (Floating point exception).
--------------------------------------------------------------------------