[velan]

Hi all,
I am getting error while running in parallel mode. This happens after somany iterations. But same job i ran using single proc, its running fine. Anybody knows what is that error mean ?

- Velan

[0] #0 Foam::error::printStack(Foam:stream&)[1] #0 Foam::error::printStack(Foam:stream&) in "/home/vc in "/home/vc/OpenFOAM/OpenFOAM/OpenFOAM-1.5/li/Openb/linuxGccDPOpt/libOpenFOAM.so"
[1] #1 Foam::sigFpe::sigFpeHandler(int)FOAM-1.5/lib/linuxGccDPOpt/libOpenFOAM.so"
[0] #1 Foam::sigFpe::sigFpeHandler(int) in "/home/vc in "/home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libOpenFOAM.so"
[0] #2 Uninterpreted: [0xffffe400]
[0] #3 void Foam::processorLduInterface::compressedSend<double >(Foam::Pstream::commsTypes, Foam::UList<double> const&) const/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libOpenFOAM.so"
[1] #2 Uninterpreted: [0xffffe400]
[1] #3 void Foam::processorLduInterface::compressedSend<double >(Foam::Pstream::commsTypes, Foam::UList<double> const&) const in in "/home/"v/ch/oOme/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDpenFOAM/OpenFOAM-1.5/lib /linuxGccDPOpt/libfiniteVolume.so"
[1] #4 Foam::processorFvPatchField<double>::initEvaluate( Foam::Pstream::commsTypes)POpt /libfiniteVolume.so"
[0] #4 Foam::processorFvPatchField<double>::initEvaluate( Foam::Pstream::commsTypes) in "/home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libfiniteVolume.so"
[1] #5 in "/home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libfiniteVolume.so"
[0] #5 Foam::GeometricField<double,>::GeometricBoundaryFi eld::evaluate()Foam::Geometric Field<double,>::GeometricBoundaryField::evaluate() in " in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[0] #6 /home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[1] #6 Foam::tmp<foam::geometricfield<double,> > Foam::fvc::surfaceIntegrate<double>(Foam::Geometri cField<double,> const&)Foam::tmp<foam::geometricfield<double,> > Foam::fvc::surfaceIntegrate<double>(Foam::Geometri cField<double,> const&) in "/home/vc/OpenFO in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[1] #7 Foam::fv::gaussConvectionScheme<double>::fvcDiv(Fo am::GeometricField<double,> const&, Foam::GeometricField<double,> const&) constAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[0] #7 Foam::fv::gaussConvectionScheme<double>::fvcDiv(Fo am::GeometricField<double,> const&, Foam::GeometricField<double,> const&) const in "/home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libfiniteVolume.so"
[1] #8 in "/home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libfiniteVolume.so"
[0] #8 Foam::tmp<foam::geometricfield<double,> > Foam::fvc::div<double>(Foam::GeometricField<double ,> const&, Foam::GeometricField<double,> const&, Foam::word const&)Foam::tmp<foam::geometricfield<double,> > Foam::fvc::div<double>(Foam::GeometricField<double ,> const&, Foam::GeometricField<double,> const&, Foam::word const&) in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[1] #9 in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[0] #9 Foam::tmp<foam::geometricfield<double,> > Foam::fvc::div<double>(Foam::GeometricField<double ,> const&, Foam::GeometricField<double,> const&)Foam::tmp<foam::geometricfield<double,> > Foam::fvc::div<double>(Foam::GeometricField<double ,> const&, Foam::GeometricField<double,> const&) in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[1] #10 in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[0] #10 Foam::tmp<foam::geometricfield<double,> > Foam::fvc::DDt<double>(Foam::GeometricField<double ,> const&, Foam::GeometricField<double,> const&) in Foam::tmp<foam::geometricfield<double,> > Foam::fvc::DDt<double>(Foam::GeometricField<double ,> const&, Foam::GeometricField<double,> const&)"/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbF oam"
[1] #11 in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurmainbFoam "
[0] #11 in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[1] #12 __libc_start_main in "/lib/libmainc.so.6"
[1] #13 in "/homeFoam::regIOobject::readIfModified()/vc/OpenFOAM/OpenFOAM-1.5/applications/ bin/linuxGccDPOpt/sonicTurbFoam"
[0] #12 __libc_start_main in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[keira:12074] *** Process received signal ***
[keira:12074] Signal: Floating point exception (8)
[keira:12074] Signal code: (-6)
[keira:12074] Failing at address: 0x2f2a
[keira:12074] [ 0] [0xffffe410]
[keira:12074] [ 1] /home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libOpenFOAM.so(_ZN4Foam6sigFpe1 3sigFpeHandlerEi+0x61) [0xb707f841]
[keira:12074] [ 2] [0xffffe400]
[keira:12074] [ 3] /home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libfiniteVolume.so(_ZN4Foam21pr ocessorFvPatchFieldIdE12initEvaluateENS_7Pstream10 commsTypesE+0x73) [0xb7815163]
[keira:12074] [ 4] sonicTurbFoam(_ZN4Foam14GeometricFieldIdNS_12fvPat chFieldENS_7volMeshEE22Geometr icBoundaryField8evaluateEv+0x2b7) [0x8077d17]
[keira:12074] [ 5] sonicTurbFoam(_ZN4Foam3fvc16surfaceIntegrateIdEENS _3tmpINS_14GeometricFieldIT_NS _12fvPatchFieldENS_7volMeshEEEEERKNS3_IS4_NS_13fvs PatchFieldENS_11surfaceMeshEEE +0x2bb) [0x808daab]
[keira:12074] [ 6] /home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libfiniteVolume.so(_ZNK4Foam2fv 21gaussConvectionSchemeIdE6fvcDivERKNS_14Geometric FieldIdNS_13fvsPatchFieldENS_1 1surfaceMeshEEERKNS3_IdNS_12fvPatchFieldENS_7volMe shEEE+0x5b) [0xb791a0fb]
[keira:12074] [ 7] sonicTurbFoam [0x809e51b]
[keira:12074] [ 8] sonicTurbFoam [0x809e6c2]
[keira:12074] [ 9] sonicTurbFoam [0x809e7a3]
[keira:12074] [10] sonicTurbFoam [0x805dd78]
[keira:12074] [11] /lib/libc.so.6(__libc_start_main+0xe5) [0xb6ad35f5]
[keira:12074] [12] sonicTurbFoam(_ZN4Foam11regIOobject14readIfModifie dEv+0x19d) [0x805b4f1]
[keira:12074] *** End of error message ***
in "/lib/libc.so.6"
[0] #13 Foam::regIOobject::readIfModified() in "/home/vc/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/sonicTurbFoam"
[keira:12073] *** Process received signal ***
[keira:12073] Signal: Floating point exception (8)
[keira:12073] Signal code: (-6)
[keira:12073] Failing at address: 0x2f29
[keira:12073] [ 0] [0xffffe410]
[keira:12073] [ 1] /home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libOpenFOAM.so(_ZN4Foam6sigFpe1 3sigFpeHandlerEi+0x61) [0xb70f1841]
[keira:12073] [ 2] [0xffffe400]
[keira:12073] [ 3] /home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libfiniteVolume.so(_ZN4Foam21pr ocessorFvPatchFieldIdE12initEvaluateENS_7Pstream10 commsTypesE+0x73) [0xb7887163]
[keira:12073] [ 4] sonicTurbFoam(_ZN4Foam14GeometricFieldIdNS_12fvPat chFieldENS_7volMeshEE22Geometr icBoundaryField8evaluateEv+0x2b7) [0x8077d17]
[keira:12073] [ 5] sonicTurbFoam(_ZN4Foam3fvc16surfaceIntegrateIdEENS _3tmpINS_14GeometricFieldIT_NS _12fvPatchFieldENS_7volMeshEEEEERKNS3_IS4_NS_13fvs PatchFieldENS_11surfaceMeshEEE +0x2bb) [0x808daab]
[keira:12073] [ 6] /home/vc/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libfiniteVolume.so(_ZNK4Foam2fv 21gaussConvectionSchemeIdE6fvcDivERKNS_14Geometric FieldIdNS_13fvsPatchFieldENS_1 1surfaceMeshEEERKNS3_IdNS_12fvPatchFieldENS_7volMe shEEE+0x5b) [0xb798c0fb]
[keira:12073] [ 7] sonicTurbFoam [0x809e51b]
[keira:12073] [ 8] sonicTurbFoam [0x809e6c2]
[keira:12073] [ 9] sonicTurbFoam [0x809e7a3]
[keira:12073] [10] sonicTurbFoam [0x805dd78]
[keira:12073] [11] /lib/libc.so.6(__libc_start_main+0xe5) [0xb6b455f5]
[keira:12073] [12] sonicTurbFoam(_ZN4Foam11regIOobject14readIfModifie dEv+0x19d) [0x805b4f1]
[keira:12073] *** End of error message ***
mpirun noticed that job rank 0 with PID 12073 on node keira exited on signal 8 (Floating point exception).

[floooo]

Hi Velan,

have you try with another methode of decomposition
in one of my project the simple decomposition does'nt work whereas Metis runs perfectly.

Florian

[wolle1982]

I'm facing the same problems. Try to turn up your nCorrectors an your nonOrthogonalCorrectors in the fvsoulution file. (eg.: n=3, nonOrth=5)

try running, after a while you can turn down.

[velan]

Hi florian,
Thanks for your reply, I tried as you said, but same problem i got after one day .
Now i will try wolfgang approach and let you know about the status

- Velan

[fra76]

Hi Velan,
in my opinion changing nCorrectors and nonOrthogonalCorrectors, in case it works, is not resolving the problem, but hiding another one.
If you are using OF 1.5 (and not a recent 1.5.x) and you are solving in double precision, try to switch off floatTransfer parameter in OpenFOAM-1.5/etc/controlDict
Have a look to this thread for more details: http://www.cfd-online.com/cgi-bin/Op...how.cgi?1/8378

Hope this helps,
Francesco

[velan]

Hi Francesco,

Thanks for your help, i tried wolfgang approach, but found the same problem.

Can you please explain me clearly (as i not able to found the answer in the link) about floatTransfer parameter.

I am using OF 1.5, how can i switch off floatTransfer parameter. Now the value of floatTransfer is 1, can i replace to 0 ?.

If i switch off the floatTransfer, will it cause any numerical error in simulation results.

[fra76]

Hi Velan,
you can simply change its value to 0 and rerun the simulation.
At the beginning of the parallel run you have a resume of the options used.
As far as I know, floatTransfer is a clever way of converting the double precision numbers of a simulation to single precision before sending them over the communication network used, reducing the amount of time spent for exchanging data, especially on a Gigabit network. This has usually a negligible effect in terms of accuracy, but there are cases when it creates problems. It should be set as 0 as default now in the 1.5.x version.
In any case, setting it to 0, i.e. switching it off, is the most accurate setting, in terms of numerical error.

Obviously, this is what I've understood about how it works! If you have a look to the post i linked above, however, there are a few comments of Henry Weller about this feature.

Hope this helps,
Francesco

[prapanj]

Hi Fran,

I am using OpenFoam1.5.x and getting a similar issue. I had upgraded from 1.5 due to this issue. I am using buoyantSimpleFoam and from the error output on screen I see words like therm , h etc. So I had been playing with the solvers and schemes related to h, but with no success. And I would really like to read the post of henry wellers that you mentioned. Unfortunately the link you have provided doesn't have any post from Henry, not does it have anything to do with controlDict, floatTransfer etc. Could you please give us the correct link? Thank you.

Prapanj

[fra76]

Sorry, this should be the correct link to the thread I was referring to:

http://www.cfd-online.com/Forums/ope...llel-runs.html

Francesco