Hisham |
October 15, 2012 12:06 |
Running contactStressFoam in Parallel
Dear Foamers,
I have compiled the contactStressFoam solver on OpenFOAM 2.0.1. The ball and brick tutorial runs OK in serial. However, when I try to run it in parallel (using 4 cpus and scotch) I get the following error running it with valgrind:
Code:
==18787== Memcheck, a memory error detector
==18787== Copyright (C) 2002-2010, and GNU GPL'd, by Julian Seward et al.
==18787== Using Valgrind-3.6.1 and LibVEX; rerun with -h for copyright info
==18787== Command: mpirun -np 4 contactStressFoam -parallel
==18787==
==18787== Syscall param sched_setaffinity(mask) points to unaddressable byte(s)
==18787== at 0x55D65D9: syscall (syscall.S:39)
==18787== by 0x609253B: ??? (in /usr/lib/openmpi/lib/openmpi/mca_paffinity_linux.so)
==18787== by 0x609291C: ??? (in /usr/lib/openmpi/lib/openmpi/mca_paffinity_linux.so)
==18787== by 0x6093439: ??? (in /usr/lib/openmpi/lib/openmpi/mca_paffinity_linux.so)
==18787== by 0x60923AF: ??? (in /usr/lib/openmpi/lib/openmpi/mca_paffinity_linux.so)
==18787== by 0x50B9C5E: opal_paffinity_base_select (in /usr/lib/openmpi/lib/libopen-pal.so.0.0.0)
==18787== by 0x508F866: opal_init (in /usr/lib/openmpi/lib/libopen-pal.so.0.0.0)
==18787== by 0x4E3C9F4: orte_init (in /usr/lib/openmpi/lib/libopen-rte.so.0.0.0)
==18787== by 0x403046: ??? (in /usr/bin/orterun)
==18787== by 0x402BC3: ??? (in /usr/bin/orterun)
==18787== by 0x5510EFE: (below main) (libc-start.c:226)
==18787== Address 0x0 is not stack'd, malloc'd or (recently) free'd
==18787==
/*---------------------------------------------------------------------------*\
| ========= | |
| \\ / F ield | OpenFOAM: The Open Source CFD Toolbox |
| \\ / O peration | Version: 2.0.1 |
| \\ / A nd | Web: www.OpenFOAM.com |
| \\/ M anipulation | |
\*---------------------------------------------------------------------------*/
Build : 2.0.1-cce6c678443c
Exec : contactStressFoam -parallel
Date : Oct 15 2012
Time : 18:03:21
Host : numubuntu-System-Product-Name
PID : 18790
Case : /home/hisham/OpenFOAM/OpenFOAM-1.6-ext/tutorials/stressAnalysis/contactStressFoam/ballAndBrick
nProcs : 4
Slaves :
3
(
numubuntu-System-Product-Name.18791
numubuntu-System-Product-Name.18792
numubuntu-System-Product-Name.18793
)
Pstream initialized with:
floatTransfer : 0
nProcsSimpleSum : 0
commsType : nonBlocking
sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStamp
allowSystemOperations : Allowing user-supplied system call operations
// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time
Create mesh for time = 0
[1] #0 Foam::error::printStack(Foam::Ostream&)[0] #0 Foam::error::printStack(Foam::Ostream&)// using new solver syntax:
U
{
solver PCG;
preconditioner DIC;
tolerance 1e-05;
relTol 0.01;
}
Reading field U
Reading material properties
Normalising E : E/rho
Reading boundary conditions
Reading patchPressure
Normalising patchPressure : patchPressure/rho
Reading patchTraction
Normalising patchTraction : patchTraction/rho
Calculating Lame's coefficients
Plane Strain
mu = 9.79413e+06 Pa/rho
lambda = 1.46912e+07 Pa/rho
Calculating patch traction
Reading contact patch IDs etc.
Creating contact pairs
Calculating displacement field
Iteration: 1
[2] #0 Foam::error::printStack(Foam::Ostream&)[3] #0 Foam::error::printStack(Foam::Ostream&) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[1] #1 Foam::sigSegv::sigHandler(int) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[0] #1 Foam::sigSegv::sigHandler(int) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[3] #1 Foam::sigSegv::sigHandler(int) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[2] #1 Foam::sigSegv::sigHandler(int) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[0] #2 in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[3] #2 [1] #2 in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[2] #2 in "/lib/x86_64-linux-gnu/libc.so.6"
[3] #3 in "/lib/x86_64-linux-gnu/libc.so.6"
[0] #3 in "/lib/x86_64-linux-gnu/libc.so.6"
[1] #3 in "/lib/x86_64-linux-gnu/libc.so.6"
[2] #3
[3] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #4
[0] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[0] #4 [1] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[1] #4
[2] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #4
[0] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[0] #5 [1] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[1] #5
[3] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #5
[2] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #5
[0] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[0] #6 [1] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[1] #6
[3] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #6
[2] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #6
[1] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bi[0] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[0] #7 n/contactStressFoam"
[1] #7
[3] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #7
[2] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #7
[1] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/con[0] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoatactStressFoam"
[1] #8 __libc_start_mainm"
[0] #8 __libc_start_main
in "/lib/x86_64-linux-gnu/libc.so.6"
[1] #9 in "/lib/x86_64-linux-gnu/libc.so.6"
[0] #9 [3] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #8 __libc_start_main[2] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #8 __libc_start_main
in "/lib/x86_64-linux-gnu/libc.so.6"
[3] #9 in "/lib/x86_64-linux-gnu/libc.so.6"
[2] #9 [1] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[numubuntu-System-Product-Name:18791] *** Process received signal ***
[numubuntu-System-Product-Name:18791] Signal: Segmentation fault (11)
[numubuntu-System-Product-Name:18791] Signal code: (-6)
[numubuntu-System-Product-Name:18791] Failing at address: 0x3e900004967
[numubuntu-System-Product-Name:18791] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f38318cfd80]
[numubuntu-System-Product-Name:18791] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f38318cfd05]
[numubuntu-System-Product-Name:18791] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f38318cfd80]
[numubuntu-System-Product-Name:18791] [ 3] contactStressFoam() [0x4241a5]
[numubuntu-System-Product-Name:18791] [ 4] contactStressFoam() [0x4249fa]
[numubuntu-System-Product-Name:18791] [ 5] contactStressFoam() [0x425e92]
[numubuntu-System-Product-Name:18791] [ 6] contactStressFoam() [0x41da07]
[numubuntu-System-Product-Name:18791] [ 7] contactStressFoam() [0x42e92b]
[numubuntu-System-Product-Name:18791] [ 8] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7f38318baeff]
[numubuntu-System-Product-Name:18791] [ 9] contactStressFoam() [0x41cc79]
[numubuntu-System-Product-Name:18791] *** End of error message ***
[0] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[numubuntu-System-Product-Name:18790] *** Process received signal ***
[numubuntu-System-Product-Name:18790] Signal: Segmentation fault (11)
[numubuntu-System-Product-Name:18790] Signal code: (-6)
[numubuntu-System-Product-Name:18790] Failing at address: 0x3e900004966
[numubuntu-System-Product-Name:18790] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7fd76cfc6d80]
[numubuntu-System-Product-Name:18790] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7fd76cfc6d05]
[numubuntu-System-Product-Name:18790] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7fd76cfc6d80]
[numubuntu-System-Product-Name:18790] [ 3] contactStressFoam() [0x4241a5]
[numubuntu-System-Product-Name:18790] [ 4] contactStressFoam() [0x4249fa]
[numubuntu-System-Product-Name:18790] [ 5] contactStressFoam() [0x425e92]
[numubuntu-System-Product-Name:18790] [ 6] contactStressFoam() [0x41da07]
[numubuntu-System-Product-Name:18790] [ 7] contactStressFoam() [0x42e92b]
[numubuntu-System-Product-Name:18790] [ 8] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7fd76cfb1eff]
[numubuntu-System-Product-Name:18790] [ 9] contactStressFoam() [0x41cc79]
[numubuntu-System-Product-Name:18790] *** End of error message ***
[2] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[numubuntu-System-Product-Name:18792] *** Process received signal ***
[numubuntu-System-Product-Name:18792] Signal: Segmentation fault (11)
[numubuntu-System-Product-Name:18792] Signal code: (-6)
[numubuntu-System-Product-Name:18792] Failing at address: 0x3e900004968
[numubuntu-System-Product-Name:18792] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f66112a6d80]
[numubuntu-System-Product-Name:18792] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f66112a6d05]
[numubuntu-System-Product-Name:18792] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f66112a6d80]
[numubuntu-System-Product-Name:18792] [ 3] contactStressFoam() [0x4241a5]
[numubuntu-System-Product-Name:18792] [ 4] contactStressFoam() [0x4249fa]
[numubuntu-System-Product-Name:18792] [ 5] contactStressFoam() [0x425e92]
[numubuntu-System-Product-Name:18792] [ 6] contactStressFoam() [0x41da07]
[numubuntu-System-Product-Name:18792] [ 7] contactStressFoam() [0x42e948]
[numubuntu-System-Product-Name:18792] [ 8] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7f6611291eff]
[numubuntu-System-Product-Name:18792] [ 9] contactStressFoam() [0x41cc79]
[numubuntu-System-Product-Name:18792] *** End of error message ***
[3] in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[numubuntu-System-Product-Name:18793] *** Process received signal ***
[numubuntu-System-Product-Name:18793] Signal: Segmentation fault (11)
[numubuntu-System-Product-Name:18793] Signal code: (-6)
[numubuntu-System-Product-Name:18793] Failing at address: 0x3e900004969
[numubuntu-System-Product-Name:18793] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f184c04ed80]
[numubuntu-System-Product-Name:18793] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f184c04ed05]
[numubuntu-System-Product-Name:18793] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f184c04ed80]
[numubuntu-System-Product-Name:18793] [ 3] contactStressFoam() [0x4241a5]
[numubuntu-System-Product-Name:18793] [ 4] contactStressFoam() [0x4249fa]
[numubuntu-System-Product-Name:18793] [ 5] contactStressFoam() [0x425e92]
[numubuntu-System-Product-Name:18793] [ 6] contactStressFoam() [0x41da07]
[numubuntu-System-Product-Name:18793] [ 7] contactStressFoam() [0x42e948]
[numubuntu-System-Product-Name:18793] [ 8] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7f184c039eff]
[numubuntu-System-Product-Name:18793] [ 9] contactStressFoam() [0x41cc79]
[numubuntu-System-Product-Name:18793] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 1 with PID 18791 on node numubuntu-System-Product-Name exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
2 total processes killed (some possibly by mpirun during cleanup)
==18787==
==18787== HEAP SUMMARY:
==18787== in use at exit: 266,137 bytes in 1,614 blocks
==18787== total heap usage: 10,283 allocs, 8,669 frees, 15,766,629 bytes allocated
==18787==
==18787== LEAK SUMMARY:
==18787== definitely lost: 34,567 bytes in 73 blocks
==18787== indirectly lost: 2,716 bytes in 64 blocks
==18787== possibly lost: 0 bytes in 0 blocks
==18787== still reachable: 228,854 bytes in 1,477 blocks
==18787== suppressed: 0 bytes in 0 blocks
==18787== Rerun with --leak-check=full to see details of leaked memory
==18787==
==18787== For counts of detected and suppressed errors, rerun with: -v
==18787== ERROR SUMMARY: 1 errors from 1 contexts (suppressed: 4 from 4)
I appreciate any help!
Edit: The solver does not execute in parallel when compiled in an OpenFOAM-1.6-ext environment as well. It reports the same error.
Best regards,
Hisham
|