CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Running, Solving & CFD

Running contactStressFoam in Parallel

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   October 15, 2012, 12:06
Default Running contactStressFoam in Parallel
  #1
Senior Member
 
Hisham's Avatar
 
Hisham El Safti
Join Date: Apr 2011
Location: Braunschweig, Germany
Posts: 247
Blog Entries: 10
Rep Power: 7
Hisham is on a distinguished road
Dear Foamers,

I have compiled the contactStressFoam solver on OpenFOAM 2.0.1. The ball and brick tutorial runs OK in serial. However, when I try to run it in parallel (using 4 cpus and scotch) I get the following error running it with valgrind:

Code:
==18787== Memcheck, a memory error detector
==18787== Copyright (C) 2002-2010, and GNU GPL'd, by Julian Seward et al.
==18787== Using Valgrind-3.6.1 and LibVEX; rerun with -h for copyright info
==18787== Command: mpirun -np 4 contactStressFoam -parallel
==18787== 
==18787== Syscall param sched_setaffinity(mask) points to unaddressable byte(s)
==18787==    at 0x55D65D9: syscall (syscall.S:39)
==18787==    by 0x609253B: ??? (in /usr/lib/openmpi/lib/openmpi/mca_paffinity_linux.so)
==18787==    by 0x609291C: ??? (in /usr/lib/openmpi/lib/openmpi/mca_paffinity_linux.so)
==18787==    by 0x6093439: ??? (in /usr/lib/openmpi/lib/openmpi/mca_paffinity_linux.so)
==18787==    by 0x60923AF: ??? (in /usr/lib/openmpi/lib/openmpi/mca_paffinity_linux.so)
==18787==    by 0x50B9C5E: opal_paffinity_base_select (in /usr/lib/openmpi/lib/libopen-pal.so.0.0.0)
==18787==    by 0x508F866: opal_init (in /usr/lib/openmpi/lib/libopen-pal.so.0.0.0)
==18787==    by 0x4E3C9F4: orte_init (in /usr/lib/openmpi/lib/libopen-rte.so.0.0.0)
==18787==    by 0x403046: ??? (in /usr/bin/orterun)
==18787==    by 0x402BC3: ??? (in /usr/bin/orterun)
==18787==    by 0x5510EFE: (below main) (libc-start.c:226)
==18787==  Address 0x0 is not stack'd, malloc'd or (recently) free'd
==18787== 
/*---------------------------------------------------------------------------*\
| =========                 |                                                 |
| \\      /  F ield         | OpenFOAM: The Open Source CFD Toolbox           |
|  \\    /   O peration     | Version:  2.0.1                                 |
|   \\  /    A nd           | Web:      www.OpenFOAM.com                      |
|    \\/     M anipulation  |                                                 |
\*---------------------------------------------------------------------------*/
Build  : 2.0.1-cce6c678443c
Exec   : contactStressFoam -parallel
Date   : Oct 15 2012
Time   : 18:03:21
Host   : numubuntu-System-Product-Name
PID    : 18790
Case   : /home/hisham/OpenFOAM/OpenFOAM-1.6-ext/tutorials/stressAnalysis/contactStressFoam/ballAndBrick
nProcs : 4
Slaves : 
3
(
numubuntu-System-Product-Name.18791
numubuntu-System-Product-Name.18792
numubuntu-System-Product-Name.18793
)

Pstream initialized with:
    floatTransfer     : 0
    nProcsSimpleSum   : 0
    commsType         : nonBlocking
sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStamp
allowSystemOperations : Allowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time

Create mesh for time = 0

[1] #0  Foam::error::printStack(Foam::Ostream&)[0] #0  Foam::error::printStack(Foam::Ostream&)// using new solver syntax:
U
{
    solver          PCG;
    preconditioner  DIC;
    tolerance       1e-05;
    relTol          0.01;
}

Reading field U

Reading material properties

Normalising E : E/rho

Reading boundary conditions

Reading patchPressure

Normalising patchPressure : patchPressure/rho

Reading patchTraction

Normalising patchTraction : patchTraction/rho

Calculating Lame's coefficients

Plane Strain

mu = 9.79413e+06 Pa/rho
lambda = 1.46912e+07 Pa/rho
Calculating patch traction
Reading contact patch IDs etc.

Creating contact pairs

Calculating displacement field

Iteration: 1

[2] #0  Foam::error::printStack(Foam::Ostream&)[3] #0  Foam::error::printStack(Foam::Ostream&) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[1] #1  Foam::sigSegv::sigHandler(int) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[0] #1  Foam::sigSegv::sigHandler(int) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[3] #1  Foam::sigSegv::sigHandler(int) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[2] #1  Foam::sigSegv::sigHandler(int) in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[0] #2   in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
 in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[3] #2  [1] #2   in "/opt/openfoam201/platforms/linux64GccDPOpt/lib/libOpenFOAM.so"
[2] #2   in "/lib/x86_64-linux-gnu/libc.so.6"
[3] #3   in "/lib/x86_64-linux-gnu/libc.so.6"
[0] #3   in "/lib/x86_64-linux-gnu/libc.so.6"
[1] #3   in "/lib/x86_64-linux-gnu/libc.so.6"
[2] #3  


[3]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #4  
[0]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[0] #4  [1]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[1] #4  

[2]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #4  
[0]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[0] #5  [1]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[1] #5  
[3]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #5  

[2]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #5  
[0]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[0] #6  [1]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[1] #6  
[3]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #6  

[2]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #6  
[1]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bi[0]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[0] #7  n/contactStressFoam"
[1] #7  
[3]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"

[3] #7  
[2]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #7  
[1]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/con[0]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoatactStressFoam"
[1] #8  __libc_start_mainm"
[0] #8  __libc_start_main
 in "/lib/x86_64-linux-gnu/libc.so.6"
[1] #9   in "/lib/x86_64-linux-gnu/libc.so.6"
[0] #9  [3]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[3] #8  __libc_start_main[2]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[2] #8  __libc_start_main

 in "/lib/x86_64-linux-gnu/libc.so.6"
[3] #9   in "/lib/x86_64-linux-gnu/libc.so.6"
[2] #9  [1]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[numubuntu-System-Product-Name:18791] *** Process received signal ***
[numubuntu-System-Product-Name:18791] Signal: Segmentation fault (11)
[numubuntu-System-Product-Name:18791] Signal code:  (-6)
[numubuntu-System-Product-Name:18791] Failing at address: 0x3e900004967
[numubuntu-System-Product-Name:18791] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f38318cfd80]
[numubuntu-System-Product-Name:18791] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f38318cfd05]
[numubuntu-System-Product-Name:18791] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f38318cfd80]
[numubuntu-System-Product-Name:18791] [ 3] contactStressFoam() [0x4241a5]
[numubuntu-System-Product-Name:18791] [ 4] contactStressFoam() [0x4249fa]
[numubuntu-System-Product-Name:18791] [ 5] contactStressFoam() [0x425e92]
[numubuntu-System-Product-Name:18791] [ 6] contactStressFoam() [0x41da07]
[numubuntu-System-Product-Name:18791] [ 7] contactStressFoam() [0x42e92b]
[numubuntu-System-Product-Name:18791] [ 8] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7f38318baeff]
[numubuntu-System-Product-Name:18791] [ 9] contactStressFoam() [0x41cc79]
[numubuntu-System-Product-Name:18791] *** End of error message ***

[0]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[numubuntu-System-Product-Name:18790] *** Process received signal ***
[numubuntu-System-Product-Name:18790] Signal: Segmentation fault (11)
[numubuntu-System-Product-Name:18790] Signal code:  (-6)
[numubuntu-System-Product-Name:18790] Failing at address: 0x3e900004966
[numubuntu-System-Product-Name:18790] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7fd76cfc6d80]
[numubuntu-System-Product-Name:18790] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7fd76cfc6d05]
[numubuntu-System-Product-Name:18790] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7fd76cfc6d80]
[numubuntu-System-Product-Name:18790] [ 3] contactStressFoam() [0x4241a5]
[numubuntu-System-Product-Name:18790] [ 4] contactStressFoam() [0x4249fa]
[numubuntu-System-Product-Name:18790] [ 5] contactStressFoam() [0x425e92]
[numubuntu-System-Product-Name:18790] [ 6] contactStressFoam() [0x41da07]
[numubuntu-System-Product-Name:18790] [ 7] contactStressFoam() [0x42e92b]
[numubuntu-System-Product-Name:18790] [ 8] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7fd76cfb1eff]
[numubuntu-System-Product-Name:18790] [ 9] contactStressFoam() [0x41cc79]
[numubuntu-System-Product-Name:18790] *** End of error message ***

[2]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[numubuntu-System-Product-Name:18792] *** Process received signal ***
[numubuntu-System-Product-Name:18792] Signal: Segmentation fault (11)
[numubuntu-System-Product-Name:18792] Signal code:  (-6)
[numubuntu-System-Product-Name:18792] Failing at address: 0x3e900004968
[numubuntu-System-Product-Name:18792] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f66112a6d80]
[numubuntu-System-Product-Name:18792] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f66112a6d05]
[numubuntu-System-Product-Name:18792] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f66112a6d80]
[numubuntu-System-Product-Name:18792] [ 3] contactStressFoam() [0x4241a5]
[numubuntu-System-Product-Name:18792] [ 4] contactStressFoam() [0x4249fa]
[numubuntu-System-Product-Name:18792] [ 5] contactStressFoam() [0x425e92]
[numubuntu-System-Product-Name:18792] [ 6] contactStressFoam() [0x41da07]
[numubuntu-System-Product-Name:18792] [ 7] contactStressFoam() [0x42e948]
[numubuntu-System-Product-Name:18792] [ 8] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7f6611291eff]
[numubuntu-System-Product-Name:18792] [ 9] contactStressFoam() [0x41cc79]
[numubuntu-System-Product-Name:18792] *** End of error message ***
[3]  in "/home/hisham/OpenFOAM/hisham-2.0.1/platforms/linux64GccDPOpt/bin/contactStressFoam"
[numubuntu-System-Product-Name:18793] *** Process received signal ***
[numubuntu-System-Product-Name:18793] Signal: Segmentation fault (11)
[numubuntu-System-Product-Name:18793] Signal code:  (-6)
[numubuntu-System-Product-Name:18793] Failing at address: 0x3e900004969
[numubuntu-System-Product-Name:18793] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f184c04ed80]
[numubuntu-System-Product-Name:18793] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f184c04ed05]
[numubuntu-System-Product-Name:18793] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x33d80) [0x7f184c04ed80]
[numubuntu-System-Product-Name:18793] [ 3] contactStressFoam() [0x4241a5]
[numubuntu-System-Product-Name:18793] [ 4] contactStressFoam() [0x4249fa]
[numubuntu-System-Product-Name:18793] [ 5] contactStressFoam() [0x425e92]
[numubuntu-System-Product-Name:18793] [ 6] contactStressFoam() [0x41da07]
[numubuntu-System-Product-Name:18793] [ 7] contactStressFoam() [0x42e948]
[numubuntu-System-Product-Name:18793] [ 8] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7f184c039eff]
[numubuntu-System-Product-Name:18793] [ 9] contactStressFoam() [0x41cc79]
[numubuntu-System-Product-Name:18793] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 1 with PID 18791 on node numubuntu-System-Product-Name exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
2 total processes killed (some possibly by mpirun during cleanup)
==18787== 
==18787== HEAP SUMMARY:
==18787==     in use at exit: 266,137 bytes in 1,614 blocks
==18787==   total heap usage: 10,283 allocs, 8,669 frees, 15,766,629 bytes allocated
==18787== 
==18787== LEAK SUMMARY:
==18787==    definitely lost: 34,567 bytes in 73 blocks
==18787==    indirectly lost: 2,716 bytes in 64 blocks
==18787==      possibly lost: 0 bytes in 0 blocks
==18787==    still reachable: 228,854 bytes in 1,477 blocks
==18787==         suppressed: 0 bytes in 0 blocks
==18787== Rerun with --leak-check=full to see details of leaked memory
==18787== 
==18787== For counts of detected and suppressed errors, rerun with: -v
==18787== ERROR SUMMARY: 1 errors from 1 contexts (suppressed: 4 from 4)

I appreciate any help!

Edit: The solver does not execute in parallel when compiled in an OpenFOAM-1.6-ext environment as well. It reports the same error.

Best regards,
Hisham

Last edited by Hisham; October 16, 2012 at 10:06. Reason: Additional Info
Hisham is offline   Reply With Quote

Old   October 16, 2012, 10:27
Default
  #2
Senior Member
 
bigphil's Avatar
 
Philip Cardiff
Join Date: Mar 2009
Location: Dublin,Ireland
Posts: 538
Rep Power: 17
bigphil will become famous soon enough
Hi Hisham,

This solver has not been developed for parallel simulation. In fact, this solver does not work in serial (there are a couple of mistakes in the procedure).

The solver elasticContactSolidFoam (found in the solidMechanics branch of OpenFOAM-1.6-ext) runs in parallel by employing special procedures in combination with globalFaceZones.

Best regards,
Philip
bigphil is offline   Reply With Quote

Old   October 16, 2012, 10:34
Default
  #3
Senior Member
 
Hisham's Avatar
 
Hisham El Safti
Join Date: Apr 2011
Location: Braunschweig, Germany
Posts: 247
Blog Entries: 10
Rep Power: 7
Hisham is on a distinguished road
Quote:
Originally Posted by bigphil View Post
Hi Hisham,

This solver has not been developed for parallel simulation. In fact, this solver does not work in serial (there are a couple of mistakes in the procedure).

The solver elasticContactSolidFoam (found in the solidMechanics branch of OpenFOAM-1.6-ext) runs in parallel by employing special procedures in combination with globalFaceZones.

Best regards,
Philip
Thanks a lot Philip ... It is wonderful what you have done ... Respect to you, sir
Hisham is offline   Reply With Quote

Reply

Tags
contact, contactstressfoam, newcontactstressfoam, openfoam, stress analysis

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
running OpenFoam in parallel vishwa OpenFOAM 20 November 7, 2012 15:33
Problems running in parallel - missing controlDict Argen OpenFOAM Running, Solving & CFD 4 June 7, 2012 03:50
error while running in parallel using openmpi on local mc 6 processors suryawanshi_nitin OpenFOAM 5 May 21, 2012 14:13
Running mapFields with Parallel Source and Parallel Target RDanks OpenFOAM Mesh Utilities 2 June 6, 2011 07:56
Running in parallel crashed zhajingjing OpenFOAM 4 September 15, 2010 07:12


All times are GMT -4. The time now is 01:57.