CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Running, Solving & CFD

[foam-extend 4.1] dynamicTopoFvMesh fails to run in parallel

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   March 27, 2022, 07:16
Question [foam-extend 4.1] dynamicTopoFvMesh fails to run in parallel
  #1
New Member
 
Pengcheng Zhang
Join Date: Aug 2021
Posts: 12
Rep Power: 2
Zane is on a distinguished road
Hi Foamers,


I'm using dynamicTopoFvMesh with mesquite(motion solver) in [foam-extend 4.1] to realize dynamic mesh with topo change.

I choose the two tutorials named "circCylinder3d" and "Balltranslation" to test. They both run well in serial, however, in parallel they both crash at the first time step.

From serial to parallel, All I did was the following:
1. Getting a decomposeParDict(using method scotch).
2. Running decomposePar.
3. Running moveDynamicMesh with mpirun.

My cases and logs are attached.

I don't know if I made a mistake or it is a bug.


Does anyone have the same problem with me?
Any suggestions would be greatly appreciated!

Best regard,
Zane

----------------------------------------------------------------------------------

Quote:
Part of ERROR:
[DESKTOP-IT4S0I8:03194] *** Process received signal ***
[DESKTOP-IT4S0I8:03194] Signal: Segmentation fault (11)
[DESKTOP-IT4S0I8:03194] Signal code: (-6)
[DESKTOP-IT4S0I8:03194] Failing at address: 0x3e800000c7a
...
[DESKTOP-IT4S0I8:03196] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x3ef10)[0x7fcf35d8ef10]
[DESKTOP-IT4S0I8:03196] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7)[0x7fcf35d8ee87]
[DESKTOP-IT4S0I8:03196] [ 2] [DESKTOP-IT4S0I8:03194] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x3ef10)[0x7f57a2263f10]
...
[DESKTOP-IT4S0I8:03194] [ 3] /home/zane/foam/foam-extend-4.1/lib/linux64GccDPInt32Opt/libfoam.so(_ZN4Foam8polyMesh15resetPrimitivesERKNS _4XferINS_5FieldINS_6VectorIdEEEEEERKNS1_INS_4List INS_4faceEEEEERKNS1_INS9_IiEEEESI_RKSF_SK_b+0xfb)[0x7f9e9188052b]
[DESKTOP-IT4S0I8:03193] [ 4] /home/zane/foam/foam-extend-4.1/lib/linux64GccDPInt32Opt/libdynamicTopoFvMesh.so(_ZN4Foam17dynamicTopoFvMes h20moveCoupledSubMeshesEv+0x5bc)[0x7f9e6ecf09fc]
Attached Files
File Type: gz circCylinder3d.tar.gz (168.7 KB, 0 views)
File Type: txt log.moveDynamicMesh_parl.txt (9.2 KB, 0 views)
File Type: txt dynamicMeshDict.txt (5.6 KB, 0 views)
File Type: txt decomposeParDict.txt (1.0 KB, 0 views)
Zane is offline   Reply With Quote

Old   April 10, 2022, 07:48
Default
  #2
New Member
 
Pengcheng Zhang
Join Date: Aug 2021
Posts: 12
Rep Power: 2
Zane is on a distinguished road
Can anyone help me, please?

Thanks in adavance.
Zane is offline   Reply With Quote

Old   April 10, 2022, 08:18
Default
  #3
Senior Member
 
Join Date: Sep 2013
Posts: 329
Rep Power: 17
Bloerb will become famous soon enough
Topology changes aren't easily parallelized. If you have topology changes on the boundary between processors the solver won't know what it should couple to. Or if you delete all cells on a processor it can't solve anything anymore. I am uncertain about foam extend, but the topology changing solvers inside openfoam in general do not like that. Tools like load balancing and so on exist, but in all likely-hood you have to integrate those yourself and the solvers won't use those out of the box. The easiest way is to make sure that all your topology changes are happening inside the processor domain and that you do not delete to much of the processors cells.
Bloerb is offline   Reply With Quote

Old   April 12, 2022, 06:20
Default
  #4
New Member
 
Pengcheng Zhang
Join Date: Aug 2021
Posts: 12
Rep Power: 2
Zane is on a distinguished road
Hi Bloerb,

First, thanks to your kind reply!

You're right. Changing topology in parallel is complicated, but I think dynamicTopoFvMesh in foam-extend is capable of doing that. Because when I checked the code of dynamicTopoFvMesh, I saw some words like "in parallel", "multiThread" and "loadBalancing". Therefore, I just copied a tutorials using dynamicTopoFvMesh and ran it in parallel, but somehow I failed (it crashed in the very beginning).

Quote:
Originally Posted by Bloerb View Post
Tools like load balancing and so on exist, but in all likely-hood you have to integrate those yourself and the solvers won't use those out of the box. The easiest way is to make sure that all your topology changes are happening inside the processor domain and that you do not delete to much of the processors cells.
Do you mean decomposing manually to make sure processor boundaries do not intersect with the topoChanging domain? That is a good idea. However, as far as I know, dynamicTopoFvMesh is applied to global mesh. In other words, topoChanging could happen anywhere. It is very difficult to realize what you mean, so I am stuck again. Thank you all the same.

Best regard.
Zane is offline   Reply With Quote

Old   April 18, 2022, 17:13
Default
  #5
Senior Member
 
Sandeep Menon
Join Date: Mar 2009
Location: Amherst, MA
Posts: 403
Rep Power: 23
deepsterblue will become famous soon enough
I haven't maintained this code for years now, so it's quite likely that recent changes in the foam-extend code have caused things to go awry. If you're willing to revert to OpenFOAM-2.3.x (the last maintained version that I know worked in parallel), you're welcome to try the Port-2.3.x branch on github.com/smenon. Unfortunately, I don't have the time to keep up with recent API changes an maintain it for newer versions.
__________________
Sandeep Menon
University of Massachusetts Amherst
https://github.com/smenon
deepsterblue is offline   Reply With Quote

Old   April 20, 2022, 03:02
Default
  #6
New Member
 
Pengcheng Zhang
Join Date: Aug 2021
Posts: 12
Rep Power: 2
Zane is on a distinguished road
Hi Sandeep,

Thank you very much for your reply and your code implementation.

I will try dynamicTopoFvMesh in OpenFOAM-2.3.x in the near future. If I succeed, I will reply in this thread later.
Zane is offline   Reply With Quote

Reply

Tags
dynamictopofvmesh, foam-extend, parallel

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
OpenFOAM benchmarks on various hardware eric Hardware 545 Today 06:32
parallel run error cma-permission-denied supvato OpenFOAM Running, Solving & CFD 2 May 14, 2022 13:42
[mesh manipulation] Importing Multiple Meshes thomasnwalshiii OpenFOAM Meshing & Mesh Conversion 18 December 19, 2015 18:57
Explicitly filtered LES saeedi Main CFD Forum 16 October 14, 2015 11:58
[mesh manipulation] Cannot get refineMesh to run in parallel smschnob OpenFOAM Meshing & Mesh Conversion 2 June 3, 2014 11:20


All times are GMT -4. The time now is 12:57.