overset decompose problem

daron · April 15, 2019, 14:09

hello

I faced some problem when I run overset mesh in parallel. It has not appeared when I run serial. I am sharing part of the log file.

Serial :

Courant Number mean: 0.00121288 max: 0.502868
deltaT = 1.75879e-06
Time = 0.000014

GAMG: Solving for yPsi, Initial residual = 0.000260796, Final residual = 1.91064e-10, No Iterations 1
inverseDistance : detected 3 mesh regions
zone:0 nCells:1292958 voxels

148 148 148) bb (-19.5001 -6.50008 -13.0001) (45.5001 19.5001 26.0001)
zone:1 nCells:425058 voxels

148 148 148) bb (0.649994 -0.65001 0.77999) (5.20003 1.95001 3.38002)
zone:2 nCells:1524013 voxels

148 148 148) bb (-1.30002 -1.30002 -1.30004) (6.50006 2.60001 6.50002)
Overset analysis : nCells : 3242029
calculated : 3165603
interpolated : 32353 (interpolated from local:32353 mixed local/remote:0 remote:0)
hole : 44073

GAMG: Solving for pcorr, Initial residual = 1, Final residual = 9.14158e-07, No Iterations 1
GAMG: Solving for pcorr, Initial residual = 0.00148492, Final residual = 1.23804e-09, No Iterations 1
GAMG: Solving for pcorr, Initial residual = 0.000273814, Final residual = 2.30215e-10, No Iterations 1
GAMG: Solving for rho, Initial residual = 1.8292e-05, Final residual = 2.28631e-14, No Iterations 1
rhoEqn max/min : 2.29631 0.449226
PIMPLE: iteration 1
DILUPBiCGStab: Solving for Ux, Initial residual = 4.47217e-07, Final residual = 4.47217e-07, No Iterations 0
DILUPBiCGStab: Solving for Uy, Initial residual = 0.00169997, Final residual = 1.82087e-09, No Iterations 1
DILUPBiCGStab: Solving for Uz, Initial residual = 3.14376e-06, Final residual = 3.56543e-09, No Iterations 1
DILUPBiCGStab: Solving for e, Initial residual = 5.46042e-06, Final residual = 7.42468e-09, No Iterations 1
GAMG: Solving for p, Initial residual = 7.89309e-06, Final residual = 1.93076e-13, No Iterations 1
GAMG: Solving for p, Initial residual = 1.14139e-08, Final residual = 1.14139e-08, No Iterations 0
GAMG: Solving for p, Initial residual = 1.14139e-08, Final residual = 1.14139e-08, No Iterations 0
GAMG: Solving for rho, Initial residual = 2.22368e-05, Final residual = 2.00998e-14, No Iterations 1
time step continuity errors : sum local = 5.27835e-10, global = -2.87996e-10, cumulative = -7.49365e-06
rho max/min : 2 0.5
PIMPLE: iteration 2
DILUPBiCGStab: Solving for Ux, Initial residual = 3.24208e-08, Final residual = 3.24208e-08, No Iterations 0
DILUPBiCGStab: Solving for Uy, Initial residual = 2.60198e-05, Final residual = 2.86554e-08, No Iterations 1
DILUPBiCGStab: Solving for Uz, Initial residual = 8.4792e-08, Final residual = 8.4792e-08, No Iterations 0
DILUPBiCGStab: Solving for e, Initial residual = 4.72788e-06, Final residual = 4.15527e-09, No Iterations 1
GAMG: Solving for p, Initial residual = 1.72731e-06, Final residual = 1.10266e-13, No Iterations 1
GAMG: Solving for p, Initial residual = 4.71422e-09, Final residual = 4.71422e-09, No Iterations 0
GAMG: Solving for p, Initial residual = 4.71422e-09, Final residual = 4.71422e-09, No Iterations 0
GAMG: Solving for rho, Initial residual = 8.08318e-06, Final residual = 3.58713e-14, No Iterations 1
time step continuity errors : sum local = 4.96232e-10, global = -2.98507e-10, cumulative = -7.49394e-06
rho max/min : 2 0.5
DILUPBiCGStab: Solving for omega, Initial residual = 0.245689, Final residual = 8.96029e-08, No Iterations 1
bounding omega, min: -6293.07 max: 480000 average: 276022
DILUPBiCGStab: Solving for k, Initial residual = 0.237053, Final residual = 8.64984e-08, No Iterations 1
PIMPLE: converged in 2 iterations
ExecutionTime = 900.04 s ClockTime = 900 s

Paralell :

Courant Number mean: 0.00121259 max: 0.500232
deltaT = 1.76778e-06
Time = 0.0001200

GAMG: Solving for yPsi, Initial residual = 0.000143923, Final residual = 1.39577e-10, No Iterations 1
inverseDistance : detected 3 mesh regions
zone:0 nCells:1292958 voxels

17 17 17) bb

-149.5 -58.5001 -91.0001) (-84.4999 -32.4999 -51.9999)
zone:1 nCells:425058 voxels

17 17 17) bb

-149.5 -58.5001 -91.0001) (-84.4999 -32.4999 -51.9999)
zone:2 nCells:1524013 voxels

17 17 17) bb

4.63107 -0.389524 -0.39054) (5.20016 0.519058 0.276258)
Overset analysis : nCells : 3242029
calculated : 3170494
interpolated : 31228 (interpolated from local:0 mixed local/remote 0 remote:31228)
hole : 40307

GAMG: Solving for pcorr, Initial residual = 1, Final residual = 8.28641e-08, No Iterations 1
GAMG: Solving for pcorr, Initial residual = 3.89681e-08, Final residual = 3.89681e-08, No Iterations 0
GAMG: Solving for pcorr, Initial residual = 3.89681e-08, Final residual = 3.89681e-08, No Iterations 0
GAMG: Solving for rho, Initial residual = 1.40776e-05, Final residual = 1.80395e-13, No Iterations 1
rhoEqn max/min : 2.06166 0.495558
PIMPLE: iteration 1
DILUPBiCGStab: Solving for Ux, Initial residual = 2.98633e-07, Final residual = 2.98633e-07, No Iterations 0
DILUPBiCGStab: Solving for Uy, Initial residual = 0.000207149, Final residual = 7.08924e-07, No Iterations 1
DILUPBiCGStab: Solving for Uz, Initial residual = 9.51457e-07, Final residual = 9.51457e-07, No Iterations 0
DILUPBiCGStab: Solving for e, Initial residual = 2.53483e-06, Final residual = 5.16154e-09, No Iterations 1
GAMG: Solving for p, Initial residual = 6.82611e-06, Final residual = 6.35264e-12, No Iterations 1
GAMG: Solving for p, Initial residual = 8.21936e-10, Final residual = 8.21936e-10, No Iterations 0
GAMG: Solving for p, Initial residual = 8.21936e-10, Final residual = 8.21936e-10, No Iterations 0
GAMG: Solving for rho, Initial residual = 1.9906e-05, Final residual = 1.98631e-13, No Iterations 1
time step continuity errors : sum local = 5.012e-09, global = 6.01237e-10, cumulative = -7.55715e-06
rho max/min : 2 0.5
PIMPLE: iteration 2
DILUPBiCGStab: Solving for Ux, Initial residual = 1.08868e-08, Final residual = 1.08868e-08, No Iterations 0
DILUPBiCGStab: Solving for Uy, Initial residual = 8.90283e-07, Final residual = 8.90283e-07, No Iterations 0
DILUPBiCGStab: Solving for Uz, Initial residual = 3.74944e-08, Final residual = 3.74944e-08, No Iterations 0
DILUPBiCGStab: Solving for e, Initial residual = 1.55754e-06, Final residual = 3.00801e-09, No Iterations 1
GAMG: Solving for p, Initial residual = 1.31285e-06, Final residual = 1.25254e-12, No Iterations 1
GAMG: Solving for p, Initial residual = 4.26434e-10, Final residual = 4.26434e-10, No Iterations 0
GAMG: Solving for p, Initial residual = 4.26434e-10, Final residual = 4.26434e-10, No Iterations 0
GAMG: Solving for rho, Initial residual = 3.59682e-06, Final residual = 1.76856e-13, No Iterations 1
time step continuity errors : sum local = 3.933e-09, global = -1.76874e-09, cumulative = -7.55892e-06
rho max/min : 2 0.5
DILUPBiCGStab: Solving for omega, Initial residual = 0.366482, Final residual = 1.67301e-08, No Iterations 1
DILUPBiCGStab: Solving for k, Initial residual = 0.00849793, Final residual = 6.06598e-11, No Iterations 1
PIMPLE: converged in 2 iterations
ExecutionTime = 589.94 s ClockTime = 593 s

As you can see when I run case in the serial overset mesh can interpolate, but when I run in the parallel overset mesh cannot interpolate.

Meantime, I use scotch decomposition method and 560 core with the overRhoPimpleDyMFoam solver. As it can be guessed I use OpenFOAM+ and version 1712

Could anyone please give me some advice about this error?

courant_numero_uno · February 10, 2020, 10:04

I have heard that the hierarchical decomposition is better suited for overset mesh in parallel. Just a suggestion, I know this thread is old.

April 15, 2019, 14:09	overset decompose problem	#1
daron New Member daron ciyakian Join Date: Dec 2016 Posts: 7 Rep Power: 9	hello I faced some problem when I run overset mesh in parallel. It has not appeared when I run serial. I am sharing part of the log file. Serial : Courant Number mean: 0.00121288 max: 0.502868 deltaT = 1.75879e-06 Time = 0.000014 GAMG: Solving for yPsi, Initial residual = 0.000260796, Final residual = 1.91064e-10, No Iterations 1 inverseDistance : detected 3 mesh regions zone:0 nCells:1292958 voxels148 148 148) bb (-19.5001 -6.50008 -13.0001) (45.5001 19.5001 26.0001) zone:1 nCells:425058 voxels148 148 148) bb (0.649994 -0.65001 0.77999) (5.20003 1.95001 3.38002) zone:2 nCells:1524013 voxels148 148 148) bb (-1.30002 -1.30002 -1.30004) (6.50006 2.60001 6.50002) Overset analysis : nCells : 3242029 calculated : 3165603 interpolated : 32353 (interpolated from local:32353 mixed local/remote:0 remote:0) hole : 44073 GAMG: Solving for pcorr, Initial residual = 1, Final residual = 9.14158e-07, No Iterations 1 GAMG: Solving for pcorr, Initial residual = 0.00148492, Final residual = 1.23804e-09, No Iterations 1 GAMG: Solving for pcorr, Initial residual = 0.000273814, Final residual = 2.30215e-10, No Iterations 1 GAMG: Solving for rho, Initial residual = 1.8292e-05, Final residual = 2.28631e-14, No Iterations 1 rhoEqn max/min : 2.29631 0.449226 PIMPLE: iteration 1 DILUPBiCGStab: Solving for Ux, Initial residual = 4.47217e-07, Final residual = 4.47217e-07, No Iterations 0 DILUPBiCGStab: Solving for Uy, Initial residual = 0.00169997, Final residual = 1.82087e-09, No Iterations 1 DILUPBiCGStab: Solving for Uz, Initial residual = 3.14376e-06, Final residual = 3.56543e-09, No Iterations 1 DILUPBiCGStab: Solving for e, Initial residual = 5.46042e-06, Final residual = 7.42468e-09, No Iterations 1 GAMG: Solving for p, Initial residual = 7.89309e-06, Final residual = 1.93076e-13, No Iterations 1 GAMG: Solving for p, Initial residual = 1.14139e-08, Final residual = 1.14139e-08, No Iterations 0 GAMG: Solving for p, Initial residual = 1.14139e-08, Final residual = 1.14139e-08, No Iterations 0 GAMG: Solving for rho, Initial residual = 2.22368e-05, Final residual = 2.00998e-14, No Iterations 1 time step continuity errors : sum local = 5.27835e-10, global = -2.87996e-10, cumulative = -7.49365e-06 rho max/min : 2 0.5 PIMPLE: iteration 2 DILUPBiCGStab: Solving for Ux, Initial residual = 3.24208e-08, Final residual = 3.24208e-08, No Iterations 0 DILUPBiCGStab: Solving for Uy, Initial residual = 2.60198e-05, Final residual = 2.86554e-08, No Iterations 1 DILUPBiCGStab: Solving for Uz, Initial residual = 8.4792e-08, Final residual = 8.4792e-08, No Iterations 0 DILUPBiCGStab: Solving for e, Initial residual = 4.72788e-06, Final residual = 4.15527e-09, No Iterations 1 GAMG: Solving for p, Initial residual = 1.72731e-06, Final residual = 1.10266e-13, No Iterations 1 GAMG: Solving for p, Initial residual = 4.71422e-09, Final residual = 4.71422e-09, No Iterations 0 GAMG: Solving for p, Initial residual = 4.71422e-09, Final residual = 4.71422e-09, No Iterations 0 GAMG: Solving for rho, Initial residual = 8.08318e-06, Final residual = 3.58713e-14, No Iterations 1 time step continuity errors : sum local = 4.96232e-10, global = -2.98507e-10, cumulative = -7.49394e-06 rho max/min : 2 0.5 DILUPBiCGStab: Solving for omega, Initial residual = 0.245689, Final residual = 8.96029e-08, No Iterations 1 bounding omega, min: -6293.07 max: 480000 average: 276022 DILUPBiCGStab: Solving for k, Initial residual = 0.237053, Final residual = 8.64984e-08, No Iterations 1 PIMPLE: converged in 2 iterations ExecutionTime = 900.04 s ClockTime = 900 s Paralell : Courant Number mean: 0.00121259 max: 0.500232 deltaT = 1.76778e-06 Time = 0.0001200 GAMG: Solving for yPsi, Initial residual = 0.000143923, Final residual = 1.39577e-10, No Iterations 1 inverseDistance : detected 3 mesh regions zone:0 nCells:1292958 voxels17 17 17) bb-149.5 -58.5001 -91.0001) (-84.4999 -32.4999 -51.9999) zone:1 nCells:425058 voxels17 17 17) bb-149.5 -58.5001 -91.0001) (-84.4999 -32.4999 -51.9999) zone:2 nCells:1524013 voxels17 17 17) bb4.63107 -0.389524 -0.39054) (5.20016 0.519058 0.276258) Overset analysis : nCells : 3242029 calculated : 3170494 interpolated : 31228 (interpolated from local:0 mixed local/remote 0 remote:31228) hole : 40307 GAMG: Solving for pcorr, Initial residual = 1, Final residual = 8.28641e-08, No Iterations 1 GAMG: Solving for pcorr, Initial residual = 3.89681e-08, Final residual = 3.89681e-08, No Iterations 0 GAMG: Solving for pcorr, Initial residual = 3.89681e-08, Final residual = 3.89681e-08, No Iterations 0 GAMG: Solving for rho, Initial residual = 1.40776e-05, Final residual = 1.80395e-13, No Iterations 1 rhoEqn max/min : 2.06166 0.495558 PIMPLE: iteration 1 DILUPBiCGStab: Solving for Ux, Initial residual = 2.98633e-07, Final residual = 2.98633e-07, No Iterations 0 DILUPBiCGStab: Solving for Uy, Initial residual = 0.000207149, Final residual = 7.08924e-07, No Iterations 1 DILUPBiCGStab: Solving for Uz, Initial residual = 9.51457e-07, Final residual = 9.51457e-07, No Iterations 0 DILUPBiCGStab: Solving for e, Initial residual = 2.53483e-06, Final residual = 5.16154e-09, No Iterations 1 GAMG: Solving for p, Initial residual = 6.82611e-06, Final residual = 6.35264e-12, No Iterations 1 GAMG: Solving for p, Initial residual = 8.21936e-10, Final residual = 8.21936e-10, No Iterations 0 GAMG: Solving for p, Initial residual = 8.21936e-10, Final residual = 8.21936e-10, No Iterations 0 GAMG: Solving for rho, Initial residual = 1.9906e-05, Final residual = 1.98631e-13, No Iterations 1 time step continuity errors : sum local = 5.012e-09, global = 6.01237e-10, cumulative = -7.55715e-06 rho max/min : 2 0.5 PIMPLE: iteration 2 DILUPBiCGStab: Solving for Ux, Initial residual = 1.08868e-08, Final residual = 1.08868e-08, No Iterations 0 DILUPBiCGStab: Solving for Uy, Initial residual = 8.90283e-07, Final residual = 8.90283e-07, No Iterations 0 DILUPBiCGStab: Solving for Uz, Initial residual = 3.74944e-08, Final residual = 3.74944e-08, No Iterations 0 DILUPBiCGStab: Solving for e, Initial residual = 1.55754e-06, Final residual = 3.00801e-09, No Iterations 1 GAMG: Solving for p, Initial residual = 1.31285e-06, Final residual = 1.25254e-12, No Iterations 1 GAMG: Solving for p, Initial residual = 4.26434e-10, Final residual = 4.26434e-10, No Iterations 0 GAMG: Solving for p, Initial residual = 4.26434e-10, Final residual = 4.26434e-10, No Iterations 0 GAMG: Solving for rho, Initial residual = 3.59682e-06, Final residual = 1.76856e-13, No Iterations 1 time step continuity errors : sum local = 3.933e-09, global = -1.76874e-09, cumulative = -7.55892e-06 rho max/min : 2 0.5 DILUPBiCGStab: Solving for omega, Initial residual = 0.366482, Final residual = 1.67301e-08, No Iterations 1 DILUPBiCGStab: Solving for k, Initial residual = 0.00849793, Final residual = 6.06598e-11, No Iterations 1 PIMPLE: converged in 2 iterations ExecutionTime = 589.94 s ClockTime = 593 s As you can see when I run case in the serial overset mesh can interpolate, but when I run in the parallel overset mesh cannot interpolate. Meantime, I use scotch decomposition method and 560 core with the overRhoPimpleDyMFoam solver. As it can be guessed I use OpenFOAM+ and version 1712 Could anyone please give me some advice about this error?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Problem in overset postprocessing	Adri54	OpenFOAM Running, Solving & CFD	8	July 15, 2018 07:55
Large problem partitioner	tzy	CFX	3	February 7, 2018 17:11
6DOF Dynamic Mesh Problem with Overset Meshing - Weird velocity contour	Caster_Troy	FLUENT	1	December 7, 2017 06:19
Gambit - meshing over airfoil wrapping (?) problem	JFDC	FLUENT	1	July 11, 2011 05:59
Adiabatic and Rotating wall (Convection problem)	ParodDav	CFX	5	April 29, 2007 19:13

February 10, 2020, 10:04		#2
courant_numero_uno New Member Join Date: Sep 2019 Posts: 17 Rep Power: 6	I have heard that the hierarchical decomposition is better suited for overset mesh in parallel. Just a suggestion, I know this thread is old.