[hxaxtma]

Hi guys,

In my case I am trying to simulate an open couette channel flow with perdiodic BCs:

in: cyclicAMI
out: cyclicAMI
FrontAndBack: slip
bottom: no slip
top: no slip with fixed Value;
decomposingMethod: scotch with preservePatches (in out);

I know I have to keep my cyclic patches in one processor, therefore I used preservePatches (in out); in the decomposeDict File.

If i decompose in 4 cpus the simulation runs.

Checking
grep -A4 in processor*/constant/polyMesh/boundary | grep nFacesprocessors
results for in:

processor0/constant/polyMesh/boundary-        nFaces          0;
processor0/constant/polyMesh/boundary-        nFaces          0;
processor0/constant/polyMesh/boundary-        nFaces          5143;
processor0/constant/polyMesh/boundary-        nFaces          3474;
processor0/constant/polyMesh/boundary-        nFaces          2150;
processor1/constant/polyMesh/boundary-        nFaces          2320;
processor1/constant/polyMesh/boundary-        nFaces          2320;
processor1/constant/polyMesh/boundary-        nFaces          5143;
processor2/constant/polyMesh/boundary-        nFaces          0;
processor2/constant/polyMesh/boundary-        nFaces          0;
processor2/constant/polyMesh/boundary-        nFaces          3474;
processor2/constant/polyMesh/boundary-        nFaces          3392;
processor3/constant/polyMesh/boundary-        nFaces          0;
processor3/constant/polyMesh/boundary-        nFaces          0;
processor3/constant/polyMesh/boundary-        nFaces          2150;
processor3/constant/polyMesh/boundary-        nFaces          3392;

and for out in

processor0/constant/polyMesh/boundary-        nFaces          0;
processor1/constant/polyMesh/boundary-        nFaces          2320;
processor2/constant/polyMesh/boundary-        nFaces          0;
processor3/constant/polyMesh/boundary-        nFaces          0;

processor 1 contains my inlet patch with 2320 faces and my outlet patch with 2320 faces. For out the Output is clear? What are all the other faces for in Output (5143,3392,etc..).


So far so good, but if I try massive Parllelisation on Cluster with 128 cpus my simulation fails with following error: EVEN with 1 CPU! On my local workstation everything is OK

...
Reading/calculating face flux field phi

AMI: Creating addressing and weights between 2320 source faces and 2320 target faces
--> FOAM Warning : 
    From function AMIInterpolation<SourcePatch, TargetPatch>::checkPatches(const SourcePatch&, const TargetPatch&)
    in file lnInclude/AMIInterpolation.C at line 111
    Source and target patch bounding boxes are not similar
    source box span     : (42.4264 84.8528 10)
    target box span     : (26.0597 76.9991 10)
    source box          : (-42.4264 -42.4264 0) (3.55271e-15 42.4264 10)
    target box          : (-43.7641 -39.1969 0) (-17.7044 37.8022 10)
    inflated target box : (-47.8592 -43.292 -4.09511) (-13.6093 41.8973 14.0951)
[88] 
[88] 
[88] --> FOAM FATAL ERROR: 
[88] Unable to set source and target faces

Where is the problem?

Thanks for help

[hxaxtma]

I really really need help on this, so any advise would be appreciated

[wyldckat]

Quick answer: I don't have time any time soon to look into this, but I think you can find a lot of valuable information on this thread: http://www.cfd-online.com/Forums/ope...using-ami.html

[KateEisenhower]

Originally Posted by hxaxtma

decomposingMethod: scotch with preservePatches (in out);

I know I have to keep my cyclic patches in one processor, therefore I used preservePatches (in out); in the decomposeDict File.

Hi,

Could you please tell how you can use preservePatches in the decomposeParDict File? I looked at the official wiki (http://cfd.direct/openfoam/user-guid...ions-parallel/) but preservePatches doesn't seem to be mentioned.

Best regards,

Kate

[wyldckat]

Originally Posted by KateEisenhower

Could you please tell how you can use preservePatches in the decomposeParDict File? I looked at the official wiki (http://cfd.direct/openfoam/user-guid...ions-parallel/) but preservePatches doesn't seem to be mentioned.

Quick answer: Run this command:

echo $FOAM_UTILITIES/parallelProcessing/decomposePar/decomposeParDict

which will tell you the location of the main reference file. For quick reference, this file can be seen online here: https://github.com/OpenFOAM/OpenFOAM...composeParDict