[Thaw Tar]

I am not very sure that my post is directly related to OpenFOAM but I would be very grateful if anyone could help me.

I want to do FSI with large deformations and chose ElmerFoamFSI for my research.

ElmerFoamFSi is a package intended to solve fluid-structure interaction problems using OpenFOAM and Elmer. It couples foam-extend 3.2 and Elmer 8.0 by something called IMPACT coupler (I don't know the details).

I could compile ElmerFoamFSI with the default BuildSourceScript file and I could run the test cases such as SimpleDynamic and HronTurek FSI3 cases using a single thread.

However, when I try to run in parallel using "elmerfoamfsiPar" solver using "elmerfoamfsiPar test.config" I got the following message:

elmerfoamfsiPar:Run: User Parameters:
elmerfoamfsiPar:Run: FluidSolver = OpenFoamFSI
elmerfoamfsiPar:Run: SolidSolver = ElmerCSC
elmerfoamfsiPar:Run: TransferService = SurfX
elmerfoamfsiPar:Run: FinalTime = 1.0
elmerfoamfsiPar:Run: TimeStep = 1.0e-3
FsiFoam:Load: Loading FsiFoamModule with name FluidsComponentInterface.
Loading ElmerCSC: StructuresComponentInterface
elmerfoamfsiPar:fsicouplingpar:Initialize: Final Time = 1
elmerfoamfsiPar:fsicouplingpar:Initialize: Time Step = 0.001
OF Module verbosity = 1
--------------------------------------------------------------------------
Calling MPI_Init or MPI_Init_thread twice is erroneous.
--------------------------------------------------------------------------
[thawtar-Workstation:8494] *** An error occurred in MPI_Init
[thawtar-Workstation:8494] *** on communicator MPI_COMM_WORLD
[thawtar-Workstation:8494] *** MPI_ERR_OTHER: known error not in list
[thawtar-Workstation:8494] *** MPI_ERRORS_ARE_FATAL: your MPI job will now abort

I think my OpenMPI interface is working well because I can run foam-extend-3.2 cases in parallel well.

I do not know how to fix this error. I would be very grateful if you can help me solve this problem.

[Thaw Tar]

It was my stupid mistake.

I tried serial solver using

"mpirun -np 4 elmerfoamfsi test.cfg" and it did not work because it was intended for only serial computation.


The parallel version is elmerfoamfsiPar and it needs mpirun.

So, I tried

"mpirun -np 4 elmerfoamfsiPar test.cfg"

And it works!!

Cheers!

[ssyadav]

Hello Tar

I ran the parallel case as you described, but still i am getting MPI error.

Following is what I did and what I am getting:

mpirun -np 2 elmerfoamfsiPar test.config
elmerfoamfsiPar:Run: User Parameters:
elmerfoamfsiPar:Run: FluidSolver = OpenFoamFSI
elmerfoamfsiPar:Run: SolidSolver = ElmerCSC
elmerfoamfsiPar:Run: TransferService = SurfX
elmerfoamfsiPar:Run: FinalTime = 0.05
elmerfoamfsiPar:Run: TimeStep = 5.0e-4
FsiFoam:Load: Loading FsiFoamModule with name FluidsComponentInterface.
FsiFoam:Load: Loading FsiFoamModule with name FluidsComponentInterface.
Loading ElmerCSC: StructuresComponentInterface
Loading ElmerCSC: StructuresComponentInterface
elmerfoamfsiPar:fsicouplingpar:Initialize: Final Time = 0.05
elmerfoamfsiPar:fsicouplingpar:Initialize: Time Step = 0.0005
OF Module verbosity = 1
OF Module verbosity = 1
[cfd2:27055] *** An error occurred in MPI_Init
[cfd2:27055] *** reported by process [139957580988417,139955804307457]
[cfd2:27055] *** on communicator MPI_COMM_WORLD
[cfd2:27055] *** MPI_ERR_OTHER: known error not in list
[cfd2:27055] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
[cfd2:27055] *** and potentially your MPI job)

I have decomposed the case using AllrunPar. Any clue what I am missing?

Thanks

Shyam

[Thaw Tar]

I can see you use 2 processors. So, I think you decomposed into 2 domains in Open Foam.

But how about Elmer? Did you use the version for 2 processors ? May be you need 2 processors version of Elmer grid (I mean, the script for grid generation for Elmer).

[ssyadav]

Hello Tar

Can you please help me in how to prepare the parallel ElmerFoamFSI case?
Where I can further information on this?

I am using the following commands but still getting error:

1) Run the script AllrunParDrvSetup
2) cd fluid
3) ElmerGrid 1 2 beam3d -partition 4 1 1 0
4) mpirun -np 4 elmerfoamfsiPar test.config

The test case I am trying is located in

ElmerFoamFSI/testing/share/Testing/test_data/HronTurekFSI3_136/

Thanks

Shyam