ElmerFoamFSI parallel error
 

I am not very sure that my post is directly related to OpenFOAM but I would be very grateful if anyone could help me.

I want to do FSI with large deformations and chose ElmerFoamFSI for my research.

ElmerFoamFSi is a package intended to solve fluid-structure interaction problems using OpenFOAM and Elmer. It couples foam-extend 3.2 and Elmer 8.0 by something called IMPACT coupler (I don't know the details).

I could compile ElmerFoamFSI with the default BuildSourceScript file and I could run the test cases such as SimpleDynamic and HronTurek FSI3 cases using a single thread.

However, when I try to run in parallel using "elmerfoamfsiPar" solver using "elmerfoamfsiPar test.config" I got the following message:

elmerfoamfsiPar:Run: User Parameters:
elmerfoamfsiPar:Run: FluidSolver = OpenFoamFSI
elmerfoamfsiPar:Run: SolidSolver = ElmerCSC
elmerfoamfsiPar:Run: TransferService = SurfX
elmerfoamfsiPar:Run: FinalTime = 1.0
elmerfoamfsiPar:Run: TimeStep = 1.0e-3
FsiFoam:Load: Loading FsiFoamModule with name FluidsComponentInterface.
Loading ElmerCSC: StructuresComponentInterface
elmerfoamfsiPar:fsicouplingpar:Initialize: Final Time = 1
elmerfoamfsiPar:fsicouplingpar:Initialize: Time Step = 0.001
OF Module verbosity = 1
--------------------------------------------------------------------------
Calling MPI_Init or MPI_Init_thread twice is erroneous.
--------------------------------------------------------------------------
[thawtar-Workstation:8494] *** An error occurred in MPI_Init
[thawtar-Workstation:8494] *** on communicator MPI_COMM_WORLD
[thawtar-Workstation:8494] *** MPI_ERR_OTHER: known error not in list
[thawtar-Workstation:8494] *** MPI_ERRORS_ARE_FATAL: your MPI job will now abort

I think my OpenMPI interface is working well because I can run foam-extend-3.2 cases in parallel well.

I do not know how to fix this error. I would be very grateful if you can help me solve this problem. :D:D

Solved that part
 

It was my stupid mistake.

I tried serial solver using

"mpirun -np 4 elmerfoamfsi test.cfg" and it did not work because it was intended for only serial computation.


The parallel version is elmerfoamfsiPar and it needs mpirun.

So, I tried

"mpirun -np 4 elmerfoamfsiPar test.cfg"

And it works!!

Cheers!

Hello Tar

I ran the parallel case as you described, but still i am getting MPI error.

Following is what I did and what I am getting:

mpirun -np 2 elmerfoamfsiPar test.config
elmerfoamfsiPar:Run: User Parameters:
elmerfoamfsiPar:Run: FluidSolver = OpenFoamFSI
elmerfoamfsiPar:Run: SolidSolver = ElmerCSC
elmerfoamfsiPar:Run: TransferService = SurfX
elmerfoamfsiPar:Run: FinalTime = 0.05
elmerfoamfsiPar:Run: TimeStep = 5.0e-4
FsiFoam:Load: Loading FsiFoamModule with name FluidsComponentInterface.
FsiFoam:Load: Loading FsiFoamModule with name FluidsComponentInterface.
Loading ElmerCSC: StructuresComponentInterface
Loading ElmerCSC: StructuresComponentInterface
elmerfoamfsiPar:fsicouplingpar:Initialize: Final Time = 0.05
elmerfoamfsiPar:fsicouplingpar:Initialize: Time Step = 0.0005
OF Module verbosity = 1
OF Module verbosity = 1
[cfd2:27055] *** An error occurred in MPI_Init
[cfd2:27055] *** reported by process [139957580988417,139955804307457]
[cfd2:27055] *** on communicator MPI_COMM_WORLD
[cfd2:27055] *** MPI_ERR_OTHER: known error not in list
[cfd2:27055] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
[cfd2:27055] *** and potentially your MPI job)

I have decomposed the case using AllrunPar. Any clue what I am missing?

Thanks

Shyam

I can see you use 2 processors. So, I think you decomposed into 2 domains in Open Foam.

But how about Elmer? Did you use the version for 2 processors ? May be you need 2 processors version of Elmer grid (I mean, the script for grid generation for Elmer).

Parallel ElmerFoamFSI
 

Hello Tar

Can you please help me in how to prepare the parallel ElmerFoamFSI case?
Where I can further information on this?

I am using the following commands but still getting error:

1) Run the script AllrunParDrvSetup
2) cd fluid
3) ElmerGrid 1 2 beam3d -partition 4 1 1 0
4) mpirun -np 4 elmerfoamfsiPar test.config

The test case I am trying is located in

ElmerFoamFSI/testing/share/Testing/test_data/HronTurekFSI3_136/

Thanks

Shyam