[bravikanth]

Dear all,

I want to run the simpleFoam solver using OpenMP. Can anyone suggest me how i can run the solver and what environment variables i need to set in order to make the openmp run.

Thanks,

Ravi

[akidess]

Parallelization in OpenFOAM is done with MPI, not OpenMP. If you really want to use OpenMP, youll have to write some code. If you just want to run in parallel, read the according section in the user guide to learn how to do so using MPI.

[bravikanth]

Thanks for your reply. I do not have any problem running the code in MPI. I just thought there should be something like setting up OMP_NUM_THREADS to 8 and i thought i can use mpirun.

But if it like what you are saying it is different. Do you have any idea on running using OpenMP.

Regards,
Ravi Kanth

[immortality]

hi whats the advantage of openMI to MPI that you want to use it?

[bravikanth]

I want to compare the solver times / performance / drag values with DMP and also i am comparing against inhouse solvers / commercial solvers.

That is the main intention of running the openMP and MPI both on OpenFoam

[mbeaudoin]

You can find here a very very short description of the main differences between OpenMP and MPI (where OpenMPI is a flavor of MPI).

http://lists.apple.com/archives/mt-s.../msg00002.html

This text refers to SMP systems. Nowadays, you can assume that multi-cores computers are a kind of SMP system.

Martin

[luckycfd]

Hi,
can you give me some idea for start to implementation the openMP protocol for parallelization the openFoam linear solver.

[wyldckat]

Hi Hassan,

Since you asked me through the private message and since you asked here as well, I'll answer here what I can remember:

• If you are planning on using Intel Xeon Phi, you can simply use MPI: http://www.cfd-online.com/Forums/ope...-xeon-phi.html
• For hacking the matrix manipulation algorithms directly, see the projects that do this for GPU:
  • http://code.google.com/p/cufflink-library/
  • http://www.symscape.com/gpu-1-0-openfoam
• Last but not least, see OpenFOAM's own MPI interface mechanisms, shown in the various folders at "$FOAM_SRC/Pstream": https://github.com/OpenFOAM/OpenFOAM...er/src/Pstream

Best regards,
Bruno

[luckycfd]

thank you bruno

[wyldckat]

To help add information to this thread, I remembered this thread when I saw the PDF from this other post:

Originally Posted by luckycfd

According to the reference that it's address link is below, in page 53;
http://www.diva-portal.org/smash/get...T01.pdf‎

The document is titled "Hybrid Parallel Computation of OpenFOAM Solver on Multi-Core Cluster Systems", a Master of Science Thesis by Yuan Liu.
Quoting from the abstract:

This thesis pick up the most used compressible reacting solver named
dieselFoam as the research target. Through the analysis of code struc-
ture in solver equation and native MPI implementation in OpenFOAM,
deploy two level parallelism structure on SMP cluster, which use Mes-
sage Passing Interface (MPI) between each SMP nodes and OpenMP
directives inside SMP node. The key idea is making use of feature of
threads parallelism, reduce unnecessary MPI communication overhead,
thereby achieve performance improvement.

Although the results seem a bit suspicious, because being able to cut down runtime by 25% in MPI vs OpenMP, seems awfully suspicious to me. 5-10% I would believe, but 25% is too much. But then again, I don't have evidence to back me up.
Wait... the test case has 168100 cells and it was subdivided into 8 sub-domains, which would explain the performance boost, since this would be 20 kcells vs the rule of thumb of 50 kcells for MPI. So this (in theory) gives the ability to improve scalability for low cell count in sub-domains, therefore allowing for more cores assigned for a case.

[luckycfd]

Originally Posted by bravikanth

Dear all,

I want to run the simpleFoam solver using OpenMP. Can anyone suggest me how i can run the solver and what environment variables i need to set in order to make the openmp run.

Thanks,

Ravi

Hi,
for activate the openmp protocol in your openfoam projects, you must add the "-fopenm" flag into the Make/options file of your project.
regards

[zhulianhua]

Originally Posted by luckycfd

Hi,
for activate the openmp protocol in your openfoam projects, you must add the "-fopenm" flag into the Make/options file of your project.
regards

I have tried to put -fopenmp in the solver's Make/option. But it seems wmake ignored it.

Then I put -fopenmp in the wmake rules in

~/OpenFOAM/OpenFOAM-2.4.0/wmake/rules/linux64Icc/c++

, the OpenMP compilation worked.

My environment is
OS: CentOS 6.5 64 bit
OF: OF2.4.0
CXX: Icc 15.0.1
MPI: Intel MPI 5.0.2

Hope that information helps.

Lianhua

[xuhuang]

Originally Posted by zhulianhua

I have tried to put -fopenmp in the solver's Make/option. But it seems wmake ignored it.

Then I put -fopenmp in the wmake rules in

~/OpenFOAM/OpenFOAM-2.4.0/wmake/rules/linux64Icc/c++

, the OpenMP compilation worked.

My environment is
OS: CentOS 6.5 64 bit
OF: OF2.4.0
CXX: Icc 15.0.1
MPI: Intel MPI 5.0.2

Hope that information helps.

Lianhua

Hi Lianhua,

Apart from putting -fopenmp in the wmake rules, is there any other modifications needed for a solver?

Greetings,
Xu