Notes about running OpenFOAM in parallel
Posted February 27, 2011 at 09:22 by wyldckat
Updated May 1, 2013 at 05:05 by wyldckat (added more links)
Updated May 1, 2013 at 05:05 by wyldckat (added more links)
This is a rough list of informations to be compiled and posted on openfoamwiki.net on a page about running OpenFOAM in parallel. If someone picks up on this and wants to start the article in the wiki, be my guest. Leave a comment pointing to the wiki page, so we can cooperate 
List of already catalogued applications on the wiki for pre/post processing for parallel mode: http://openfoamwiki.net/index.php/Ca...sing_utilities
Yet to be catalogued:
OpenFOAM's script for running applications in parallel: foamJob
OpenFOAM's script with helpful functions, including for running in parallel: "bin/tools/RunFunctions", namely function runParallel
Threads with very useful information:
About NFS and OpenMPI tweaks:
Items to talk about:
List of already catalogued applications on the wiki for pre/post processing for parallel mode: http://openfoamwiki.net/index.php/Ca...sing_utilities
Yet to be catalogued:
- redistributeMesh
- renumberMesh - useful for optimizing the mesh in each processor for improving cooperative performance.
- reconstructParMesh
OpenFOAM's script for running applications in parallel: foamJob
OpenFOAM's script with helpful functions, including for running in parallel: "bin/tools/RunFunctions", namely function runParallel
Threads with very useful information:
- On how to test if MPI is working: post #4 of "openfoam 1.6 on debian etch", and/or post #19 of "OpenFOAM updates"
- decomposed case to 2-cores (Not working) (more precisely post #21 has valuable info)
- renumberMesh: Some questions on blockMesh, decomposePar and renumberMesh post #2
- Further diagnoses when checking if things can even run in parallel: Segmentation fault in interFoam run through openMPI posts #8 and #10.
- Cluster OpenFOAM [Solved]
- OpenMPI bash: orted: comand not found error
- Cyclic patches and parallel postprocessing problems #8 - about preserving cyclic patches in one sub-domain.
- Installing OpenFOAM-1.5-dev on a cluster #2 - check out the report for some references for clusters and the valuable reference benchmark. Notice the super-scale up when using more than one machine, even when all machines are multi-core!
- Notes about figuring out why it doesn't scale as we wanted it to: Parallel processing of OpenFOAM cases on multicore processor??? post #11
- On BlueGene/P: FOAM FATAL ERROR in Foam::findEtcFile() : could not find mandatory file - post #9
- Anyone succesful on static executable solver? - see my posts!
- Quote:Originally Posted by kyle
CFD performance with unstructured grids on AMD's multi-socket boards is extremely poor. This article from anandtech tries to investigate why. I am assuming that Interlagos won't fix this entirely. - Running OpenFOAM in parallel with different locations for each process
- A nice summary of how-to: OpenFOAM on deux pc post #13
- How to run concurrent MPI jobs within a node or set of nodes - post #9 - A must read for when using Open-MPI with more than one job on a single machine!
- Another discussion: Running Foam on multiple nodes (small cluster)
- snappyHexMesh with more than 100 processes in parallel: SnappyHexmesh crashes with many processes
- Quote:Originally Posted by mfmohdyasin
Just figured out that I supposed to use "Pout" instead of "Info" to get output from each processor.
- Caution: Open-MPI 1.5.3 is a beta version: problems with openmpi
- Diagnosing NFS+MPI lock-ups: MPI issue on multiple nodes post #10
- Notes on scalability: Large test case for running OpenFoam in parallel post #20 (reference: http://www.cfd-online.com/Forums/blo...-parallel.html)
- Performance tuning: mpirun, best parameters
About NFS and OpenMPI tweaks:
Items to talk about:
- Intro on how things work
- Passwordless ssh and possibly rsh
- NFS and in case the network can't handle NFS
- .bashrc and foamExec
- using mpirun app, foamJob script, and RunParallel function
- Testing operationality
- Tweaking mpirun, including telling it how to use rsh instead of ssh
- Running cases and benchmarks
- Tips on improving performance with OpenFOAM tools.
Total Comments 0
