MPI nodes limit
 

Hi friends,

I found this report about testing OF on Raspberry.
https://krex.k-state.edu/dspace/bits...pdf?sequence=1

There is an interesting conclusion at pages 32-35 explaining the reasons beyond the increase in computational time when the job is shared between more than 4 nodes.

Well, I feel concern about this as I was considering equip myself with a 64 Intel cores rack. So do we have to stick to the 4 nodes in our decomposeParDict file? This would mean that with my happy 64 cores, I would simply be able to run more cases simultaneously, not solving one case at the speed of light.

Has anyone some feedback about MPI distribution rules?

Happy sunday!

Well, after further readings
http://www.prace-ri.eu/IMG/pdf/Curre...Clusters-2.pdf
http://www.hpcadvisorycouncil.com/pd...015_PakLui.pdf
https://blog.syncious.com/2017/03/24...-hpc-clusters/
I think I mixed cores and clusters. Actually the first experiment was made with RP1 with only 1 core. So 1 cluster = 1 core and the bottleneck is indeed the Ethernet cable as intercommunication between cores is required in OpenFOAM.

From these studies, I understand that as long as we have RDMA clusters with InfinityBand connections, we simply need to carefully select the number of cores we attribute according to the mesh size (not solving a medium size project in a hight number of cores).

Interesting to know RP can be used for Openfoam as well. Thanks for sharing

Sent from my LG-H818 using CFD Online Forum mobile app