# porousSimpleFoam crash on 40 cores

 Register Blogs Members List Search Today's Posts Mark Forums Read

 February 26, 2012, 14:56 porousSimpleFoam crash on 40 cores #1 New Member   Marco Join Date: Feb 2012 Posts: 7 Rep Power: 14 Hi, I'm running a simulation with porousSimpleFoam. The simulation executed on 7 cores converges after 1295 iterations, but if I try to run the same simulation on 40 cores it diverges after 96 iterations. Is there any mathematical reason for this? If yes, there is a way to calculate the max number of cores that can be used? Thanks to all. Marco

 February 26, 2012, 16:09 #2 Retired Super Moderator   Bruno Santos Join Date: Mar 2009 Location: Lisbon, Portugal Posts: 10,975 Blog Entries: 45 Rep Power: 128 Greetings Marco, My experience on this is limited, but AFAIK, there are several hypothesis for the crash, since you didn't give any specifics about the case. Some examples: There could be communication problems if you are using the 7 cores case in a single machine, but the 40 cores in several machines. Did you check with 7 cores, one or two per machine? Analyze how the mesh was decomposed into several parts. You might find some weird situation where patches got improperly divided. Certain boundary conditions have a few issues with parallel processing. Usually the guilty ones are the cyclic patches, where their division between sub-domains might lead to problems. Bug reports as examples: Usually the rule of thumb is to have at least 50k cells per core, but this varies with core power and communication stack (number of machines vs bandwidth). Best regards, Bruno __________________ OpenFOAM: FAQ | Getting started Forum: How to get help, to post code/output and forum guide Read this before sending me PM

February 26, 2012, 17:22
#3
Senior Member

Arjun
Join Date: Mar 2009
Location: Nurenberg, Germany
Posts: 1,272
Rep Power: 34
Quote:
 Originally Posted by ciberbob1987 Hi, Is there any mathematical reason for this? If yes, there is a way to calculate the max number of cores that can be used?
numerically possible. So yes there is a mathematical reason for it.

But I am not sure if it is the case. What was your pressure correction solver.
If it was multigrid then it is possible to crash or diverge. If it was Kyrlov based solver like conjugate gradient then less likely but still depends on preconditioner used.