CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Running, Solving & CFD

porousSimpleFoam crash on 40 cores

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   February 26, 2012, 15:56
Default porousSimpleFoam crash on 40 cores
  #1
New Member
 
Marco
Join Date: Feb 2012
Posts: 7
Rep Power: 5
ciberbob1987 is on a distinguished road
Hi,
I'm running a simulation with porousSimpleFoam.
The simulation executed on 7 cores converges after 1295 iterations, but if I try to run the same simulation on 40 cores it diverges after 96 iterations.

Is there any mathematical reason for this?
If yes, there is a way to calculate the max number of cores that can be used?

Thanks to all.
Marco
ciberbob1987 is offline   Reply With Quote

Old   February 26, 2012, 17:09
Default
  #2
Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 8,301
Blog Entries: 34
Rep Power: 84
wyldckat is just really nicewyldckat is just really nicewyldckat is just really nicewyldckat is just really nice
Greetings Marco,

My experience on this is limited, but AFAIK, there are several hypothesis for the crash, since you didn't give any specifics about the case. Some examples:
  1. There could be communication problems if you are using the 7 cores case in a single machine, but the 40 cores in several machines. Did you check with 7 cores, one or two per machine?
  2. Analyze how the mesh was decomposed into several parts. You might find some weird situation where patches got improperly divided.
  3. Certain boundary conditions have a few issues with parallel processing. Usually the guilty ones are the cyclic patches, where their division between sub-domains might lead to problems. Bug reports as examples:
  4. Usually the rule of thumb is to have at least 50k cells per core, but this varies with core power and communication stack (number of machines vs bandwidth).
Best regards,
Bruno
wyldckat is offline   Reply With Quote

Old   February 26, 2012, 18:22
Default
  #3
Senior Member
 
Arjun
Join Date: Mar 2009
Location: Nurenberg, Germany
Posts: 369
Rep Power: 10
arjun is on a distinguished road
Quote:
Originally Posted by ciberbob1987 View Post
Hi,
Is there any mathematical reason for this?
If yes, there is a way to calculate the max number of cores that can be used?
numerically possible. So yes there is a mathematical reason for it.

But I am not sure if it is the case. What was your pressure correction solver.
If it was multigrid then it is possible to crash or diverge. If it was Kyrlov based solver like conjugate gradient then less likely but still depends on preconditioner used.
arjun is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Which is better for CFD 4 core i7-2600 or AMD 8 core FX-8150? GregShaffer Hardware 3 May 7, 2015 13:26
Superlinear speedup in OpenFOAM 13 msrinath80 OpenFOAM Running, Solving & CFD 18 March 3, 2015 06:36
Specify number of cores that CFX should use. Lance CFX 14 April 1, 2014 10:43
porousSimpleFoam - crash Sebaj OpenFOAM 2 January 4, 2012 17:16
Selecting cores independently in a dual quad core machine jalarron FLUENT 1 September 7, 2009 17:06


All times are GMT -4. The time now is 16:54.