CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > FLUENT

Paralel Network Bottleneck?

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   April 4, 2006, 18:34
Default Paralel Network Bottleneck?
  #1
Riaan
Guest
 
Posts: n/a
Dear all,

I am currently running 6 CPU's in paralel using the NET protocol. After 4 CPU's, I do not see any additional speed-up in time per iteration.

I switched to NMPI/Metis Partitioning, but this just made it run the same/slower.

The 6 CPU's are 3 Dual CPU machines, each with 4gb of ram, and on a gigabit network. We do not run out of ram/cpu on any of the machines.

Right now the cases are 3 million cells, steady segregated, 2nd order,Realizable K-Eps, and take about 25 seconds per itteration on the 6 CPU cluster...

Some advice please ~?!
  Reply With Quote

Old   April 7, 2006, 19:34
Default Re: Paralel Network Bottleneck?
  #2
Andrew
Guest
 
Posts: n/a
I have noticed a similar problem with my simulations. My explanation (and I am no expert on the subject), a large amount of time is taken juggling data around between each computer node once you get above 4 CPU nodes.

Here are the stats that I found for my particular case:

I based efficiency on (CPU-time/Number of CPU's)/Wall Clock, also DT data transfer per iteration:

1 Node: 99.9873% 2 Nodes: 97.9519% (DT=0.025MB) 4 Nodes: 86.1218% (DT=0.063MB) 8 Nodes: 69.923% (DT=0.306MB) 16 Nodes: 40.512339% (DT=2.743MB) 32 Nodes: 16.906626% (DT=11.6MB)

I get around this by running a parallel version of Fluent 8 times, each taking 4 nodes.

Andrew
  Reply With Quote

Old   April 7, 2006, 20:55
Default Re: Paralel Network Bottleneck?
  #3
Riaan
Guest
 
Posts: n/a
Yip, my problem is that I only have access to a single license, with 6 parallel licences.
  Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
IcePak network objects in parallel solver Alexey FLUENT 1 December 25, 2013 09:32
48 Core Cluster - GigE Network ronaldalau Hardware 2 September 9, 2011 13:50
Problem whith parallel an network configuration agamezcfdof FLUENT 0 June 30, 2009 10:51
Initialization of fluid network Liang Huang Main CFD Forum 0 September 23, 2004 03:10
uptodate water distribution network fredius,magige,tanzanian,(e.a) Main CFD Forum 0 January 27, 2002 08:10


All times are GMT -4. The time now is 16:56.