CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > ANSYS > FLUENT

Paralel Network Bottleneck?

Register Blogs Community New Posts Updated Threads Search

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   April 4, 2006, 18:34
Default Paralel Network Bottleneck?
  #1
Riaan
Guest
 
Posts: n/a
Dear all,

I am currently running 6 CPU's in paralel using the NET protocol. After 4 CPU's, I do not see any additional speed-up in time per iteration.

I switched to NMPI/Metis Partitioning, but this just made it run the same/slower.

The 6 CPU's are 3 Dual CPU machines, each with 4gb of ram, and on a gigabit network. We do not run out of ram/cpu on any of the machines.

Right now the cases are 3 million cells, steady segregated, 2nd order,Realizable K-Eps, and take about 25 seconds per itteration on the 6 CPU cluster...

Some advice please ~?!
  Reply With Quote

Old   April 7, 2006, 19:34
Default Re: Paralel Network Bottleneck?
  #2
Andrew
Guest
 
Posts: n/a
I have noticed a similar problem with my simulations. My explanation (and I am no expert on the subject), a large amount of time is taken juggling data around between each computer node once you get above 4 CPU nodes.

Here are the stats that I found for my particular case:

I based efficiency on (CPU-time/Number of CPU's)/Wall Clock, also DT data transfer per iteration:

1 Node: 99.9873% 2 Nodes: 97.9519% (DT=0.025MB) 4 Nodes: 86.1218% (DT=0.063MB) 8 Nodes: 69.923% (DT=0.306MB) 16 Nodes: 40.512339% (DT=2.743MB) 32 Nodes: 16.906626% (DT=11.6MB)

I get around this by running a parallel version of Fluent 8 times, each taking 4 nodes.

Andrew
  Reply With Quote

Old   April 7, 2006, 20:55
Default Re: Paralel Network Bottleneck?
  #3
Riaan
Guest
 
Posts: n/a
Yip, my problem is that I only have access to a single license, with 6 parallel licences.
  Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
IcePak network objects in parallel solver Alexey FLUENT 1 December 25, 2013 08:32
48 Core Cluster - GigE Network ronaldalau Hardware 2 September 9, 2011 13:50
Problem whith parallel an network configuration agamezcfdof FLUENT 0 June 30, 2009 10:51
Initialization of fluid network Liang Huang Main CFD Forum 0 September 23, 2004 03:10
uptodate water distribution network fredius,magige,tanzanian,(e.a) Main CFD Forum 0 January 27, 2002 07:10


All times are GMT -4. The time now is 22:09.