CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > ANSYS > CFX

CFX and HPC

Register Blogs Community New Posts Updated Threads Search

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   March 1, 2010, 06:12
Default CFX and HPC
  #1
Senior Member
 
ckleanth's Avatar
 
George
Join Date: Mar 2009
Location: Birmingham, UK
Posts: 257
Rep Power: 18
ckleanth is on a distinguished road
Right,

Been looking on the performance of my machine at work and its.. well pretty crap. I've defraged the thing and cleared all clutter but I also get no effective change of speedup after using 6 cores.

This is by using a Dell PowerEdge 2900 server using 8 cores (2 Intel quad core X3350 cpu’s - E5430 @ 2.66 GHz) with 25 GB RAM on an MS windows server 2003 R2 SP2 64 bit.

I'm not an expert on cpu's so I'd appreciate if someone can write a possible explanation why old type cpu's are not working as efficient with cfx, whats different with the Nehalem microarchitecture and why cfx can utilize Nehalem cpu's better?

Many thanks for your help
Attached Images
File Type: jpg Benchmark DELL PowerEdge 2900.jpg (57.4 KB, 35 views)
__________________
Top 4 tips
1. Knowledge is everything and Ignorance is dangerous.
2. Understand your limitations and try to eliminate them.
3. Get yerself a bike and hoon the chuffer. You will soon learn why dogs like to hang their heads out the car window.
4. Please before asking any questions on how to run simulations in CFX, go though all the tutorials
ckleanth is offline   Reply With Quote

Old   March 1, 2010, 16:35
Default
  #2
Super Moderator
 
Glenn Horrocks
Join Date: Mar 2009
Location: Sydney, Australia
Posts: 17,700
Rep Power: 143
ghorrocks is just really niceghorrocks is just really niceghorrocks is just really niceghorrocks is just really nice
The Nehalem CPUs have a memory controller on the chip. This means the CPU communicates directly with the memory. In older style Intel chips the CPU goes through the Northbridge chip for all memory IO and that was a bottleneck, especially for larger numbers of cores. Lots of other improvements also but this is the biggest one.

http://en.wikipedia.org/wiki/Northbr...28computing%29

Disk fragmentation will make little difference to CFD benchmarks. The biggest thing for CFD is fast CPUs and disk speed makes little difference.
ghorrocks is offline   Reply With Quote

Old   March 1, 2010, 17:39
Default
  #3
Senior Member
 
ckleanth's Avatar
 
George
Join Date: Mar 2009
Location: Birmingham, UK
Posts: 257
Rep Power: 18
ckleanth is on a distinguished road
edit of my previous post: should had mentioned it before but I'm running cfx local parallel on this machine hence the results. (the good thing about it is that I haven't specked the machine but should had picked the performance problem up much earlier ) oh well..

cheers glenn for the answer I have a few more if you dont mind, do amd chips suffer in a similar way? and does it make any difference speedwise if running windows server or linux apart that in windows you have a limit of 2GB on the results file?

the last question is regarding the Nehalem cpu, in your experience should I be looking on a cluster setup or could I run cfx efficiently on a single server local parallel?

cheers
__________________
Top 4 tips
1. Knowledge is everything and Ignorance is dangerous.
2. Understand your limitations and try to eliminate them.
3. Get yerself a bike and hoon the chuffer. You will soon learn why dogs like to hang their heads out the car window.
4. Please before asking any questions on how to run simulations in CFX, go though all the tutorials
ckleanth is offline   Reply With Quote

Old   March 1, 2010, 19:30
Default
  #4
Super Moderator
 
Glenn Horrocks
Join Date: Mar 2009
Location: Sydney, Australia
Posts: 17,700
Rep Power: 143
ghorrocks is just really niceghorrocks is just really niceghorrocks is just really niceghorrocks is just really nice
I guessed you were running local parallel.

AMD has for living memory had the memory controller on the chip. AMD devices scale much better than the old style Intel chips, but about the same as the newer Nehalem chips. The problem with AMD is that the serial performance of their CPUs has not kept up with Intel recently. Intel has always been faster in serial, and now with the Nehalem architecture the multi-core disadvantage has gone.

The Nehalem CPUs does change the equation a little for people on commercial licenses on CFX. It runs pretty well multi-processor so it is often now worth running small clusters with 4 or 8 cores per node. Note that 8 cores on a node may require a good network if you are clustering these machines. You might need to go to Infiniband networks, although you may be able to get away with 10GB ethernet - you would need to benchmark it as it would be borderline.
ghorrocks is offline   Reply With Quote

Old   March 1, 2010, 19:49
Default
  #5
Senior Member
 
ckleanth's Avatar
 
George
Join Date: Mar 2009
Location: Birmingham, UK
Posts: 257
Rep Power: 18
ckleanth is on a distinguished road
there is no option to buy more cfx HPC lisences so I'm trying to spec someting near the entry level page 3 dell setup
http://www.ansys.com/corporate/partners/company/Dell_ANSYS_Spec1_R1.pdf

with the nehalem I might try and lease one machine that I can run all 8 cores localy (if its cost effictive compared to a cluster setup) and if cfx will work properly.
__________________
Top 4 tips
1. Knowledge is everything and Ignorance is dangerous.
2. Understand your limitations and try to eliminate them.
3. Get yerself a bike and hoon the chuffer. You will soon learn why dogs like to hang their heads out the car window.
4. Please before asking any questions on how to run simulations in CFX, go though all the tutorials
ckleanth is offline   Reply With Quote

Old   March 1, 2010, 19:53
Default
  #6
Super Moderator
 
Glenn Horrocks
Join Date: Mar 2009
Location: Sydney, Australia
Posts: 17,700
Rep Power: 143
ghorrocks is just really niceghorrocks is just really niceghorrocks is just really niceghorrocks is just really nice
I can't see that document... I think my web connection is dodgy at the moment.

You will loose some parallel performance at 8 cores local, but that is weighed against the fact that the alternative for 8 processes is to go distributed parallel and that requires more hardware, software, maintenance etc.

Do the benchmarks to be sure, but local parallel is lots simpler and more reliable than distributed parallel so has a lot going for it.
ghorrocks is offline   Reply With Quote

Old   March 1, 2010, 19:56
Default
  #7
Senior Member
 
ckleanth's Avatar
 
George
Join Date: Mar 2009
Location: Birmingham, UK
Posts: 257
Rep Power: 18
ckleanth is on a distinguished road
cheers mate, I owe ya some beer once I visit Sydney

ta
__________________
Top 4 tips
1. Knowledge is everything and Ignorance is dangerous.
2. Understand your limitations and try to eliminate them.
3. Get yerself a bike and hoon the chuffer. You will soon learn why dogs like to hang their heads out the car window.
4. Please before asking any questions on how to run simulations in CFX, go though all the tutorials
ckleanth is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
CFX in Windows HPC 2008 Srikanth CFX 5 February 15, 2010 03:42


All times are GMT -4. The time now is 12:28.