CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > General Forums > Hardware

8-12 core workstation for Star CCM+

Register Blogs Community New Posts Updated Threads Search

Like Tree1Likes
  • 1 Post By ErikAdr

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   March 14, 2019, 08:44
Question 8-12 core workstation for Star CCM+
  #1
New Member
 
Henrik
Join Date: Mar 2019
Posts: 8
Rep Power: 7
HBH_aero is on a distinguished road
Hello,

I am currently looking to buy/build a workstation for Star CCM+, and was hoping to get a little advice.

Background: We will not upgrade our licenses before early 2020. We already have a 16 core machine which works quite well - we would like to have one more workstation, but only have 8 cores worth of licenses left for this machine. We could go with something like 12 cores and then re-allocate licenses from existing machine, but this might not be very cost effective.
Current workstation is running 2xE5-2630 v3 (8cores 2.4 Ghz 20 mb cache).

The budget is ~5000-6000 euro for the entire workstation.

Aside from CPU, we need 250 GB SSD + 8 TB HD for data storage and a basic GPU.

I am currently considering:
1) AMD Epyc 7251 single CPU (8 cores, 2.1 GHz, 32 MB cache)
2) Intel Xeon Gold 6134 Skylake SP (8 cores, 3.2 Ghz, 24.75 MB cache)
My gut feeling is that I would get more speed with the Gold 6134, even though there's less memory bandwidth.

I am very open for suggestions!

BR
/Henrik
HBH_aero is offline   Reply With Quote

Old   March 14, 2019, 13:41
Default
  #2
Super Moderator
 
flotus1's Avatar
 
Alex
Join Date: Jun 2012
Location: Germany
Posts: 3,399
Rep Power: 46
flotus1 has a spectacular aura aboutflotus1 has a spectacular aura about
AMD Epyc 7371 is by far the best CFD workstation CPU.
It has 8 memory channels and is currently the highest frequency 16-core CPU. With a price of around 1700$ it should fit comfortably into your budget.
flotus1 is offline   Reply With Quote

Old   March 14, 2019, 14:09
Default Configuration?
  #3
New Member
 
Henrik
Join Date: Mar 2019
Posts: 8
Rep Power: 7
HBH_aero is on a distinguished road
Thanks Flotus. Markes total sense to go for high clockspeed AND high bandwidth.

In a single CPU motherboard using 8x8GB of ram, would I take full advantage of the CPU even when running only E.g. 8 or 12 cof the 16 cores?

BR
Henrik
HBH_aero is offline   Reply With Quote

Old   March 14, 2019, 14:10
Default
  #4
Member
 
Erik Andresen
Join Date: Feb 2016
Location: Denmark
Posts: 35
Rep Power: 10
ErikAdr is on a distinguished road
AMD Epyc 7261 is the fastest 8 core AMD processor. The lowest frequency is 2.5 GHz and it got 64 MB cache. You should choose that over the 7251.
I don’t know if it will be faster than the Intel alternative for you usage.

Erik
ErikAdr is offline   Reply With Quote

Old   March 14, 2019, 14:18
Default
  #5
Super Moderator
 
flotus1's Avatar
 
Alex
Join Date: Jun 2012
Location: Germany
Posts: 3,399
Rep Power: 46
flotus1 has a spectacular aura aboutflotus1 has a spectacular aura about
Quote:
Originally Posted by HBH_aero View Post
In a single CPU motherboard using 8x8GB of ram, would I take full advantage of the CPU even when running only E.g. 8 or 12 cof the 16 cores?
Definitely. You just have to make sure the threads are evenly distributed across the 4 NUMA nodes. But that should be the default behavior anyway.
flotus1 is offline   Reply With Quote

Old   March 14, 2019, 15:46
Default
  #6
Senior Member
 
Simbelmynė's Avatar
 
Join Date: May 2012
Posts: 546
Rep Power: 15
Simbelmynė is on a distinguished road
Quote:
Originally Posted by HBH_aero View Post
In a single CPU motherboard using 8x8GB of ram, would I take full advantage of the CPU even when running only E.g. 8 or 12 cof the 16 cores?

BR
Henrik

Not sure I understand the question. If you have 16 cores on your single EPYC CPU, then you will see improved results up to 16 cores. So no, you would not take full advantage of the CPU.



On the contrary a 8700k will only benefit from 4 of the 6 cores for CFD, at least when 3200 MHz memory is used. Or put in a different way - The 8700k is memory bottle-necked above 4 cores (there is definitely more CPU power available, but it cannot be used).


(the above analysis is based on the motorbike benchmark, so it may vary depending on your application)
Simbelmynė is offline   Reply With Quote

Old   March 14, 2019, 16:04
Default
  #7
Super Moderator
 
flotus1's Avatar
 
Alex
Join Date: Jun 2012
Location: Germany
Posts: 3,399
Rep Power: 46
flotus1 has a spectacular aura aboutflotus1 has a spectacular aura about
In this context, making full use of the CPU means getting the maximum possible performance out of those 8 licenses.
flotus1 is offline   Reply With Quote

Old   March 15, 2019, 01:05
Default
  #8
Senior Member
 
Simbelmynė's Avatar
 
Join Date: May 2012
Posts: 546
Rep Power: 15
Simbelmynė is on a distinguished road
Ah, ok I see, then I guess the 12 cores OP mentiones is 8+4 licenses. At least for us, ANSYS provides the option to run on 4 cores for each serial license, so it then makes sense.
Simbelmynė is offline   Reply With Quote

Old   March 15, 2019, 02:36
Default
  #9
New Member
 
Henrik
Join Date: Mar 2019
Posts: 8
Rep Power: 7
HBH_aero is on a distinguished road
Hi Simbelmynė,

The license system from Siemens for Star CCM+ is a little complicated. We have a total of 18 cores distributed on 2 solver jobs. We already have an 'old' machine running up to 16 cores. So I am looking to employ 8-12 cores on this new workstation. As Flotus said, what I mean by 'full advantage' is basically whether I would see pretty linear scale-up from 8 to 16 cores on an Epyc 7371.

I will update this thread in a week or so, when I have a suggestion for a full workstation :-) .

I guess I should go for dual channel 2666 MHz ram?
Do I have the freedom to go for a motherboard with 2 CPU 'slots' so that I could upgrade my machine later on?

Thank you all - I don't know how I would have approached this without a forum like this.
HBH_aero is offline   Reply With Quote

Old   March 15, 2019, 12:04
Default
  #10
Super Moderator
 
flotus1's Avatar
 
Alex
Join Date: Jun 2012
Location: Germany
Posts: 3,399
Rep Power: 46
flotus1 has a spectacular aura aboutflotus1 has a spectacular aura about
Quote:
what I mean by 'full advantage' is basically whether I would see pretty linear scale-up from 8 to 16 cores on an Epyc 7371
That would be a bit of a stretch. Scaling will definitely not be linear beyond 8-12 cores. But there is currently no single-CPU that will get you closer than this one.
Apart from a lower-clocked 16-core Epyc CPU. Due to the lower performance per core, scaling in bandwidth-intensive applications will be better. But of course overall performance would be worse
For (super-)linear scaling up to 16 threads you would need 2 of these CPUs.

Quote:
I guess I should go for dual channel 2666 MHz ram?
Dual-ranked would be ideal.

Quote:
Do I have the freedom to go for a motherboard with 2 CPU 'slots' so that I could upgrade my machine later on?
That would be a very good idea, I'd recommend that.
flotus1 is offline   Reply With Quote

Old   March 15, 2019, 13:30
Default
  #11
Member
 
Erik Andresen
Join Date: Feb 2016
Location: Denmark
Posts: 35
Rep Power: 10
ErikAdr is on a distinguished road
For bandwith intensive applications combined with an expensive license, it could be a good option to distribute the load over two cpu’s and then get 16 memory channels. Even with just 8 to 12 active cores two Epyc 7261 would be faster than one 7371 for such applications, but not as fast as two 7371.
ErikAdr is offline   Reply With Quote

Old   March 18, 2019, 11:09
Default
  #12
New Member
 
Henrik
Join Date: Mar 2019
Posts: 8
Rep Power: 7
HBH_aero is on a distinguished road
Hi all,

So, I have been in touch with a few local retailers. Apparently the 7371 seems to out of stock everywhere (I am based in Denmark). I will most likely go forward with a 7261.

Ill update next week when I get a full workstation offer from a retailer :-)
HBH_aero is offline   Reply With Quote

Old   March 26, 2019, 07:30
Default Update
  #13
New Member
 
Henrik
Join Date: Mar 2019
Posts: 8
Rep Power: 7
HBH_aero is on a distinguished road
Hi all,

Just wanted to update with the following offer I got from a local vendor:

SuperMicro Mid Tower Chassis, 500W Redundant PSU
1,00 Supermicro MB H11SSL-i - 1xAMD EPYC 7000 8xDDR4 16xSATA3 2xGbE 6xPCIe M.2
1,00 AMD EPYC 7371 - 16-Core 3.10GHz 64MB FCLGA4094 200W
1,00 Supermicro 4U Active CPU Heat Sink for AMD EPYC 7000
1,00 Supermicro 12cm (1850rpm) cooling fan
1,00 Total memory - 64GB balanced 8-ch. memory config.
8,00 8GB DDR4 2666MHz ECC Registered 1Rx8 Samsung
1,00 Toshiba NVMe XG5 - 512GB M.2 2280 BiCS3 TLC 1050w/3000r MB/s
1,00 HGST Ultrastar DC HC320 HDD 8TB SATA3 3.5" 7k2 256MB 512e SE 0B36404
1,00 ** Operating System Not Installed **
1,00** GPU
1,00 PNY Nvidia Quadro P400-PB, 2GB GDDR5, 256 CUDA Cores, 30W, 3 x mDP to DP, PCIe 3.0 x16, LP
1,00 ** Service / Support
1,00 Standard Service - Pickup and return / parts cross shipment (included)
1,00 Standard Service - Pickup and return / parts cross shipment (included) 1,00 Assembly and Testing Workstation - 5 Year Warranty

Any feedback is very welcome!

BR Henrik
HBH_aero is offline   Reply With Quote

Old   March 26, 2019, 09:54
Default
  #14
Member
 
Erik Andresen
Join Date: Feb 2016
Location: Denmark
Posts: 35
Rep Power: 10
ErikAdr is on a distinguished road
It will do fine. Two things though. Dual ranked memory, I believe, performs a little bit better than the single rank you have on the list. More important, it will be a noisy machine that I would not like to share office with. I'm a little sensitive on that. To compare prices look at www.deltacomputer.com. They make less noisy servers, but it looks like they don't have an Epyc 7371 yet. Compare it with the model D10z-ULN-ZN that most likely is based on the same motherboard. Please not, I have no experience buying from them!


Erik A
ErikAdr is offline   Reply With Quote

Old   March 26, 2019, 10:29
Default
  #15
New Member
 
Henrik
Join Date: Mar 2019
Posts: 8
Rep Power: 7
HBH_aero is on a distinguished road
Thanks a lot Eric.
I have already asked them for dual ranked memory! I don't know if they have alternative (less noisy) fans though. Perhaps Noctua? https://noctua.at/en/products/fan
HBH_aero is offline   Reply With Quote

Old   March 26, 2019, 10:43
Default
  #16
Member
 
Erik Andresen
Join Date: Feb 2016
Location: Denmark
Posts: 35
Rep Power: 10
ErikAdr is on a distinguished road
Noctua is the only alternative, but a very good one. Perhaps there most compact of the three coolers they make for the SP3 socket can fit in the cabinet, but I don't know if it can cool a 200 w processor. It is named NH-U9 TR4-SP3.



/Erik
foamF likes this.
ErikAdr is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
FOR SALE: 24 core workstation with STAR-CCM+ trampoCFD STAR-CCM+ 0 February 2, 2018 00:17
mpirun, best parameters pablodecastillo Hardware 18 November 10, 2016 12:36
solving a conduction problem in FLUENT using UDF Avin2407 Fluent UDF and Scheme Programming 1 March 13, 2015 02:02
Superlinear speedup in OpenFOAM 13 msrinath80 OpenFOAM Running, Solving & CFD 18 March 3, 2015 05:36


All times are GMT -4. The time now is 04:01.