CFD Online Discussion Forums

CFD Online Discussion Forums (https://www.cfd-online.com/Forums/)
-   Hardware (https://www.cfd-online.com/Forums/hardware/)
-   -   8-12 core workstation for Star CCM+ (https://www.cfd-online.com/Forums/hardware/215721-8-12-core-workstation-star-ccm.html)

HBH_aero March 14, 2019 08:44

8-12 core workstation for Star CCM+
 
Hello,

I am currently looking to buy/build a workstation for Star CCM+, and was hoping to get a little advice.

Background: We will not upgrade our licenses before early 2020. We already have a 16 core machine which works quite well - we would like to have one more workstation, but only have 8 cores worth of licenses left for this machine. We could go with something like 12 cores and then re-allocate licenses from existing machine, but this might not be very cost effective.
Current workstation is running 2xE5-2630 v3 (8cores 2.4 Ghz 20 mb cache).

The budget is ~5000-6000 euro for the entire workstation.

Aside from CPU, we need 250 GB SSD + 8 TB HD for data storage and a basic GPU.

I am currently considering:
1) AMD Epyc 7251 single CPU (8 cores, 2.1 GHz, 32 MB cache)
2) Intel Xeon Gold 6134 Skylake SP (8 cores, 3.2 Ghz, 24.75 MB cache)
My gut feeling is that I would get more speed with the Gold 6134, even though there's less memory bandwidth.

I am very open for suggestions!

BR
/Henrik

flotus1 March 14, 2019 13:41

AMD Epyc 7371 is by far the best CFD workstation CPU.
It has 8 memory channels and is currently the highest frequency 16-core CPU. With a price of around 1700$ it should fit comfortably into your budget.

HBH_aero March 14, 2019 14:09

Configuration?
 
Thanks Flotus. Markes total sense to go for high clockspeed AND high bandwidth.

In a single CPU motherboard using 8x8GB of ram, would I take full advantage of the CPU even when running only E.g. 8 or 12 cof the 16 cores?

BR
Henrik

ErikAdr March 14, 2019 14:10

AMD Epyc 7261 is the fastest 8 core AMD processor. The lowest frequency is 2.5 GHz and it got 64 MB cache. You should choose that over the 7251.
I don’t know if it will be faster than the Intel alternative for you usage.

Erik

flotus1 March 14, 2019 14:18

Quote:

Originally Posted by HBH_aero (Post 727816)
In a single CPU motherboard using 8x8GB of ram, would I take full advantage of the CPU even when running only E.g. 8 or 12 cof the 16 cores?

Definitely. You just have to make sure the threads are evenly distributed across the 4 NUMA nodes. But that should be the default behavior anyway.

Simbelmynė March 14, 2019 15:46

Quote:

Originally Posted by HBH_aero (Post 727816)
In a single CPU motherboard using 8x8GB of ram, would I take full advantage of the CPU even when running only E.g. 8 or 12 cof the 16 cores?

BR
Henrik


Not sure I understand the question. If you have 16 cores on your single EPYC CPU, then you will see improved results up to 16 cores. So no, you would not take full advantage of the CPU.



On the contrary a 8700k will only benefit from 4 of the 6 cores for CFD, at least when 3200 MHz memory is used. Or put in a different way - The 8700k is memory bottle-necked above 4 cores (there is definitely more CPU power available, but it cannot be used).


(the above analysis is based on the motorbike benchmark, so it may vary depending on your application)

flotus1 March 14, 2019 16:04

In this context, making full use of the CPU means getting the maximum possible performance out of those 8 licenses.

Simbelmynė March 15, 2019 01:05

Ah, ok I see, then I guess the 12 cores OP mentiones is 8+4 licenses. At least for us, ANSYS provides the option to run on 4 cores for each serial license, so it then makes sense. :D

HBH_aero March 15, 2019 02:36

Hi Simbelmynė,

The license system from Siemens for Star CCM+ is a little complicated. We have a total of 18 cores distributed on 2 solver jobs. We already have an 'old' machine running up to 16 cores. So I am looking to employ 8-12 cores on this new workstation. As Flotus said, what I mean by 'full advantage' is basically whether I would see pretty linear scale-up from 8 to 16 cores on an Epyc 7371.

I will update this thread in a week or so, when I have a suggestion for a full workstation :-) .

I guess I should go for dual channel 2666 MHz ram?
Do I have the freedom to go for a motherboard with 2 CPU 'slots' so that I could upgrade my machine later on?

Thank you all - I don't know how I would have approached this without a forum like this.

flotus1 March 15, 2019 12:04

Quote:

what I mean by 'full advantage' is basically whether I would see pretty linear scale-up from 8 to 16 cores on an Epyc 7371
That would be a bit of a stretch. Scaling will definitely not be linear beyond 8-12 cores. But there is currently no single-CPU that will get you closer than this one.
Apart from a lower-clocked 16-core Epyc CPU. Due to the lower performance per core, scaling in bandwidth-intensive applications will be better. But of course overall performance would be worse ;)
For (super-)linear scaling up to 16 threads you would need 2 of these CPUs.

Quote:

I guess I should go for dual channel 2666 MHz ram?
Dual-ranked would be ideal.

Quote:

Do I have the freedom to go for a motherboard with 2 CPU 'slots' so that I could upgrade my machine later on?
That would be a very good idea, I'd recommend that.

ErikAdr March 15, 2019 13:30

For bandwith intensive applications combined with an expensive license, it could be a good option to distribute the load over two cpu’s and then get 16 memory channels. Even with just 8 to 12 active cores two Epyc 7261 would be faster than one 7371 for such applications, but not as fast as two 7371.

HBH_aero March 18, 2019 11:09

Hi all,

So, I have been in touch with a few local retailers. Apparently the 7371 seems to out of stock everywhere (I am based in Denmark). I will most likely go forward with a 7261.

Ill update next week when I get a full workstation offer from a retailer :-)

HBH_aero March 26, 2019 07:30

Update
 
Hi all,

Just wanted to update with the following offer I got from a local vendor:

SuperMicro Mid Tower Chassis, 500W Redundant PSU
1,00 Supermicro MB H11SSL-i - 1xAMD EPYC 7000 8xDDR4 16xSATA3 2xGbE 6xPCIe M.2
1,00 AMD EPYC 7371 - 16-Core 3.10GHz 64MB FCLGA4094 200W
1,00 Supermicro 4U Active CPU Heat Sink for AMD EPYC 7000
1,00 Supermicro 12cm (1850rpm) cooling fan
1,00 Total memory - 64GB balanced 8-ch. memory config.
8,00 8GB DDR4 2666MHz ECC Registered 1Rx8 Samsung
1,00 Toshiba NVMe XG5 - 512GB M.2 2280 BiCS3 TLC 1050w/3000r MB/s
1,00 HGST Ultrastar DC HC320 HDD 8TB SATA3 3.5" 7k2 256MB 512e SE 0B36404
1,00 ** Operating System Not Installed **
1,00** GPU
1,00 PNY Nvidia Quadro P400-PB, 2GB GDDR5, 256 CUDA Cores, 30W, 3 x mDP to DP, PCIe 3.0 x16, LP
1,00 ** Service / Support
1,00 Standard Service - Pickup and return / parts cross shipment (included)
1,00 Standard Service - Pickup and return / parts cross shipment (included) 1,00 Assembly and Testing Workstation - 5 Year Warranty

Any feedback is very welcome!

BR Henrik

ErikAdr March 26, 2019 09:54

It will do fine. Two things though. Dual ranked memory, I believe, performs a little bit better than the single rank you have on the list. More important, it will be a noisy machine that I would not like to share office with. I'm a little sensitive on that. To compare prices look at www.deltacomputer.com. They make less noisy servers, but it looks like they don't have an Epyc 7371 yet. Compare it with the model D10z-ULN-ZN that most likely is based on the same motherboard. Please not, I have no experience buying from them!


Erik A

HBH_aero March 26, 2019 10:29

Thanks a lot Eric.
I have already asked them for dual ranked memory! I don't know if they have alternative (less noisy) fans though. Perhaps Noctua? https://noctua.at/en/products/fan

ErikAdr March 26, 2019 10:43

Noctua is the only alternative, but a very good one. Perhaps there most compact of the three coolers they make for the SP3 socket can fit in the cabinet, but I don't know if it can cool a 200 w processor. It is named NH-U9 TR4-SP3.



/Erik


All times are GMT -4. The time now is 05:56.