CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > General Forums > Hardware

Building Workstation using 2 x AMD EPYC 7301

Register Blogs Community New Posts Updated Threads Search

Like Tree5Likes
  • 1 Post By naffrancois
  • 1 Post By LuckyTran
  • 2 Post By ksmithgall
  • 1 Post By flotus1

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   November 13, 2018, 14:37
Default Building Workstation using 2 x AMD EPYC 7301
  #1
New Member
 
Ivanrips's Avatar
 
Roger Iván
Join Date: Jun 2009
Location: Perú
Posts: 22
Rep Power: 16
Ivanrips is on a distinguished road
Hi guys;
I will build a new workstation using 02 AMD EPYC 7301 for run ANSYS CFX, FLUENT, and OpenFOAM. For this reason, I want to know if you have experience about performance or benchmark about two processors AMD EPYC and if you have built a similar workstation? Can you share your experience?

The components
  • 02 processors AMD EPYC 7301
  • Motherboard: Supermicro: H11DSI-NT Dual
  • Memory 128 Gb (16x8Gb) DDR4 2666 Mhz
  • Power: 1500 W Plus Gold
  • VideoCard: NVIDIA Quadro P4000 8Gb GDDR5
  • NVMe Drive: Samsumg 970 EVO 2TB
  • SSD Samsumg 860 EVO 2TB

Thanks in advance
Ivanrips is offline   Reply With Quote

Old   November 13, 2018, 15:38
Default
  #2
Senior Member
 
Join Date: Oct 2011
Posts: 242
Rep Power: 16
naffrancois is on a distinguished road
Hello,

You should post your message on the hardware section, several people have built and benchmarked a similar configuration against xeon gold and others. Anyway your setup looks good, I built a similar one recently with 7501 instead and clearly 7301 is better in terms of perf/$
naffrancois is offline   Reply With Quote

Old   November 13, 2018, 15:48
Default
  #3
New Member
 
Ivanrips's Avatar
 
Roger Iván
Join Date: Jun 2009
Location: Perú
Posts: 22
Rep Power: 16
Ivanrips is on a distinguished road
Quote:
Originally Posted by naffrancois View Post
Hello,

You should post your message on the hardware section, several people have built and benchmarked a similar configuration against xeon gold and others. Anyway your setup looks good, I built a similar one recently with 7501 instead and clearly 7301 is better in terms of perf/$
Thanks, yes I try to post in the hardware section but it was removed. Anyway, I have a doubt, Can you share the RAM memory specification of your workstation? I have review forums and I see that some RAM memory can be incompatible with the motherboard.
Regards
Ivanrips is offline   Reply With Quote

Old   November 13, 2018, 16:28
Default
  #4
Senior Member
 
Join Date: Oct 2011
Posts: 242
Rep Power: 16
naffrancois is on a distinguished road
My configuration has H11DSi, and the ram specification is 16x8 DDR4 2666 ECC dual rank (this last point is important if you can have it at the same price as single rank).
naffrancois is offline   Reply With Quote

Old   November 13, 2018, 16:32
Default
  #5
Senior Member
 
Join Date: Oct 2011
Posts: 242
Rep Power: 16
naffrancois is on a distinguished road
By the way, mine came with a supermicro chassis and dynatron cpu fans. The 80mm chassis fans + dynatron fans yield a noise level forbidding use as a workstation
naffrancois is offline   Reply With Quote

Old   November 14, 2018, 00:51
Default
  #6
New Member
 
Ivanrips's Avatar
 
Roger Iván
Join Date: Jun 2009
Location: Perú
Posts: 22
Rep Power: 16
Ivanrips is on a distinguished road
Thank you very much naffrancois,
What is the power supply in your workstation? I want to buy one of 1600W but I don't know if it is too much. Do you know another chassis for H11DSI-NT? I see the Supermicro Models and all are very expensive.
I appreciate you sharing your experience
Ivanrips is offline   Reply With Quote

Old   November 14, 2018, 08:01
Default
  #7
Senior Member
 
Join Date: Oct 2011
Posts: 242
Rep Power: 16
naffrancois is on a distinguished road
I extracted the exact memory specifications I have:

Array Handle: 0x001F
Error Information Handle: 0x0051
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: P2-DIMMF1
Bank Locator: P1_Node0_Channel5_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2667 MHz
Manufacturer: Samsung
Serial Number: 2024A631
Asset Tag: P2-DIMMF1_AssetTag (date:17/33)
Part Number: M393A1G43EB1-CTD
Rank: 2
Configured Clock Speed: 2667 MHz
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V

As for the power supply it came with the following case

https://www.supermicro.com/products/...745BAC-R1K28B2

so 1280 redundant. I think 1600W is way too much for a single GPU configuration.

There are other chassis other forumers used, you should wait for other answers
Ivanrips likes this.
naffrancois is offline   Reply With Quote

Old   November 14, 2018, 11:18
Default
  #8
Senior Member
 
Lucky
Join Date: Apr 2011
Location: Orlando, FL USA
Posts: 5,682
Rep Power: 66
LuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura about
The TDP for the 7301 is 180W each. The TDP for the P4000 is 105W. You're looking at 600-800 W. 1600 W is definitely overkill and probably will run super inefficiently. PSU's are most efficient when they're near maximum power draw.


Quote:
Originally Posted by naffrancois View Post
By the way, mine came with a supermicro chassis and dynatron cpu fans. The 80mm chassis fans + dynatron fans yield a noise level forbidding use as a workstation

That's a general feature of workstations. I'm surprised you even found one with 80 mm fans. Even 20 mm fans are not uncommon. Workstations are a lot like race cars, louder is cooler. You have to get creative in your build if you want a quiet setup. One thing though, is to just expect it to run hot if you want it quiet.
Ivanrips likes this.
LuckyTran is offline   Reply With Quote

Old   November 14, 2018, 12:41
Default
  #9
Senior Member
 
Join Date: Oct 2011
Posts: 242
Rep Power: 16
naffrancois is on a distinguished road
there are other Dell workstations at work hosting dual-xeon gold which are quite silent and perfectly fit in an office room.

This setup trust me is very noisy, you cannot stand working in the same room a whole day without going nuts. I agree 80mm is not bad but maximum rpm reaches 9k, chassis and cpu fans. Currently on full charge the dynatron are at about 6/7k rpm and CPU temp is about 66deg, this is ok but not that much cooled

these dynatron A26 are in fact 60mm fans and deliver 45cfm at 8k rpm for a noise level of 53dB. A 92mm fan such as Noctua NH-U9 delivers 45cfm at 2k rpm for a noise level of 23dB.
naffrancois is offline   Reply With Quote

Old   November 14, 2018, 13:07
Default
  #10
New Member
 
Kurt
Join Date: Feb 2017
Posts: 10
Rep Power: 9
ksmithgall is on a distinguished road
I just finished a single CPU AMD Epyc build and here are some comments:

A H11DSi/H11DSi-NT will fit in a Phanteks Enthoo Pro Case

For the CPU cooler I used a Noctua NH-U12S TR4-SP3
For the case fans I used x2 Noctua NF-A20 PWM which do fit, if you notch the corners

Using the supplied low noise adapters and modifying the fan thresholds, the system is very quiet and under load, the CPU temp stays in the 35-45c range depending to room temperature
Ivanrips and naffrancois like this.
ksmithgall is offline   Reply With Quote

Old   November 14, 2018, 13:18
Default
  #11
Senior Member
 
Join Date: Oct 2011
Posts: 242
Rep Power: 16
naffrancois is on a distinguished road
It may be obvious but do this cpu cooler fit in a dual socket configuration on the motherboards you mentioned?
naffrancois is offline   Reply With Quote

Old   November 14, 2018, 13:27
Default
  #12
New Member
 
Kurt
Join Date: Feb 2017
Posts: 10
Rep Power: 9
ksmithgall is on a distinguished road
Yes, there's enough room for two of the Noctua NH-U12S TR4-SP3 CPU coolers. Though for a dual CPU set up I would use x2 NF-A14 PWM fans on the top panel so that the two CPU coolers push the hot air up, and then the two case fans immediately exhaust the hot air

(This will be my plan once I save up enough for more RAM and the second CPU)
ksmithgall is offline   Reply With Quote

Old   November 14, 2018, 13:59
Default
  #13
Super Moderator
 
flotus1's Avatar
 
Alex
Join Date: Jun 2012
Location: Germany
Posts: 3,401
Rep Power: 47
flotus1 has a spectacular aura aboutflotus1 has a spectacular aura about
Quote:
Originally Posted by LuckyTran View Post
That's a general feature of workstations. I'm surprised you even found one with 80 mm fans. Even 20 mm fans are not uncommon. Workstations are a lot like race cars, louder is cooler. You have to get creative in your build if you want a quiet setup. One thing though, is to just expect it to run hot if you want it quiet.
Those are servers, not workstations. Quiet does not equal hot with a proper cooling concept.
A workstation should be designed to sit under your desk and not annoy you with loud noise. Supermicro just has the habit of re-purposing server components -like power supplies with 40mm fans or 80mm case fans that spin up to 8000rpm- for workstations.
There are other hardware vendors who put more thought into a quiet cooling solution for their workstations.

Quote:
What is the power supply in your workstation? I want to buy one of 1600W but I don't know if it is too much.
Your configuration can be powered easily with a 650W power supply. You won't get it to draw much more than 500W even with synthetic benchmarks.
There is not really a "too much" when it comes to power supplies, a 1600W PSU with platinum or titanium efficiency rating will still run quite efficient with lower loads https://www.anandtech.com/show/12645...-performance/5
Just the cost of the part will be higher.
Ivanrips likes this.
flotus1 is offline   Reply With Quote

Old   November 14, 2018, 16:14
Default
  #14
New Member
 
Ivanrips's Avatar
 
Roger Iván
Join Date: Jun 2009
Location: Perú
Posts: 22
Rep Power: 16
Ivanrips is on a distinguished road
Thank you very much! for all for sharing your experience and recommendations
I have a doubt for select the processor.
I plan to buy 02 AMD EPYC 7301 (16 cores), however, I also analyze the option to buy 01 AMD EPYC 7531(32 cores) and later buy another one (for the cost) Could I use the Supermicro h11dsi-nt dual motherboard with a single AMD EPYC 7531 processor ?
Regards
Ivanrips is offline   Reply With Quote

Old   November 14, 2018, 16:16
Default
  #15
New Member
 
Ivanrips's Avatar
 
Roger Iván
Join Date: Jun 2009
Location: Perú
Posts: 22
Rep Power: 16
Ivanrips is on a distinguished road
Quote:
Originally Posted by ksmithgall View Post
I just finished a single CPU AMD Epyc build and here are some comments:

A H11DSi/H11DSi-NT will fit in a Phanteks Enthoo Pro Case

For the CPU cooler I used a Noctua NH-U12S TR4-SP3
For the case fans I used x2 Noctua NF-A20 PWM which do fit, if you notch the corners

Using the supplied low noise adapters and modifying the fan thresholds, the system is very quiet and under load, the CPU temp stays in the 35-45c range depending to room temperature
Hi ksmithgall,
Can you share the exact model of your case? or a link from Amazon
Thanks in advance
Ivanrips is offline   Reply With Quote

Old   November 14, 2018, 16:24
Default
  #16
New Member
 
Ivanrips's Avatar
 
Roger Iván
Join Date: Jun 2009
Location: Perú
Posts: 22
Rep Power: 16
Ivanrips is on a distinguished road
Quote:
Originally Posted by flotus1 View Post
Those are servers, not workstations. Quiet does not equal hot with a proper cooling concept.
A workstation should be designed to sit under your desk and not annoy you with loud noise. Supermicro just has the habit of re-purposing server components -like power supplies with 40mm fans or 80mm case fans that spin up to 8000rpm- for workstations.
There are other hardware vendors who put more thought into a quiet cooling solution for their workstations.


Your configuration can be powered easily with a 650W power supply. You won't get it to draw much more than 500W even with synthetic benchmarks.
There is not really a "too much" when it comes to power supplies, a 1600W PSU with platinum or titanium efficiency rating will still run quite efficient with lower loads https://www.anandtech.com/show/12645...-performance/5
Just the cost of the part will be higher.
Hi flotus1;
Thanks
Could you help me fine-tune the accessories I intend to buy?
Initially, I am thinking about the following:
  • 02 processors AMD EPYC 7301
  • Motherboard: Supermicro: H11DSI-NT Dual
  • Memory 128 Gb (16x8Gb) DDR4 2666 Mhz
  • Power: 1500 W Plus Gold (I will change it according to your previous recommendation)
  • VideoCard: 02 x NVIDIA Quadro P4000 8Gb GDDR5
  • NVMe Drive: Samsumg 970 EVO 2TB
  • SSD Samsumg 860 EVO 2TB
  • Case (I am not sure)
But I have doubts about compatibility and performance.
My main objective is to use it for CFD.
Thanks

Last edited by Ivanrips; November 14, 2018 at 21:08.
Ivanrips is offline   Reply With Quote

Old   January 21, 2019, 09:39
Exclamation Problem
  #17
Rec
New Member
 
Sergey
Join Date: Jan 2018
Posts: 18
Rep Power: 8
Rec is on a distinguished road
I ask for help:
Problem Supermicro H11DSi + 2 x AMD EPYC 7351
Rec is offline   Reply With Quote

Reply

Tags
amd epyc


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
AMD Epyc CFD benchmarks with Ansys Fluent flotus1 Hardware 55 November 12, 2018 05:33
AMD EPYC 7281 (32 MB L2 cache) vs 7301 (64 MB cache)? zwilhoit Hardware 0 November 9, 2018 15:00
EPYC based workstation for OpenFOAM simulations roenby Hardware 21 May 30, 2018 09:29
[foam-extend.org] Error compiling OpenFOAM-1.6-ext Canesin OpenFOAM Installation 137 January 20, 2016 14:56
Compilation error OF1.5-dev on Suse10.3 darenyang OpenFOAM Installation 0 April 29, 2009 04:55


All times are GMT -4. The time now is 23:53.