2x network connected PCs

Echidna · September 3, 2017, 07:17

Could you please explain how can we connect 2 separate computers to run parallel simulations using Ansys? Do we need some specific software to connect the computers together?
My main workstation has a Supermicro motherboard with IPMI ferature, if that helps, and i want to connect this workstation to my old PC so i can exploit both for FEA simulations.
Is it possible?

Echidna · September 4, 2017, 10:28

Just to refresh my question a bit.
Let's say i keep my dual X5670 workstation and buying a used similar dual X5670 server. Is it possible to connect the server to my workstation as the second node of the cluster?
I want to work on my workstation and having the second node (server) connected to it. Do i have to use an Infiniband switch or can i connect them by etherner instead?

flotus1 · September 4, 2017, 10:51

You don't HAVE to use Infiniband, Gigabit Ethernet should work as well for only two nodes with only minor performance losses. However, used infiniband cards and cables are dirt cheap and offer lower latency and higher bandwidth. No IB switch is required for only two nodes, you can connect the cards directly. If you have some time to spare for setting it up it might be worth it.

Christophe · September 4, 2017, 18:21

Not sure adding in an old dissimilar computer connected over 1Gb Ethernet will speed up FEA much. I'd put in more memory, a PCIe SSD, and a GPU for speeding up structural analyses.

For CFD it can help. Easy to do in CFX

flotus1 · September 5, 2017, 04:40

Putting in more memory and using PCIe-SSDs sounds like something that only helps when running out-of-core. Is that still desirable in FEM? Anyway, I think it would be worth checking first if memory or I/O really is the bottleneck before buying any of these.
This rather old (version 14) presentation touches some of the topics mentioned here. Together with the official benchmarks here I would like to revise my recommendation about using infiniband. Gigabit ethernet should really be avoided for Ansys mechanical.
Concerning GPUs, I am not convinced that this is a good idea. Only a few expensive and power-hungry Nvidia GPUs are supported by Ansys mechanical. From what I read and experienced so far, GPU computing with Ansys is a valid option if you can afford to throw a lot of money on your problem to get a slight improvement in solution times. For this 600$ budget workstation it seems like the wrong choice. Or do you recommend any particular GPU?

Christophe · September 5, 2017, 21:08

For $600 I'm not sure what options you really have. Yeah GPU isn't worth the money on a tight budget.

Used hardware is a good option. I buy used infiniband 56 Gb stuff pretty cheap. You need a switch, two cards, and a cable. Even used that will run you at least $2k.

Sent from my iPhone using CFD Online Forum mobile app

flotus1 · September 6, 2017, 09:45

I don't see 2000$ to connect two workstations with infiniband.
You don't need a switch (which start at less than 300$ for QDR) and two cards + a cable are less than 150$.

September 3, 2017, 07:17	2x network connected PCs	#1
Echidna Member Join Date: Jun 2010 Posts: 77 Rep Power: 15	Could you please explain how can we connect 2 separate computers to run parallel simulations using Ansys? Do we need some specific software to connect the computers together? My main workstation has a Supermicro motherboard with IPMI ferature, if that helps, and i want to connect this workstation to my old PC so i can exploit both for FEA simulations. Is it possible?

September 4, 2017, 18:21	2x network connected PCs	#4
Christophe Member Join Date: Jan 2015 Posts: 62 Rep Power: 11	Not sure adding in an old dissimilar computer connected over 1Gb Ethernet will speed up FEA much. I'd put in more memory, a PCIe SSD, and a GPU for speeding up structural analyses. For CFD it can help. Easy to do in CFX

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Behaviour of the kOmegaSST in a steady-state case	Max1234	OpenFOAM Running, Solving & CFD	18	October 31, 2018 08:03
Tecplot 360 2011 R2 preview with OpenFOAM data loader available for evaluation	scott_rumage	OpenFOAM Post-Processing	50	January 23, 2017 02:49
[Netgen] Import netgen mesh to OpenFOAM	hsieh	OpenFOAM Meshing & Mesh Conversion	32	September 13, 2011 05:50
CheckMeshbs errors	ivanyao	OpenFOAM Running, Solving & CFD	2	March 11, 2009 02:34
CheckMeshbs errors	ivanyao	OpenFOAM Running, Solving & CFD	0	March 10, 2009 22:07

September 4, 2017, 10:28		#2
Echidna Member Join Date: Jun 2010 Posts: 77 Rep Power: 15	Just to refresh my question a bit. Let's say i keep my dual X5670 workstation and buying a used similar dual X5670 server. Is it possible to connect the server to my workstation as the second node of the cluster? I want to work on my workstation and having the second node (server) connected to it. Do i have to use an Infiniband switch or can i connect them by etherner instead?

September 4, 2017, 10:51		#3
flotus1 Super Moderator Alex Join Date: Jun 2012 Location: Germany Posts: 3,399 Rep Power: 46	You don't HAVE to use Infiniband, Gigabit Ethernet should work as well for only two nodes with only minor performance losses. However, used infiniband cards and cables are dirt cheap and offer lower latency and higher bandwidth. No IB switch is required for only two nodes, you can connect the cards directly. If you have some time to spare for setting it up it might be worth it.

September 5, 2017, 04:40		#5
flotus1 Super Moderator Alex Join Date: Jun 2012 Location: Germany Posts: 3,399 Rep Power: 46	Putting in more memory and using PCIe-SSDs sounds like something that only helps when running out-of-core. Is that still desirable in FEM? Anyway, I think it would be worth checking first if memory or I/O really is the bottleneck before buying any of these. This rather old (version 14) presentation touches some of the topics mentioned here. Together with the official benchmarks here I would like to revise my recommendation about using infiniband. Gigabit ethernet should really be avoided for Ansys mechanical. Concerning GPUs, I am not convinced that this is a good idea. Only a few expensive and power-hungry Nvidia GPUs are supported by Ansys mechanical. From what I read and experienced so far, GPU computing with Ansys is a valid option if you can afford to throw a lot of money on your problem to get a slight improvement in solution times. For this 600$ budget workstation it seems like the wrong choice. Or do you recommend any particular GPU?

September 5, 2017, 21:08		#6
Christophe Member Join Date: Jan 2015 Posts: 62 Rep Power: 11	For $600 I'm not sure what options you really have. Yeah GPU isn't worth the money on a tight budget. Used hardware is a good option. I buy used infiniband 56 Gb stuff pretty cheap. You need a switch, two cards, and a cable. Even used that will run you at least $2k. Sent from my iPhone using CFD Online Forum mobile app

September 6, 2017, 09:45		#7
flotus1 Super Moderator Alex Join Date: Jun 2012 Location: Germany Posts: 3,399 Rep Power: 46	I don't see 2000$ to connect two workstations with infiniband. You don't need a switch (which start at less than 300$ for QDR) and two cards + a cable are less than 150$.