GlusterFS vs NFS for openfoam

Astan · February 27, 2019, 05:40

Hi guys, i wanted to kindly ask for an information.

Do you know how to configure openfoam with GlusterFS network file system?

In your opinion when dealing with 2-node cluster, is better using NFS or GlusterFS? (with ethernet 1Gbps cable to connect the two nodes).

Thanks your for the time spent for reading the post

Astan

kyle · February 27, 2019, 11:25

Something like GlusterFS is completely unnecessary for only two nodes.

If you're doing something goofy like saving the entire flow field every few iterations then the better solution would be to use the "distributed" option in your controlDict. If you're doing more typical work, then just run normally with NFS.

Astan · February 28, 2019, 14:23

thanks for the answer kyle, could you please explain to me what is the difference between nfs and distributed "yes"?

kyle · February 28, 2019, 21:21

For "distributed no", all processor folders are stored on the same machine and the nodes access and save data via NFS. In the case of "distributed yes" then the processor folders would be stored on the node that the processor belongs to, which reduces network traffic and allows you to use many disks in parallel to speed up writes.

Astan · March 2, 2019, 06:36

ok understood, thanks you very much for your answers kyle!

Astan

Astan · March 7, 2019, 15:55

hi kyle, i've tried to use the "distributed" option, but unfortunately i wasn't able to run the simulation.
Could you kindly explain me how to use this option?

i've setup the case in the shared folder, then i wrote decomposePar, after i paste the processorN folder in the root home/user/processorN, but it doesn't start the simulation, it says it cannot open the specified directory.

Could you kindly explain me how to setup properly the files?

Astan

kyle · March 7, 2019, 16:01

It's very unlikely that you will see any meaningful performance improvement, but the documentation explains how to use it.

Section 3.4.4
https://cfd.direct/openfoam/user-gui...ions-parallel/

Astan · March 7, 2019, 16:13

ok, i'll try! thanks you very much for your reply.

Astan

February 27, 2019, 05:40	GlusterFS vs NFS for openfoam	#1
Astan Member Andrew Join Date: Mar 2018 Posts: 82 Rep Power: 8	Hi guys, i wanted to kindly ask for an information. Do you know how to configure openfoam with GlusterFS network file system? In your opinion when dealing with 2-node cluster, is better using NFS or GlusterFS? (with ethernet 1Gbps cable to connect the two nodes). Thanks your for the time spent for reading the post Astan

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
NFS setting for sharing removable hard disk on network	luchen2408	Lounge	5	May 20, 2013 16:57
Setup OpenFOAM to run one two computers steps	hsieh	OpenFOAM Installation	12	February 12, 2011 04:44
nfs file stale handle	braennstroem	OpenFOAM Installation	4	September 2, 2010 01:15
suggestions for nfs settings	braennstroem	OpenFOAM Installation	1	September 22, 2009 12:44
NFS timing problems	Mattijs Janssens (Mattijs)	OpenFOAM Running, Solving & CFD	3	September 30, 2004 05:23

February 27, 2019, 11:25		#2
kyle Senior Member Join Date: Mar 2009 Location: Austin, TX Posts: 160 Rep Power: 18	Something like GlusterFS is completely unnecessary for only two nodes. If you're doing something goofy like saving the entire flow field every few iterations then the better solution would be to use the "distributed" option in your controlDict. If you're doing more typical work, then just run normally with NFS.

February 28, 2019, 14:23		#3
Astan Member Andrew Join Date: Mar 2018 Posts: 82 Rep Power: 8	thanks for the answer kyle, could you please explain to me what is the difference between nfs and distributed "yes"?

February 28, 2019, 21:21		#4
kyle Senior Member Join Date: Mar 2009 Location: Austin, TX Posts: 160 Rep Power: 18	For "distributed no", all processor folders are stored on the same machine and the nodes access and save data via NFS. In the case of "distributed yes" then the processor folders would be stored on the node that the processor belongs to, which reduces network traffic and allows you to use many disks in parallel to speed up writes.

March 2, 2019, 06:36		#5
Astan Member Andrew Join Date: Mar 2018 Posts: 82 Rep Power: 8	ok understood, thanks you very much for your answers kyle! Astan

March 7, 2019, 15:55		#6
Astan Member Andrew Join Date: Mar 2018 Posts: 82 Rep Power: 8	hi kyle, i've tried to use the "distributed" option, but unfortunately i wasn't able to run the simulation. Could you kindly explain me how to use this option? i've setup the case in the shared folder, then i wrote decomposePar, after i paste the processorN folder in the root home/user/processorN, but it doesn't start the simulation, it says it cannot open the specified directory. Could you kindly explain me how to setup properly the files? Astan

March 7, 2019, 16:01		#7
kyle Senior Member Join Date: Mar 2009 Location: Austin, TX Posts: 160 Rep Power: 18	It's very unlikely that you will see any meaningful performance improvement, but the documentation explains how to use it. Section 3.4.4 https://cfd.direct/openfoam/user-gui...ions-parallel/

March 7, 2019, 16:13		#8
Astan Member Andrew Join Date: Mar 2018 Posts: 82 Rep Power: 8	ok, i'll try! thanks you very much for your reply. Astan