Parallel and Serial Simulations

sasanghomi · December 31, 2019, 06:20

Dear friends,

I was simulating fluid flow inside a duct with a parallel solver and after reaching the convergence condition, I continued the simulation with a serial solver. That was extremely shocking that the result of my simulation changed to a great extent at the very first iterations and remained at the same value. (I was monitoring heat transfer coefficient)

What is the source of this huge difference? Which result is more trustworthy? Incidentally, I changed the mesh a couple of times and unfortunately there was the same problem again.

Any idea is appreciated.

BR
Sasan Ghomi

ghorrocks · January 1, 2020, 03:56

It is rare that there is a significant difference between the parallel and serial solver, but it does happen. It particular happens in simulations which have very large gradients in a small region of the domain, such as free surfaces and shock waves. When a free surface or a shock wave lies on a partition boundary you can get convergence problems and it fail to converge.

The cause of this is that each partition is solving the volume assigned to it, and there are partition boundaries at the edge to couple the different partitions together. But this means the coupling of the variables between partitions is weaker than the coupling inside a partition - and this means that if you have a simulation with difficult convergence this might be the thing which makes it fail to converge.

So which one is the right answer? The serial simulation has no partition boundaries and so does not possess this weakness, so it is more likely to be correct. But if you are getting differences between serial and parallel it suggests your simulation has poor numerical stability and you better check that your convergence is adequate anyway. It might be a sign of a more important problem (that is, not tight enough convergence).

Opaque · January 1, 2020, 22:38

If properly converged, both simulations must produce IDENTICAL results.

There should NEVER be any difference in a useful solution between serial and parallel runs.

As Glenn suggested, serial runs are more likely to be correct since it is not sensitive to any parallel coding or algorithm issues.

December 31, 2019, 06:20	Parallel and Serial Simulations	#1
sasanghomi Senior Member Sasan Ghomi Join Date: Sep 2012 Location: Denmark Posts: 292 Rep Power: 14	Dear friends, I was simulating fluid flow inside a duct with a parallel solver and after reaching the convergence condition, I continued the simulation with a serial solver. That was extremely shocking that the result of my simulation changed to a great extent at the very first iterations and remained at the same value. (I was monitoring heat transfer coefficient) What is the source of this huge difference? Which result is more trustworthy? Incidentally, I changed the mesh a couple of times and unfortunately there was the same problem again. Any idea is appreciated. BR Sasan Ghomi

January 1, 2020, 03:56		#2
ghorrocks Super Moderator Glenn Horrocks Join Date: Mar 2009 Location: Sydney, Australia Posts: 17,703 Rep Power: 143	It is rare that there is a significant difference between the parallel and serial solver, but it does happen. It particular happens in simulations which have very large gradients in a small region of the domain, such as free surfaces and shock waves. When a free surface or a shock wave lies on a partition boundary you can get convergence problems and it fail to converge. The cause of this is that each partition is solving the volume assigned to it, and there are partition boundaries at the edge to couple the different partitions together. But this means the coupling of the variables between partitions is weaker than the coupling inside a partition - and this means that if you have a simulation with difficult convergence this might be the thing which makes it fail to converge. So which one is the right answer? The serial simulation has no partition boundaries and so does not possess this weakness, so it is more likely to be correct. But if you are getting differences between serial and parallel it suggests your simulation has poor numerical stability and you better check that your convergence is adequate anyway. It might be a sign of a more important problem (that is, not tight enough convergence). __________________ Note: I do not answer CFD questions by PM. CFD questions should be posted on the forum.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
different results between serial solver and parallel solver	wlt_1985	FLUENT	11	October 12, 2018 08:23
8 simulations: 1 after the other in parallel or 8 in serial?	h0rst	ANSYS	3	March 18, 2018 10:08
Serial UDF is working for parallel computation also	Tanjina	Fluent UDF and Scheme Programming	0	December 26, 2013 18:24
Cumulative continuity error large in parallel simulations	xiao	OpenFOAM	3	March 7, 2011 04:13
Differences solutions in Parallel and Serial	wizard1301	OpenFOAM Running, Solving & CFD	2	January 30, 2009 05:38

January 1, 2020, 22:38		#3
Opaque Senior Member Join Date: Jun 2009 Posts: 1,804 Rep Power: 32	If properly converged, both simulations must produce IDENTICAL results. There should NEVER be any difference in a useful solution between serial and parallel runs. As Glenn suggested, serial runs are more likely to be correct since it is not sensitive to any parallel coding or algorithm issues.