CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > REEF3D

Diverging solution on HPC cluster

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   April 17, 2021, 15:58
Exclamation Diverging solution on HPC cluster
  #1
New Member
 
Priyanka Gautam
Join Date: Apr 2015
Location: India
Posts: 4
Rep Power: 11
priyankaiitb is on a distinguished road
Hi,

I am running Reef3D on an HPC cluster, but unfortunately ever since I had updated Reef3D to the latest version, the solutions are diverging (values exceeding the critical velocity).

Interestingly, the same control files are running normally on a 4-core PC.

Any suggestion in this regard will be greatly appreciated!

Thanks in advance.
priyankaiitb is offline   Reply With Quote

Old   April 17, 2021, 18:57
Default
  #2
Super Moderator
 
Hans Bihs
Join Date: Jun 2009
Location: Trondheim, Norway
Posts: 403
Rep Power: 19
valgrinda is on a distinguished road
Thanks for the feedback. What type of simulation are you running?
__________________
Hans Bihs
Team REEF3D
www.reef3d.com
valgrinda is offline   Reply With Quote

Old   April 19, 2021, 07:35
Default
  #3
New Member
 
Priyanka Gautam
Join Date: Apr 2015
Location: India
Posts: 4
Rep Power: 11
priyankaiitb is on a distinguished road
Hello, sir. Thank you for the prompt response.

I am simulating open channel flow around a cylinder in a rectangular domain.

The umax parameter is exponentially increasing with each time step, crossing a value of 500 m/s.
priyankaiitb is offline   Reply With Quote

Old   April 19, 2021, 08:19
Default
  #4
Senior Member
 
Arun Kamath
Join Date: Nov 2014
Location: Trondheim, Norway
Posts: 265
Rep Power: 14
kamath is on a distinguished road
Hi Priyanka,
could you please share your input files so that we can take a closer look?
__________________
Arun
X years with REEF3D
kamath is offline   Reply With Quote

Old   April 19, 2021, 08:32
Default
  #5
New Member
 
Priyanka Gautam
Join Date: Apr 2015
Location: India
Posts: 4
Rep Power: 11
priyankaiitb is on a distinguished road
Hi Arun

I am attaching the control files.
Attached Files
File Type: txt control.txt (135 Bytes, 8 views)
File Type: txt ctrl.txt (269 Bytes, 8 views)
priyankaiitb is offline   Reply With Quote

Old   April 19, 2021, 08:37
Default
  #6
Super Moderator
 
Hans Bihs
Join Date: Jun 2009
Location: Trondheim, Norway
Posts: 403
Rep Power: 19
valgrinda is on a distinguished road
When you are running the case on the laptop, do you use the same mesh width?
__________________
Hans Bihs
Team REEF3D
www.reef3d.com
valgrinda is offline   Reply With Quote

Old   April 19, 2021, 09:04
Default
  #7
New Member
 
Priyanka Gautam
Join Date: Apr 2015
Location: India
Posts: 4
Rep Power: 11
priyankaiitb is on a distinguished road
While running on the laptop, I have kept the same mesh width.

PS: All the functions (except the M10 parameter), are kept the same in both control.txt and ctrl.txt files.
priyankaiitb is offline   Reply With Quote

Old   April 19, 2021, 15:37
Default
  #8
Senior Member
 
Arun Kamath
Join Date: Nov 2014
Location: Trondheim, Norway
Posts: 265
Rep Power: 14
kamath is on a distinguished road
I am not sure why it works locally and fails on the cluster, but the solution is most probably to avoid using N 40 6. This crashes cases for me locally as well with open channel flow.
Use N 40 3 and the problem should be solved.
__________________
Arun
X years with REEF3D
kamath is offline   Reply With Quote

Old   April 19, 2021, 18:04
Default
  #9
Super Moderator
 
Hans Bihs
Join Date: Jun 2009
Location: Trondheim, Norway
Posts: 403
Rep Power: 19
valgrinda is on a distinguished road
Yes, Arun is correct, N 40 6 can be less stable than N 40 3. But his should be independent of the processor count. We are currently looking in to the matter.

Another idea: maybe you did not make clean the previous build on your HPC cluster before you compiled the newest version? Maybe you have a go, make clean and then compile again?
__________________
Hans Bihs
Team REEF3D
www.reef3d.com
valgrinda is offline   Reply With Quote

Old   April 22, 2021, 06:09
Default
  #10
Senior Member
 
Arun Kamath
Join Date: Nov 2014
Location: Trondheim, Norway
Posts: 265
Rep Power: 14
kamath is on a distinguished road
A small update. With the latest version of the model, N 40 6 seems to work fine (but I would still advice caution while using it).
I do notice though that the cylinder you have in the domain has about the same diameter as the grid size. I would advice using a stretched grid to include more cells around the structure.

And finally something that might just solve the cluster problem, add M 20 2 to control.txt
(Since I cant really reproduce the error, I am limited to looking all possible options, one by one)

Did you see a change after making a fresh compilation of the latest version?
__________________
Arun
X years with REEF3D
kamath is offline   Reply With Quote

Old   April 22, 2021, 08:08
Default
  #11
Super Moderator
 
Hans Bihs
Join Date: Jun 2009
Location: Trondheim, Norway
Posts: 403
Rep Power: 19
valgrinda is on a distinguished road
We have tested your files with 24 cores. Everything works, so I think it is a compilation problem. As I wrote before:
maybe you did not make clean the previous build on your HPC cluster before you compiled the newest version? Maybe you have a go, make clean and then compile again?
__________________
Hans Bihs
Team REEF3D
www.reef3d.com
valgrinda is offline   Reply With Quote

Reply

Tags
cfd analysis, convergence, error, hpc cluster, reef3d

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Problem with loading in paraview on hpc cluster reconstructedCase Lorenzo92 OpenFOAM Post-Processing 0 November 25, 2016 04:00
Solution appears to be diverging. mia_axt88 FLUENT 0 November 24, 2014 04:05
diverging solution in bubble rise shash FLUENT 0 August 11, 2012 17:39
IcoFoam parallel woes msrinath80 OpenFOAM Running, Solving & CFD 9 July 22, 2007 03:58
Microsoft HPC cluster for CFD - question Rory - Administrator Main CFD Forum 8 November 13, 2006 13:59


All times are GMT -4. The time now is 12:50.