CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > SU2

SU2 V6.0 Diverges after restart

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   June 16, 2018, 08:59
Default SU2 V6.0 Diverges after restart
  #1
New Member
 
James Linfield - Navier
Join Date: Dec 2010
Location: Nottingham UK
Posts: 3
Rep Power: 12
JLinfield is on a distinguished road
Hi there,

We are using SU2 (v6.0 Falcon release) to simulate the flow around a civil aircraft wing/body. No mesh adaption or optimisation. The mesh is a high quality quad dominant surface mesh with typical anisotropic refinement around areas of curvature, and 50 or so hex boundary layer elements (Y+<1) with a tetra far field, circa 60M elements.

We are running on a 160 core CentOS cluster with InfiniBand interconnect and Open MPI Version 2.1.1.

We have found that a robust method for reaching convergence is to carry out stages of solution control, starting with a fixed low CFL for circa 1500 iterations, followed by a CFL ramp to say 20 over another 2500 its, then if required we move on to a fixed CL mode.

The issue is that, somewhat randomly, we find that the solution diverges immediately after a restart……..Doesn’t do a single iteration. We have carried out tests where we extend the number of iterations in the phase before to check that the solution is not actually blowing up after that number of iterations, and it’s fine.

I’m not sure if this is associated with a cluster/MPI issue or SU2 bug when SU2 writes the binary restart file in parallel, and perhaps it is corrupted causing divergence at restart?

Has anyone else faced this issue, or does anyone have any advice?

Any help greatly appreciated!

Thanks
James
JLinfield is offline   Reply With Quote

Old   March 1, 2019, 02:19
Default
  #2
New Member
 
Tim Jim
Join Date: Sep 2017
Posts: 25
Rep Power: 5
tjim is on a distinguished road
Hi James,

Did you figure out what caused this?

Thanks,
Tim
tjim is offline   Reply With Quote

Old   March 8, 2019, 05:35
Default
  #3
New Member
 
James Linfield - Navier
Join Date: Dec 2010
Location: Nottingham UK
Posts: 3
Rep Power: 12
JLinfield is on a distinguished road
Hi Tim,

Yes, we did figure out the issue in this case.

Embarrassingly it was not an issue with SU2 at all. It was due to a problem with our compute cluster. One of the nodes would fall over while SU2 was writing the restart file, so the file was corrupted and caused divergence upon restart.

Thanks
James
__________________
James Linfield
Consultant
JLinfield is offline   Reply With Quote

Old   March 16, 2019, 13:20
Default
  #4
New Member
 
Tim Jim
Join Date: Sep 2017
Posts: 25
Rep Power: 5
tjim is on a distinguished road
Thanks for the follow-up!

Kind regards,
Tim
tjim is offline   Reply With Quote

Reply

Tags
divergence after restart, su2

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Introducing SU2 International Developers Society (IDS) fpalacios SU2 News & Announcements 1 June 17, 2019 23:38
Error when reading SU2 restart file occurring every 235 restart files Kit62 SU2 0 March 27, 2018 18:23
SU2 v6.0 turbulence models. raz SU2 1 March 2, 2018 05:26
SU2 v6.0 Release talbring SU2 News & Announcements 0 February 14, 2018 18:17
compressibleInterFoam diverges after restart shildenbrand OpenFOAM Running, Solving & CFD 0 August 8, 2013 04:59


All times are GMT -4. The time now is 06:12.