CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > CONVERGE

Bad termination Error

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   January 31, 2021, 08:34
Default Bad termination Error
  #1
New Member
 
Saket
Join Date: Nov 2020
Posts: 9
Rep Power: 5
Sahus is on a distinguished road
Hello Community,
So I am running an IC engine simulation case on a system which has 32GB RAM, but it crashes at any random point (CAD). when I restart the simulation, it runs again for some time from the point of crash. this way, some time it runs for the duration of 3-400 crank duration and sometime it crashes within 10-20 crank duration.
Also, when I run the same case setup in different system of same configuration it runs successfully for whole 2-3 cycles without any issue. below are the attached error messages when I use Intel-MPI and MSMPI.
I've checked the memory usage, it is well below 50% of the total available RAM. Also attaching cell_counts_ranks.out file at the crashed point of one of the case.

Kindly, help me understand whats the issue?
Attached Images
File Type: png Intelmpi.PNG (20.2 KB, 39 views)
File Type: png msmpi.PNG (9.3 KB, 26 views)
File Type: png cell counts ranks.PNG (79.9 KB, 25 views)
Sahus is offline   Reply With Quote

Old   February 2, 2021, 10:14
Default
  #2
Senior Member
 
nitesh.attal's Avatar
 
Nitesh Attal
Join Date: Sep 2017
Location: Convergent Science, Northville MI
Posts: 113
Rep Power: 8
nitesh.attal is on a distinguished road
Quote:
Originally Posted by Sahus View Post
Hello Community,
So I am running an IC engine simulation case on a system which has 32GB RAM, but it crashes at any random point (CAD). when I restart the simulation, it runs again for some time from the point of crash. this way, some time it runs for the duration of 3-400 crank duration and sometime it crashes within 10-20 crank duration.
Also, when I run the same case setup in different system of same configuration it runs successfully for whole 2-3 cycles without any issue. below are the attached error messages when I use Intel-MPI and MSMPI.
I've checked the memory usage, it is well below 50% of the total available RAM. Also attaching cell_counts_ranks.out file at the crashed point of one of the case.

Kindly, help me understand whats the issue?

Hi,



Are they any other processes running on your computer while CONVERGE is running? These other processes may be taking up RAM which is not reported in memory.out file. This may lead to a crash if the system runs out of memory.


Thanks,
Nitesh
__________________
Nitesh Attal
Principal Engineer | Applications
CONVERGECFD
nitesh.attal is offline   Reply With Quote

Old   February 2, 2021, 16:12
Default
  #3
New Member
 
Saket
Join Date: Nov 2020
Posts: 9
Rep Power: 5
Sahus is on a distinguished road
Quote:
Originally Posted by nitesh.attal View Post
Hi,



Are they any other processes running on your computer while CONVERGE is running? These other processes may be taking up RAM which is not reported in memory.out file. This may lead to a crash if the system runs out of memory.


Thanks,
Nitesh
Hello,

No, only converge runs. Actually I was looking the memory usage through task manager one time while simulation was running and then crashed but the memory usage didn't exceed 50%.
Sahus is offline   Reply With Quote

Old   February 3, 2021, 08:58
Default
  #4
Senior Member
 
nitesh.attal's Avatar
 
Nitesh Attal
Join Date: Sep 2017
Location: Convergent Science, Northville MI
Posts: 113
Rep Power: 8
nitesh.attal is on a distinguished road
Quote:
Originally Posted by Sahus View Post
Hello,

No, only converge runs. Actually I was looking the memory usage through task manager one time while simulation was running and then crashed but the memory usage didn't exceed 50%.

Hi,



This looks like a hardware issue because the same case runs fine on a similar system but fails on the one you are using.


Can you run one of our example case, say SI8 engine with SAGE using the latest CONVERGE executable and see if it runs fine?



If the above test runs fine then please send us your system configuration, operating system, MPI flavor and CONVERGE executable version along with the case setup to support@convergecfd.com . We can take a look at your case and see if it runs on our our hardware.



Please make sure you are using an email address linked to your CONVERGE account so that we can verify your license.


Best,
Nitesh
__________________
Nitesh Attal
Principal Engineer | Applications
CONVERGECFD
nitesh.attal is offline   Reply With Quote

Old   February 4, 2021, 06:41
Default
  #5
New Member
 
Saket
Join Date: Nov 2020
Posts: 9
Rep Power: 5
Sahus is on a distinguished road
Quote:
Originally Posted by nitesh.attal View Post
Hi,



This looks like a hardware issue because the same case runs fine on a similar system but fails on the one you are using.


Can you run one of our example case, say SI8 engine with SAGE using the latest CONVERGE executable and see if it runs fine?



If the above test runs fine then please send us your system configuration, operating system, MPI flavor and CONVERGE executable version along with the case setup to support@convergecfd.com . We can take a look at your case and see if it runs on our our hardware.



Please make sure you are using an email address linked to your CONVERGE account so that we can verify your license.


Best,
Nitesh
Okay so I ran GDI SAGE transient example case but this too crashed with the same error message. It ran from -381 CAD to -319 CAD.

Few things I'd like to mention -
Earlier I ran 4 cycles (of my case) without combustion and the simulation ran successfully without any difficulty for complete cycles. Also, my colleague ran a heat exchanger case and that too completed successfully.

I will send the details you've mentioned to CONVERGE support.
Thanks.
Sahus is offline   Reply With Quote

Old   February 4, 2021, 09:06
Default
  #6
Senior Member
 
nitesh.attal's Avatar
 
Nitesh Attal
Join Date: Sep 2017
Location: Convergent Science, Northville MI
Posts: 113
Rep Power: 8
nitesh.attal is on a distinguished road
Quote:
Originally Posted by Sahus View Post
Okay so I ran GDI SAGE transient example case but this too crashed with the same error message. It ran from -381 CAD to -319 CAD.

Few things I'd like to mention -
Earlier I ran 4 cycles (of my case) without combustion and the simulation ran successfully without any difficulty for complete cycles. Also, my colleague ran a heat exchanger case and that too completed successfully.

I will send the details you've mentioned to CONVERGE support.
Thanks.

Hi,


If the example case if also crashing, then this confirms that the issue is with your hardware. Please reach out to your IT team and see if they can fix the issue.



If the non-reacting case runs, can you tell how big is the reaction mechanism (number of species and reactions). The memory requirement would go up with increase in number of species in the reaction mechanism which may explain why the case is failing.


Thanks,
Nitesh
__________________
Nitesh Attal
Principal Engineer | Applications
CONVERGECFD
nitesh.attal is offline   Reply With Quote

Old   February 4, 2021, 12:46
Default
  #7
New Member
 
Saket
Join Date: Nov 2020
Posts: 9
Rep Power: 5
Sahus is on a distinguished road
Quote:
Originally Posted by nitesh.attal View Post
Hi,


If the example case if also crashing, then this confirms that the issue is with your hardware. Please reach out to your IT team and see if they can fix the issue.



If the non-reacting case runs, can you tell how big is the reaction mechanism (number of species and reactions). The memory requirement would go up with increase in number of species in the reaction mechanism which may explain why the case is failing.


Thanks,
Nitesh
I am using the reaction mechanism which is provided in the converge itself for gasoline, which consists of 48 species and 152 reactions.

As far as memory usage is concerned, it does not exceed more than 50-60% even at the time of crash, as I've already told.
Sahus is offline   Reply With Quote

Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Compile calcMassFlowC aurore OpenFOAM Programming & Development 13 March 23, 2018 08:43
DPM udf error haghshenasfard FLUENT 0 April 13, 2016 07:35
Compile problem ivanyao OpenFOAM Running, Solving & CFD 1 October 12, 2012 10:31
DecomposePar links against liblamso0 with OpenMPI jens_klostermann OpenFOAM Bugs 11 June 28, 2007 18:51
Problems of Duns Codes! Martin J Main CFD Forum 8 August 15, 2003 00:19


All times are GMT -4. The time now is 09:23.