CFD Online URL
[Sponsors]
Home > Forums > OpenFOAM Running, Solving & CFD

OpenFoam parallel crashes at random

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   April 17, 2009, 07:17
Default OpenFoam parallel crashes at random
  #1
Senior Member
 
Prapanch Nair
Join Date: Mar 2009
Location: Bangalore, India
Posts: 105
Rep Power: 7
prapanj is on a distinguished road
Hi
I have OpenFoam and openMPI installed on a 8 core cluster. I had once case run successfully in parallel before.

On the next case (buoyantSimpleFoam), the run crashes at random. Which means, when I rerun from the latest time, everything works fine and the run proceeds beyond the previous crash time. I tried running in series, and there is absolutely no problem

The following is part of the log that I think might help some of you figure out what may be wrong:
[0]
[0] Maximum number of iterations exceeded#0 Foam::error:rintStack(Foam::Ostream&) in "/home/rwdi-india/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libOpenFOAM.so"
#1 Foam::error::abort() in "/home/rwdi-india/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libOpenFOAM.so"
#2 Foam::hThermo<Foam:ureMixture<Foam::constTranspo rt<Foam::specieThermo<Foam::hConstThermo<Foam:er fectGas> > > > >::calculate() in "/home/rwdi-india/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libbasicThermophysicalModels.so"
#3 Foam::hThermo<Foam:ureMixture<Foam::constTranspo rt<Foam::specieThermo<Foam::hConstThermo<Foam:er fectGas> > > > >::hThermo(Foam::fvMesh const&) in "/home/rwdi-india/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libbasicThermophysicalModels.so"
#4 Foam::basicThermo::addfvMeshConstructorToTable<Foa m::hThermo<Foam:ureMixture<Foam::constTransport< Foam::specieThermo<Foam::hConstThermo<Foam:erfec tGas> > > > > >::New(Foam::fvMesh const&) in "/home/rwdi-india/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libbasicThermophysicalModels.so"
#5 Foam::basicThermo::New(Foam::fvMesh const&) in "/home/rwdi-india/OpenFOAM/OpenFOAM-1.5/lib/linuxGccDPOpt/libbasicThermophysicalModels.so"
#6 main in "/home/rwdi-india/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/buoyantSimpleFoam"
#7 __libc_start_main in "/lib/tls/i686/cmov/libc.so.6"
#8 Foam::regIOobject::readIfModified() in "/home/rwdi-india/OpenFOAM/OpenFOAM-1.5/applications/bin/linuxGccDPOpt/buoyantSimpleFoam"


It reduced the tolerance on 'h' considerably. But that wouldn't help either. What might be going wrong?
Please keep in mind that there is absolutely no problem in serial run.

Thank you
Prapanj
prapanj is offline   Reply With Quote

Old   April 17, 2009, 08:47
Default
  #2
New Member
 
Oskar
Join Date: Mar 2009
Location: Finland
Posts: 6
Rep Power: 7
oskar is on a distinguished road
I had a similar instability problem.
Getting a openFoam 1.5.x update and compiling seemed to help somewhat.
I also changed to mpi 1.3.0 (mostly due to nVidia driver incompatibility with 1.2.8 disturbing paraView)

But the biggest problem what a 9950 phenom computer being unstable. Would crash at random places when compiling, often crashing opensuse at the same time. Upgrading the bios solved that and now I have no more instability issues. (not sure if it was the TLB bug or tweaked memory usage, not very specific bios documentation)

Don't know how much of this is applicable to your problem, but this worked for me.
oskar is offline   Reply With Quote

Old   April 22, 2009, 08:34
Default upgraded but...
  #3
Senior Member
 
Prapanch Nair
Join Date: Mar 2009
Location: Bangalore, India
Posts: 105
Rep Power: 7
prapanj is on a distinguished road
Hi Oskar,

Thank you for your reply. I was wondering why no one else got the same bug. I have upgraded to OpenFoam-1.5.x. And I still have the bug. And now it shows a sigFpeHandler(int) error. this is different from what was happening earlier. The funny thing is, it is still running fine in serial. I am using buoyantSimpleFoam by the way with compressible turbulence model komegaSST.

I have a question. How do I use git pull to upgrade the 1.5.x source code? coz when I do git pull http:blahblah while inside the OpenFOAM-1.5.x directory, it doesn't work.

I also found my openMPI version is 1.2.6. I don't know how to upgrade to 1.3 as I don't see it in the repository. I am stuck here. Have I actually found a bug?
Any idea?
prapanj is offline   Reply With Quote

Old   April 22, 2009, 08:49
Default
  #4
Senior Member
 
Laurence R. McGlashan
Join Date: Mar 2009
Posts: 370
Rep Power: 13
l_r_mcglashan will become famous soon enough
See this thread. Set floatTransfer to zero in etc/controlDict.
__________________
Laurence R. McGlashan :: Website
l_r_mcglashan is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Large test case for running OpenFoam in parallel fhy OpenFOAM Running, Solving & CFD 22 September 22, 2009 12:13
Superlinear speedup in OpenFOAM 13 msrinath80 OpenFOAM Running, Solving & CFD 17 August 22, 2009 04:59
Parallel performance OpenFoam Vs Fluent prapanj Main CFD Forum 0 March 26, 2009 07:43
Solver crashes (PVM parallel) Marco Müller CFX 2 February 4, 2009 03:51
OpenFOAM 14 stock version parallel bug msrinath80 OpenFOAM Bugs 2 May 30, 2007 15:47


All times are GMT -4. The time now is 09:14.