CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM

mpirun hangup.. can anyone help how to fix mpirun issues.

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   August 4, 2011, 22:55
Default mpirun hangup.. can anyone help how to fix mpirun issues.
  #1
New Member
 
Pam
Join Date: Feb 2011
Posts: 15
Rep Power: 7
prameelar is on a distinguished road
Hi,

I am getting hangups in my mpirun randomly.

The error message i am getting is


"mpirun noticed that process rank 18 with PID 28060 on node amd32-1 exited on signal 1 (Hangup).
--------------------------------------------------------------------------
2 total processes killed (some possibly by mpirun during cleanup)".

Does anybody see this kind of error before?

Any ideas of what needs to be done to resolve this issue.

I appreciate any suggestion.

Thanks in advance.
prameelar is offline   Reply With Quote

Old   August 5, 2011, 02:31
Default
  #2
pit
New Member
 
Join Date: Mar 2010
Posts: 25
Rep Power: 8
pit is on a distinguished road
If you try to run the solver after logout, you should start your job like:
Code:
nohup mpirun -np ...
(nohup=no hangup)
pit is offline   Reply With Quote

Old   August 5, 2011, 04:03
Default
  #3
Senior Member
 
Mohammad
Join Date: Feb 2010
Location: Shiraz, Iran
Posts: 108
Rep Power: 8
m2montazari is on a distinguished road
hi,
I dont know what is your problem exactly! you didnt specify in which situations and when in happens; but parallel running of cases is somewaht crashy at all. I havent experience OpenFOAM crash with mpirun but a lot with FLUENT parallel running. in FLUENT cases, the problem was with my system's RAM. it is better to place same type and capacity RAM in all slots of MB, but if you dont have, be aware of slot numbers and obey it to place them. after that a memtest may be useful to ensure that the problem is or is not with your RAM.

may can help,
m2montazari is offline   Reply With Quote

Old   August 5, 2011, 10:08
Default
  #4
New Member
 
Pam
Join Date: Feb 2011
Posts: 15
Rep Power: 7
prameelar is on a distinguished road
Hi pit,

Thank you for the reply.

I am using nohup command to run the simulation in background.

It seems like it is something related to memory , if I ma not wrong.
prameelar is offline   Reply With Quote

Old   August 5, 2011, 10:13
Default
  #5
New Member
 
Pam
Join Date: Feb 2011
Posts: 15
Rep Power: 7
prameelar is on a distinguished road
Hi Montazari,


I am running a boundary layer simulation with cyclic boundary conditions.
I am running it parallel on 26 processors.
This error message occuring randomly.
I ahve enough RAM capacity.
I am new to OpenFOAM, I didn't get that "memtest", Could you please explain me?

Thanks&Regards.
prameelar is offline   Reply With Quote

Old   August 5, 2011, 10:52
Default
  #6
Member
 
Tony
Join Date: Jun 2010
Posts: 54
Rep Power: 8
tonyuprm is on a distinguished road
Hi,

Which version of OF you're running?

I have run cases with periodic boundary conditions and metis decomposition using the following on the decomposeParDict:

preservePatches (recycle_1 recycle_2);

where recycle_1 and recycle_2 are my cyclic patches.

good luck,

Tony
tonyuprm is offline   Reply With Quote

Old   August 5, 2011, 11:03
Default
  #7
New Member
 
Pam
Join Date: Feb 2011
Posts: 15
Rep Power: 7
prameelar is on a distinguished road
Hi Tony,

I am using OF version 1.7.

I have many different cyclic patches as my mesh is not uniform.
I have 16 spanwise and 46 streamwise cyclic patches. How do I can define them in metis decomposition?

I used simple decomposition for my domain.
prameelar is offline   Reply With Quote

Old   August 5, 2011, 11:44
Default
  #8
Member
 
Tony
Join Date: Jun 2010
Posts: 54
Rep Power: 8
tonyuprm is on a distinguished road
Hi,

I am using 1.7.1 as well,

I have only done this with simple domains (box) and I use the following in my decomposeParDict:

method metis;
preservePatches (recycle_1 recycle_2);

my patches are named recycle_1 and recycle_2

Your patches would go inside preservePatches()

gl,

Tony
tonyuprm is offline   Reply With Quote

Old   August 5, 2011, 12:15
Default
  #9
New Member
 
Pam
Join Date: Feb 2011
Posts: 15
Rep Power: 7
prameelar is on a distinguished road
Thanks Tony,

I will try with metis decomposition.

Thanks alot.

Regards,
Pam.
__________________
Pam
prameelar is offline   Reply With Quote

Old   August 8, 2011, 09:05
Default
  #10
Senior Member
 
Mohammad
Join Date: Feb 2010
Location: Shiraz, Iran
Posts: 108
Rep Power: 8
m2montazari is on a distinguished road
hi pam,
I recommend checking RAM slots and their preferred arrangement of slots on motherboard first of all; then use memtest86+ utility to check memories thoroughly. memtest86+ utility is available in some distributions of linux like ubuntu by default and is available to download for other distributions in its official site. (the utility can be selected in grub menu in ubuntu if it hasnt turned off manually)
m2montazari is offline   Reply With Quote

Old   August 9, 2011, 09:43
Default
  #11
New Member
 
Pam
Join Date: Feb 2011
Posts: 15
Rep Power: 7
prameelar is on a distinguished road
Hi all,

As I found one suggestion as changing the "minimum buffer size" in openfoam/etc/settings.sh file. I modified that and running now...
Till now it is running well.. But not sure how that will be helpful .
__________________
Pam
prameelar is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
HOWTO fix mpirun problem JunaidAhmad OpenFOAM 3 April 29, 2011 13:21


All times are GMT -4. The time now is 15:29.