CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Installation

MPI error

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   October 6, 2011, 22:02
Default MPI error
  #1
New Member
 
nawei
Join Date: Apr 2009
Posts: 4
Rep Power: 8
florencenawei is on a distinguished road
Fomers,i compiled OpenFoam on RHEL 5.5,but when i parallel the case ,it shows the error below.i run the same case in my pc with 4 cpus,everything is ok.waiting for your help,i spend almost one month on it.


this is my error message

mgmt.18168ipath_wait_for_device: The /dev/ipath device failed to appear after 30.0 seconds: Connection timed out
mgmt.18168PSM Could not find an InfiniPath Unit on device /dev/ipath (30s elapsed) (err=21)
--------------------------------------------------------------------------
PSM was unable to open an endpoint. Please make sure that the network link is
active on the node and the hardware is functioning.

Error: PSM Could not find an InfiniPath Unit
--------------------------------------------------------------------------
mgmt.18165ipath_wait_for_device: The /dev/ipath device failed to appear after 30.0 seconds: Connection timed out
mgmt.18165PSM Could not find an InfiniPath Unit on device /dev/ipath (30s elapsed) (err=21)
mgmt.18166ipath_wait_for_device: The /dev/ipath device failed to appear after 30.0 seconds: Connection timed out
mgmt.18166PSM Could not find an InfiniPath Unit on device /dev/ipath (30s elapsed) (err=21)
mgmt.18167ipath_wait_for_device: The /dev/ipath device failed to appear after 30.0 seconds: Connection timed out
mgmt.18167PSM Could not find an InfiniPath Unit on device /dev/ipath (30s elapsed) (err=21)
--------------------------------------------------------------------------
It looks like MPI_INIT failed for some reason; your parallel process is
likely to abort. There are many reasons that a parallel process can
fail during MPI_INIT; some of which are due to configuration or environment
problems. This failure appears to be an internal failure; here's some
additional information (which may only be relevant to an Open MPI
developer):

PML add procs failed
--> Returned "Error" (-1) instead of "Success" (0)
--------------------------------------------------------------------------
*** An error occurred in MPI_Init
*** before MPI was initialized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
[mgmt:18168] Abort before MPI_INIT completed successfully; not able to guarantee that all other processes were killed!
*** An error occurred in MPI_Init
*** before MPI was initialized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
[mgmt:18165] Abort before MPI_INIT completed successfully; not able to guarantee that all other processes were killed!
*** An error occurred in MPI_Init
*** before MPI was initialized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
[mgmt:18166] Abort before MPI_INIT completed successfully; not able to guarantee that all other processes were killed!
*** An error occurred in MPI_Init
*** before MPI was initialized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
[mgmt:18167] Abort before MPI_INIT completed successfully; not able to guarantee that all other processes were killed!
--------------------------------------------------------------------------
mpirun has exited due to process rank 1 with PID 18166 on
node mgmt exiting without calling "finalize". This may
have caused other processes in the application to be
terminated by signals sent by mpirun (as reported here).
--------------------------------------------------------------------------
[mgmt:18164] 7 more processes have sent help message help-mtl-psm.txt / unable to open endpoint
[mgmt:18164] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
[mgmt:18164] 3 more processes have sent help message help-mpi-runtime / mpi_init:startup:internal-failure

thanks ,florence
florencenawei is offline   Reply With Quote

Old   October 9, 2011, 07:37
Default
  #2
Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 8,511
Blog Entries: 34
Rep Power: 86
wyldckat is just really nicewyldckat is just really nicewyldckat is just really nicewyldckat is just really nice
Greetings Florence,

This is very little information to work with. So, instead of asking you for more information about your system, I'm just going to try and point you in the right direction:
  1. Check the following posts for ideas to help you to figure out what the problem really is: Segmentation fault in interFoam run through openMPI posts #8 and #10.
  2. Post #21 on the thread decomposed case to 2-cores (Not working) shows how to avoid using certain network connections, which might be useful for your case as well.
  3. For even more information about running OpenFOAM in parallel, here is a blog post where I'm keeping Notes about running OpenFOAM in parallel
Best regards and good luck!
Bruno
wyldckat is offline   Reply With Quote

Old   October 9, 2011, 22:46
Default
  #3
New Member
 
nawei
Join Date: Apr 2009
Posts: 4
Rep Power: 8
florencenawei is on a distinguished road
Quote:
Originally Posted by wyldckat View Post
Greetings Florence,

This is very little information to work with. So, instead of asking you for more information about your system, I'm just going to try and point you in the right direction:
  1. Check the following posts for ideas to help you to figure out what the problem really is: Segmentation fault in interFoam run through openMPI posts #8 and #10.
  2. Post #21 on the thread decomposed case to 2-cores (Not working) shows how to avoid using certain network connections, which might be useful for your case as well.
  3. For even more information about running OpenFOAM in parallel, here is a blog post where I'm keeping Notes about running OpenFOAM in parallel
Best regards and good luck!
Bruno
wyldcakt ,thanks very much ,actually,i know you are a expert on openfoam parallel ,i have seen a lot of posts of you on forums.i am really a new foamer. i spent almost a month on compile openfoam on RHEL. thanks
florencenawei is offline   Reply With Quote

Old   October 10, 2011, 01:21
Default
  #4
New Member
 
nawei
Join Date: Apr 2009
Posts: 4
Rep Power: 8
florencenawei is on a distinguished road
Quote:
Originally Posted by wyldckat View Post
Greetings Florence,

This is very little information to work with. So, instead of asking you for more information about your system, I'm just going to try and point you in the right direction:
  1. Check the following posts for ideas to help you to figure out what the problem really is: Segmentation fault in interFoam run through openMPI posts #8 and #10.
  2. Post #21 on the thread decomposed case to 2-cores (Not working) shows how to avoid using certain network connections, which might be useful for your case as well.
  3. For even more information about running OpenFOAM in parallel, here is a blog post where I'm keeping Notes about running OpenFOAM in parallel
Best regards and good luck!
Bruno
thanks ,Bruno,the second item works!thanks very much . through i am not an natural english user,i wish i could get your email address.
florencenawei is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Compile problem ivanyao OpenFOAM Running, Solving & CFD 1 October 12, 2012 09:31
c++ libraries and solver compiling vaina74 OpenFOAM Installation 13 February 3, 2012 18:43
OpenFOAM 1.7.1 installation problem on OpenSUSE 11.3 flakid OpenFOAM Installation 16 December 28, 2010 09:48
OpenFOAM on MinGW crosscompiler hosted on Linux allenzhao OpenFOAM Installation 127 January 30, 2009 20:08
Error using LaunderGibsonRSTM on SGI ALTIX 4700 jaswi OpenFOAM 2 April 29, 2008 10:54


All times are GMT -4. The time now is 02:49.