CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Installation

[OpenFOAM.org] OpenFOAM 2.4.0 OpenMPI Epoll warning on parallel job

Register Blogs Members List Search Today's Posts Mark Forums Read

Like Tree1Likes
  • 1 Post By wyldckat

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   November 15, 2015, 07:56
Default OpenFOAM 2.4.0 OpenMPI Epoll warning on parallel job
  #1
New Member
 
Tom Alderweireldt
Join Date: Jan 2015
Location: Schilde, Belgium
Posts: 14
Rep Power: 7
Talder is on a distinguished road
Hi,

I ported my existing OpenFOAM cases from version 2.3.0 to 2.4.0.
The 2.4.0 version compiled without issues on a Fedora 23 Linux system.
When I start a parallel test case with :

>> mpirun -np 8 icoFoam -parallel > log &

it starts, but I get the following openmpi related warning:
"[WARN] Epoll ADD(4) on fd 1 failed ..."

The result is that the log file is not written while the case is running. When the job finishes, the log file appears. I can't find anything wrong with the results, but it is annoying that I can't 'tail' the log file during execution to check progress or errors.

Is this a known issue, can anyone suggest a solution ?

Tom.
Talder is offline   Reply With Quote

Old   November 15, 2015, 08:46
Default
  #2
Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,956
Blog Entries: 43
Rep Power: 122
wyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to all
Quick answer: From my blog post: Notes about running OpenFOAM in parallel
Quote:
wyldckat is offline   Reply With Quote

Old   November 15, 2015, 10:41
Default
  #3
New Member
 
Tom Alderweireldt
Join Date: Jan 2015
Location: Schilde, Belgium
Posts: 14
Rep Power: 7
Talder is on a distinguished road
the output indeed only comes out at the end of the mpirun.

It is clearly the same issue as mentioned in the other post you mentioned (thanks for that). However I'm unable to find the 'mca-params.conf' file at the location given in this other post.

Checking mpirun --version gives me 1.8.8
I don't find any /usr/mpi/gcc/openmpi-1.8.8 directory.
A full search gives me 2 locations with a mca-params.conf file
- one in /etc/openmpi-x86_64
- one in /home/myuser/OpenFOAM/Thirdparty-2.4.0/..openmpi-1.8.5/...
unfortunately both are fully commented out, so I don't see what I could change to disable this epoll function.
Talder is offline   Reply With Quote

Old   November 15, 2015, 12:24
Default
  #4
Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,956
Blog Entries: 43
Rep Power: 122
wyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to all
Quick answer: When in doubt, ask Open-MPI:
Code:
ompi_info -a -c > log.ompi_info
Look inside the file "log.ompi_info" and look for two details:
  1. "mca_param_files" - this points out which configuration files are being used.
  2. "opal_event_include" - this points out the currently defined polling mechanism.
As far as I can figure out, the default that works as intended is the setting "poll". If the setting is hard coded into the Open-MPI build, then you will need to set the value in the configuration file as "poll". The other hypothesis is setting in the command line when launching, e.g.:
Code:
mpirun --mca opal_event_include poll ...
dyle likes this.
wyldckat is offline   Reply With Quote

Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
[CGNS] CGNS converters available mbeaudoin OpenFOAM Meshing & Mesh Conversion 137 December 14, 2018 04:20
OpenFOAM v3.0+ ?? SBusch OpenFOAM 22 December 26, 2016 14:24
How to use setField to create sphere sega OpenFOAM Pre-Processing 37 March 11, 2016 11:16
Superlinear speedup in OpenFOAM 13 msrinath80 OpenFOAM Running, Solving & CFD 18 March 3, 2015 05:36
[Gmsh] discretizer - gmshToFoam Andyjoe OpenFOAM Meshing & Mesh Conversion 13 March 14, 2012 04:35


All times are GMT -4. The time now is 19:26.