CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Installation

wmkdep: too many open-files

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   January 12, 2010, 11:21
Exclamation wmkdep: too many open-files
  #1
New Member
 
Patrick Begou
Join Date: Mar 2009
Location: Grenoble, France
Posts: 17
Rep Power: 8
begou is on a distinguished road
I get a problem with wmkdep. This application recurse in the included file to build the dependance list for each file to compile. The algorithm opens many and many files (following the recursivly included files) and reach the system limits.

My default configuration was 100 open files in a session. I asked the admin for an increased limit up to 500, but 500 seams also to low for some OpenFOAM files !

Isn't it posible to modify this behavior of wmkdep ? On some super-computer with a lot of users, administrators may not accept to increase the maximum number of simultanous open files.

OpenFOAM: OpenFOAM-1.6.x
OS: Suse SLES10
Hardware: SGI Altix450


Patrick
begou is offline   Reply With Quote

Old   January 13, 2010, 07:47
Default
  #2
Assistant Moderator
 
Bernhard Gschaider
Join Date: Mar 2009
Posts: 3,915
Rep Power: 40
gschaider will become famous soon enoughgschaider will become famous soon enough
Quote:
Originally Posted by begou View Post
I get a problem with wmkdep. This application recurse in the included file to build the dependance list for each file to compile. The algorithm opens many and many files (following the recursivly included files) and reach the system limits.

My default configuration was 100 open files in a session. I asked the admin for an increased limit up to 500, but 500 seams also to low for some OpenFOAM files !

Isn't it posible to modify this behavior of wmkdep ? On some super-computer with a lot of users, administrators may not accept to increase the maximum number of simultanous open files.

OpenFOAM: OpenFOAM-1.6.x
OS: Suse SLES10
Hardware: SGI Altix450


Patrick
Have you tried "ulimit -n 1000" yourself? That should extend the number for the current shell

Bernhard
gschaider is offline   Reply With Quote

Old   January 13, 2010, 10:08
Default
  #3
New Member
 
Patrick Begou
Join Date: Mar 2009
Location: Grenoble, France
Posts: 17
Rep Power: 8
begou is on a distinguished road
Quote:
Originally Posted by gschaider View Post
Have you tried "ulimit -n 1000" yourself? That should extend the number for the current shell

Bernhard
You can't increase the limit set by the system administrator. You are only allowed to lower it (from 800 to 600 open files for example).
begou is offline   Reply With Quote

Old   January 14, 2010, 03:58
Default
  #4
Senior Member
 
Mark Olesen
Join Date: Mar 2009
Location: http://olesenm.github.io/
Posts: 777
Rep Power: 18
olesen will become famous soon enough
Quote:
Originally Posted by begou View Post
The algorithm opens many and many files (following the recursivly included files) and reach the system limits.
...
Isn't it posible to modify this behavior of wmkdep?
When you change wmkdep, I think that easiest would be to introduce a local (singly) linked list of filenames.

Instead of triggering nextFile() immediately for each "#'include" lex, you would simply add them into the linked-list. When the lexer hits the local EOF, you would then fclose() this file handle before walking through the list.
For each name in the list, open it and repeat the procedure of lexing and creating the linked-list etc.
You would retain the recursive behaviour, the hash table (to avoid unnecessary lookups) but only have a single file handle open ever.

This would not only solve your problem, but if done correctly would also eliminate the current limit of 300 open files that is hard-coded in the wmkdep source.
olesen is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Problems in compiling paraview in Suse 10.3 platform chiven OpenFOAM Installation 3 December 1, 2009 08:21
DxFoam reader update hjasak OpenFOAM Post-Processing 69 April 24, 2008 01:24
OpenFOAM with IBM AIX matthias OpenFOAM Installation 20 March 25, 2008 03:36
Results saving in CFD hawk Main CFD Forum 16 July 21, 2005 20:51
Open old files in a new Gambit version toni FLUENT 2 February 10, 2005 11:31


All times are GMT -4. The time now is 12:00.