CFD Online Logo CFD Online URL
Home > Forums > Hardware

OpenFoam- Infiniband - locks :(

Register Blogs Members List Search Today's Posts Mark Forums Read

LinkBack Thread Tools Display Modes
Old   March 9, 2010, 08:31
Default OpenFoam- Infiniband - locks :(
Senior Member
Thomas Jung
Join Date: Mar 2009
Posts: 100
Rep Power: 10
tehache is on a distinguished road
Hello there,

We used on our simulation cluster OpenFOAM 1.4.x over Ethernet.
In order to make better use of our cluster and OpenFOAM parallelism we
decided to upgrade some nodes to infiniband and at the same time we upgraded
the OS from SuSE 10.1 to openSuSE 11.1. The storage used is a netapp
over NFS. The netapp resides on our public LAN.
The IB distribution used is OFED 1.5 and the frontend plays also the
role of Subnet Manager.

What we observe now are locks of the frontend and simulation nodes. This
locks are taking up to 10-15 minutes.
During this time no login onto the nodes and/or frontend are possible.
Some time the jobs are also dying during the locks.
nfsstat -c show a lot of retransmission on this computers. E.g:

Client rpc stats:
calls retrans authrefrsh
15873268 1651722867 0

Right now we are out of ideas ...any help will be greatly appreciated...
tehache is offline   Reply With Quote


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Superlinear speedup in OpenFOAM 13 msrinath80 OpenFOAM Running, Solving & CFD 18 March 3, 2015 06:36
Modified OpenFOAM Forum Structure and New Mailing-List pete Site News & Announcements 0 June 29, 2009 05:56
64bitrhel5 OF installation instructions mirko OpenFOAM Installation 2 August 12, 2008 18:07
Adventure of fisrst openfoam installation on Ubuntu 710 jussi OpenFOAM Installation 0 April 24, 2008 14:25
OpenFOAM Debian packaging current status problems and TODOs oseen OpenFOAM Installation 9 August 26, 2007 13:50

All times are GMT -4. The time now is 02:50.