|March 9, 2010, 08:31||
OpenFoam- Infiniband - locks :(
Join Date: Mar 2009
Posts: 100Rep Power: 10
We used on our simulation cluster OpenFOAM 1.4.x over Ethernet.
In order to make better use of our cluster and OpenFOAM parallelism we
decided to upgrade some nodes to infiniband and at the same time we upgraded
the OS from SuSE 10.1 to openSuSE 11.1. The storage used is a netapp
over NFS. The netapp resides on our public LAN.
The IB distribution used is OFED 1.5 and the frontend plays also the
role of Subnet Manager.
What we observe now are locks of the frontend and simulation nodes. This
locks are taking up to 10-15 minutes.
During this time no login onto the nodes and/or frontend are possible.
Some time the jobs are also dying during the locks.
nfsstat -c show a lot of retransmission on this computers. E.g:
Client rpc stats:
calls retrans authrefrsh
15873268 1651722867 0
Right now we are out of ideas ...any help will be greatly appreciated...
|Thread||Thread Starter||Forum||Replies||Last Post|
|Superlinear speedup in OpenFOAM 13||msrinath80||OpenFOAM Running, Solving & CFD||18||March 3, 2015 06:36|
|Modified OpenFOAM Forum Structure and New Mailing-List||pete||Site News & Announcements||0||June 29, 2009 05:56|
|64bitrhel5 OF installation instructions||mirko||OpenFOAM Installation||2||August 12, 2008 18:07|
|Adventure of fisrst openfoam installation on Ubuntu 710||jussi||OpenFOAM Installation||0||April 24, 2008 14:25|
|OpenFOAM Debian packaging current status problems and TODOs||oseen||OpenFOAM Installation||9||August 26, 2007 13:50|