|
[Sponsors] |
March 9, 2010, 07:31 |
OpenFoam- Infiniband - locks :(
|
#1 |
Senior Member
Thomas Jung
Join Date: Mar 2009
Posts: 102
Rep Power: 17 |
Hello there,
We used on our simulation cluster OpenFOAM 1.4.x over Ethernet. In order to make better use of our cluster and OpenFOAM parallelism we decided to upgrade some nodes to infiniband and at the same time we upgraded the OS from SuSE 10.1 to openSuSE 11.1. The storage used is a netapp over NFS. The netapp resides on our public LAN. The IB distribution used is OFED 1.5 and the frontend plays also the role of Subnet Manager. What we observe now are locks of the frontend and simulation nodes. This locks are taking up to 10-15 minutes. During this time no login onto the nodes and/or frontend are possible. Some time the jobs are also dying during the locks. nfsstat -c show a lot of retransmission on this computers. E.g: Client rpc stats: calls retrans authrefrsh 15873268 1651722867 0 Right now we are out of ideas ...any help will be greatly appreciated... |
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Superlinear speedup in OpenFOAM 13 | msrinath80 | OpenFOAM Running, Solving & CFD | 18 | March 3, 2015 05:36 |
Modified OpenFOAM Forum Structure and New Mailing-List | pete | Site News & Announcements | 0 | June 29, 2009 05:56 |
64bitrhel5 OF installation instructions | mirko | OpenFOAM Installation | 2 | August 12, 2008 18:07 |
Adventure of fisrst openfoam installation on Ubuntu 710 | jussi | OpenFOAM Installation | 0 | April 24, 2008 14:25 |
OpenFOAM Debian packaging current status problems and TODOs | oseen | OpenFOAM Installation | 9 | August 26, 2007 13:50 |