OF 141 and MVAPICH2

msrinath80 · November 7, 2007, 11:38

I've built OpenFOAM 1.4.1 with MVAPICH2 support. I am in the process of testing infiniband performance. Can someone tell me if it is OK to rebuild OpenFOAM using mpicc and mpicxx as opposed to plain gcc and g++? Will that cause any problems ?

fra76 · November 7, 2007, 11:47

I guess you only need to recompile Pstream in order to use a different interconnection...

Try to look for this topic in the forum, it was very helpful to me.

If you don't find anything useful, I can describe how I set it up. it's not Infiniband, but the procedure to follow should be the same.

Good luck!
Francesco

msrinath80 · November 7, 2007, 12:00

Well yes, I have rebuilt Pstream for MVAPICH2 support. But I had to use mpicc and mpicxx to do it. If I build it with gcc/g++, even though it completes the compilation without problems I am unable to launch the parallel process. So I was wondering if it would be a good idea to rebuild the entire OF distribution using mpicc and mpicxx instead of just Pstream. Am I making any sense here?

fra76 · November 7, 2007, 12:10

Well, I had to set somemething in OpenFOAM-1.4.1/.OpenFOAM-1.4.1/bashrc and in OpenFOAM-1.4.1/.bashrc, plus something in the wmake rules and the Allwmake in Pstream directory.
After that, I had no problem.

What you are probably missing is a "Addlib /path/to/your/mpi/lib" in the OpenFOAM-1.4.1/.bashrc file, I guess.

However, I don't think you need to recompile OpenFOAM entirely.

November 7, 2007, 11:38	I've built OpenFOAM 1.4.1 with	#1
msrinath80 Senior Member Srinath Madhavan (a.k.a pUl\|) Join Date: Mar 2009 Location: Edmonton, AB, Canada Posts: 703 Rep Power: 21	I've built OpenFOAM 1.4.1 with MVAPICH2 support. I am in the process of testing infiniband performance. Can someone tell me if it is OK to rebuild OpenFOAM using mpicc and mpicxx as opposed to plain gcc and g++? Will that cause any problems ?

November 7, 2007, 11:47	I guess you only need to recom	#2
fra76 Senior Member Francesco Del Citto Join Date: Mar 2009 Location: Zürich Area, Switzerland Posts: 237 Rep Power: 18	I guess you only need to recompile Pstream in order to use a different interconnection... Try to look for this topic in the forum, it was very helpful to me. If you don't find anything useful, I can describe how I set it up. it's not Infiniband, but the procedure to follow should be the same. Good luck! Francesco

November 7, 2007, 12:00	Well yes, I have rebuilt Pstre	#3
msrinath80 Senior Member Srinath Madhavan (a.k.a pUl\|) Join Date: Mar 2009 Location: Edmonton, AB, Canada Posts: 703 Rep Power: 21	Well yes, I have rebuilt Pstream for MVAPICH2 support. But I had to use mpicc and mpicxx to do it. If I build it with gcc/g++, even though it completes the compilation without problems I am unable to launch the parallel process. So I was wondering if it would be a good idea to rebuild the entire OF distribution using mpicc and mpicxx instead of just Pstream. Am I making any sense here?

November 7, 2007, 12:10	Well, I had to set somemething	#4
fra76 Senior Member Francesco Del Citto Join Date: Mar 2009 Location: Zürich Area, Switzerland Posts: 237 Rep Power: 18	Well, I had to set somemething in OpenFOAM-1.4.1/.OpenFOAM-1.4.1/bashrc and in OpenFOAM-1.4.1/.bashrc, plus something in the wmake rules and the Allwmake in Pstream directory. After that, I had no problem. What you are probably missing is a "Addlib /path/to/your/mpi/lib" in the OpenFOAM-1.4.1/.bashrc file, I guess. However, I don't think you need to recompile OpenFOAM entirely.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
MVAPICH2 SIGEMT error	kumar2	OpenFOAM Running, Solving & CFD	0	May 26, 2007 18:24