CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Installation

Installing_with_Mvapich_infiniband

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   February 12, 2007, 07:16
Default Hi, I wouldl ike to compile f
  #1
Member
 
anne dejoan
Join Date: Mar 2009
Location: madrid, spain
Posts: 66
Rep Power: 8
anne is on a distinguished road
Hi,
I wouldl ike to compile from scratch OpenFoan
on a cluster with inifiband making use of mvapich
and gcc 3.4.6, So RedHat).
These are the only options I have,

Is anyone using mvapich ?

I have seen that with infiniband OpenMpi was mainly used...

If you have any informations I will be happy
to read them,

Thanks

Anne
anne is offline   Reply With Quote

Old   February 15, 2007, 16:11
Default Hi, why don't you use gcc 4.1
  #2
Senior Member
 
Francesco Del Citto
Join Date: Mar 2009
Location: Zürich Area, Switzerland
Posts: 215
Rep Power: 9
fra76 is on a distinguished road
Hi,
why don't you use gcc 4.1.1 distributed with OpenFOAM? You only have to download the pre-compiled version, and it works!
On red-hat machines you can ask your system administrator to install gcc4 (it's distributed with red-hat, but it's not part of the standard installation). However I believe the first option is better.
Concerning MPI, I've just been able to run OpenFOAM on a Quadrics network (really astonishingly fast! Many surprises from a very super-linear speedup curve!)
Well, I've just followed what written here
http://www.cfd-online.com/cgi-bin/Op...how.cgi?1/3814
You don't have to recompile everything, but only the communication library. Change some environment variable and everything works perfectly!
Great software architecture. Many compliments to the developers!
Francesco
fra76 is offline   Reply With Quote

Old   February 16, 2007, 11:36
Default Hello Francesco, You answer
  #3
Member
 
anne dejoan
Join Date: Mar 2009
Location: madrid, spain
Posts: 66
Rep Power: 8
anne is on a distinguished road
Hello Francesco,

You answer sounds encouraging!

I am not sure that my administrator will install gcc4. The inifiband was just installed and at the moment we are quite compulsory to use what is there on and no so that more.

When I connect to the http address you tagetted it does not correspond to our subject.
Actually, I have in the past tried to switch the communication library but without succes. So I would be interested if you could indicate
me the steps to do it.


Thank You

anne
anne is offline   Reply With Quote

Old   February 19, 2007, 05:37
Default Right, wrong link... This sho
  #4
Senior Member
 
Francesco Del Citto
Join Date: Mar 2009
Location: Zürich Area, Switzerland
Posts: 215
Rep Power: 9
fra76 is on a distinguished road
Right, wrong link...
This shoud be the right one: http://www.cfd-online.com/OpenFOAM_D...ges/1/716.html
Regarding gcc, just use the one distributed with OpenFOAM!
Good luck, and don't hesitate to ask anything else.
Francesco
fra76 is offline   Reply With Quote

Old   March 7, 2007, 04:55
Default Hello Francesco, I have now
  #5
Member
 
anne dejoan
Join Date: Mar 2009
Location: madrid, spain
Posts: 66
Rep Power: 8
anne is on a distinguished road
Hello Francesco,

I have now installed OpenFOAM 1.3 compiled with gcc4 on my inifinband cluster.

I have re-compiled the parrallel library libPstream by putting the mvapich installed on the cluster.

The link of libraries looks ok (I checked some
with executables with the ldd command).

HOWEVER, when I compile an application (that
used to work on an another computer) I have the following trouble:

------------------------------------------------------
make: No se hace nada para `allFiles'.
make: `Make/linuxGcc4DPOpt/dependencies' está actualizado.

/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/wmake/tcshScripts/mkObjectDir /afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/applications/bin/linuxGcc4DPOpt /laplacianFoam
g++ -m32 -Dlinux -DDP -Wall -W -Wno-unused-parameter -Wold-style-cast -O3 -DNoRepository -ftemplate-depth-30 -I/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/src/finiteVolume/lnInclude -I/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/src/OpenFOAM/lnInclude -IlnInclude -I. -fPIC -pthread Make/linuxGcc4DPOpt/laplacianFoam.o -L/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt \
-lfiniteVolume -lOpenFOAM -liberty -o /afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/applications/bin/linuxGcc4DPOpt /laplacianFoam
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_alloc_pd' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_close_device' sin definir/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich /libPstream.so: referencia a `ibv_free_device_list' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_destroy_srq' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_destroy_cq' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_destroy_qp' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_query_port' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_dealloc_pd' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_ack_async_event' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_modify_qp' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_get_device_name' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_reg_mr' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_create_cq' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_open_device' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_create_qp' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_dereg_mr' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_get_async_event' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_modify_srq' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_get_device_list' sin definir
/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/lib/linuxGcc4DPOpt/mpich/libPst ream.so: referencia a `ibv_create_srq' sin definir
collect2: ld returned 1 exit status
make: *** [/afs/ciemat.es/users/u5303/OpenFOAM/OpenFOAM-1.3/applications/bin/linuxGcc4DPOp t/laplacianFoam] Error 1
---------------------------------------------

which means that apparently some references are not defined.

The mpich library is now the mvapich-0.9.7-mlx2.2.0 .



I have read on the threat that some people make use of openmpi + inifinband?

What did you use: mvapich or openmpi+infiniband ??


Thanks you,

Anne
anne is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 16:52.