CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > OpenFOAM Bugs

DecomposePar links against liblamso0 with OpenMPI

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   April 16, 2007, 09:05
Default Description: decomposePar ask
  #1
Senior Member
 
Jens Klostermann
Join Date: Mar 2009
Posts: 117
Rep Power: 8
jens_klostermann is on a distinguished road
Description:
decomposePar asks for liblam.so.0 if OpenMPI is set for multiprocessor comunication

decomposePar: error while loading shared libraries: liblam.so.0: cannot open shared object file: No such file or directory

Solver/Application:
decomposePar

Source file:

Testcase:
damBreak4phaseFine (or all other)

Platform:
all

Version:
OF-1.4

Notes:
If I change back to lam decomposing works fine.
Why does the decomposePar try to link against to this obvious lam library and where should I look to fix it?

Jens
jens_klostermann is offline   Reply With Quote

Old   April 16, 2007, 09:17
Default It may be a consequence of dec
  #2
Senior Member
 
Join Date: Mar 2009
Posts: 854
Rep Power: 13
henry is on a distinguished road
It may be a consequence of decomposePar indirectly linking libparmetis.so which links the mpi libraries direcly rather then indirectly using the Pstream library as for the rest of the OpenFOAM applications. This problem could be avoided by linking only the metis library in the decompositionMethod library and removing the parMetisDecomp/parMetisDecomp.C file from the files. Alternatively you could recompile the parMetis library in decompositionMethods with OpenMPI.

Henry
henry is offline   Reply With Quote

Old   April 16, 2007, 14:12
Default Hi, Henry, I am using GAMMA
  #3
Senior Member
 
Pei-Ying Hsieh
Join Date: Mar 2009
Posts: 317
Rep Power: 9
hsieh is on a distinguished road
Hi, Henry,

I am using GAMMA. I have the same problem. Do I need to recompile parMetis library with OpenMPI still? What do I have to change to link parMetis library with OpenMPI? Thanks!

Pei
hsieh is offline   Reply With Quote

Old   April 16, 2007, 14:24
Default Do an Allwmake in utilities/pa
  #4
Super Moderator
 
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,416
Rep Power: 16
mattijs is on a distinguished road
Do an Allwmake in utilities/parallelProcessing/decompositionMethods/

It will use the current wmake rules to pick up the same mpi files as the Pstream library.
mattijs is offline   Reply With Quote

Old   April 17, 2007, 13:45
Default Hi, Mattijs, I did the Allw
  #5
Senior Member
 
Pei-Ying Hsieh
Join Date: Mar 2009
Posts: 317
Rep Power: 9
hsieh is on a distinguished road
Hi, Mattijs,

I did the Allwmake. But, got the following errors.

Pei
----------------
phsieh@sun:~/OpenFOAM/OpenFOAM-1.4/applications/utilities/parallelProcessing/decomposition Methods> ./Allwmake
+ wmake libso parMetisDecomp/ParMetis-3.1/METISLib
Making dependency list for source file coarsen.c
Making dependency list for source file fm.c
Making dependency list for source file initpart.c
Making dependency list for source file match.c
Making dependency list for source file ccgraph.c
Making dependency list for source file pmetis.c
Making dependency list for source file pqueue.c
Making dependency list for source file refine.c
Making dependency list for source file util.c
Making dependency list for source file timing.c
Making dependency list for source file debug.c
Making dependency list for source file bucketsort.c
Making dependency list for source file graph.c
Making dependency list for source file stat.c
Making dependency list for source file kmetis.c
Making dependency list for source file kwayrefine.c
Making dependency list for source file kwayfm.c
Making dependency list for source file balance.c
Making dependency list for source file ometis.c
Making dependency list for source file srefine.c
Making dependency list for source file sfm.c
Making dependency list for source file separator.c
Making dependency list for source file mincover.c
Making dependency list for source file mmd.c
Making dependency list for source file mesh.c
Making dependency list for source file meshpart.c
Making dependency list for source file frename.c
Making dependency list for source file fortran.c
Making dependency list for source file myqsort.c
Making dependency list for source file compress.c
Making dependency list for source file parmetis.c
Making dependency list for source file estmem.c
Making dependency list for source file mpmetis.c
Making dependency list for source file mcoarsen.c
Making dependency list for source file mmatch.c
Making dependency list for source file minitpart.c
Making dependency list for source file mbalance.c
Making dependency list for source file mutil.c
Making dependency list for source file mkmetis.c
Making dependency list for source file mkwayrefine.c
Making dependency list for source file mkwayfmh.c
Making dependency list for source file mrefine2.c
Making dependency list for source file minitpart2.c
Making dependency list for source file mbalance2.c
Making dependency list for source file mfm2.c
Making dependency list for source file kvmetis.c
Making dependency list for source file kwayvolrefine.c
Making dependency list for source file kwayvolfm.c
Making dependency list for source file subdomains.c
Making dependency list for source file mfm.c
Making dependency list for source file memory.c
Making dependency list for source file mrefine.c
Making dependency list for source file checkgraph.c
SOURCE=coarsen.c ; gcc -m64 -Dlinux64 -DDP -Wall -march=opteron -O3 -fno-gcse -I/usr/include -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/coarsen.o
In file included from lnInclude/metis.h:25,
from coarsen.c:13:
./../parmetis.h:17:17: error: mpi.h: No such file or directory
In file included from lnInclude/metis.h:25,
from coarsen.c:13:
./../parmetis.h:59: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:65: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:68: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:74: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:78: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:84: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:88: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:94: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:104: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:109: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:112: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:117: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:122: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:127: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:132: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:142: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:146: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:150: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:160: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:164: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:168: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:172: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:176: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:180: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:184: error: expected declaration specifiers or ??..??before ?PI_Comm??make: *** [Make/linux64Gcc4DPOpt/coarsen.o] Error 1
+ wmake libso parMetisDecomp/ParMetis-3.1/ParMETISLib
Making dependency list for source file comm.c
Making dependency list for source file util.c
Making dependency list for source file debug.c
Making dependency list for source file setup.c
Making dependency list for source file grsetup.c
Making dependency list for source file timer.c
Making dependency list for source file node_refine.c
Making dependency list for source file initmsection.c
Making dependency list for source file order.c
Making dependency list for source file xyzpart.c
Making dependency list for source file pspases.c
Making dependency list for source file frename.c
Making dependency list for source file iintsort.c
Making dependency list for source file iidxsort.c
Making dependency list for source file ikeysort.c
Making dependency list for source file ikeyvalsort.c
Making dependency list for source file kmetis.c
Making dependency list for source file gkmetis.c
Making dependency list for source file ometis.c
Making dependency list for source file initpart.c
Making dependency list for source file match.c
Making dependency list for source file coarsen.c
Making dependency list for source file kwayfm.c
Making dependency list for source file kwayrefine.c
Making dependency list for source file kwaybalance.c
Making dependency list for source file remap.c
Making dependency list for source file stat.c
Making dependency list for source file fpqueue.c
Making dependency list for source file ametis.c
Making dependency list for source file rmetis.c
Making dependency list for source file lmatch.c
Making dependency list for source file initbalance.c
Making dependency list for source file mdiffusion.c
Making dependency list for source file diffutil.c
Making dependency list for source file wave.c
Making dependency list for source file csrmatch.c
Making dependency list for source file redomylink.c
Making dependency list for source file balancemylink.c
Making dependency list for source file selectq.c
Making dependency list for source file akwayfm.c
Making dependency list for source file serial.c
Making dependency list for source file move.c
Making dependency list for source file mmetis.c
Making dependency list for source file mesh.c
Making dependency list for source file memory.c
Making dependency list for source file weird.c
Making dependency list for source file backcompat.c
SOURCE=comm.c ; gcc -m64 -Dlinux64 -DDP -Wall -march=opteron -O3 -fno-gcse -I/usr/include -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/comm.o
In file included from lnInclude/parmetislib.h:19,
from comm.c:11:
lnInclude/stdheaders.h:24:17: error: mpi.h: No such file or directory
In file included from lnInclude/parmetislib.h:20,
from comm.c:11:
./../parmetis.h:59: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:65: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:68: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:74: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:78: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:84: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:88: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:94: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:104: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:109: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:112: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:117: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:122: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:127: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:132: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:142: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:146: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:150: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:160: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:164: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:168: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:172: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:176: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:180: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:184: error: expected declaration specifiers or ??..??before ?PI_Comm??In file included from lnInclude/parmetislib.h:28,
from comm.c:11:
lnInclude/struct.h:258: error: expected specifier-qualifier-list before ?PI_Comm??In file included from lnInclude/parmetislib.h:30,
from comm.c:11:
lnInclude/proto.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:282: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:321: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:323: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:324: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:326: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:330: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:331: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:332: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:335: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:338: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:339: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:340: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:341: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:345: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:348: error: expected declaration specifiers or ??..??before ?PI_Comm??comm.c: In function ?ommInterfaceData__??
comm.c:34: warning: implicit declaration of function ?PI_Irecv??comm.c:34: error: ?PI_INT??undeclared (first use in this function)
comm.c:34: error: (Each undeclared identifier is reported only once
comm.c:34: error: for each function it appears in.)
comm.c:35: error: ?trlType??has no member named ?omm??comm.c:35: error: ?trlType??has no member named ?req??comm.c:44: warning: implicit declaration of function ?PI_Isend??comm.c:45: error: ?trlType??has no member named ?omm??comm.c:45: error: ?trlType??has no member named ?req??comm.c:49: warning: implicit declaration of function ?PI_Waitall??comm.c:49: error: ?trlType??has no member named ?req??comm.c:49: error: ?trlType??has no member named ?tatuses??comm.c:50: error: ?trlType??has no member named ?req??comm.c:50: error: ?trlType??has no member named ?tatuses??comm.c: In function ?ommChangedInterfaceData__??
comm.c:80: error: ?PI_INT??undeclared (first use in this function)
comm.c:81: error: ?trlType??has no member named ?omm??comm.c:81: error: ?trlType??has no member named ?req??comm.c:100: error: ?trlType??has no member named ?omm??comm.c:100: error: ?trlType??has no member named ?req??comm.c:105: error: ?trlType??has no member named ?omm??comm.c:105: error: ?trlType??has no member named ?req??comm.c:110: warning: implicit declaration of function ?PI_Wait??comm.c:110: error: ?trlType??has no member named ?req??comm.c:110: error: ?trlType??has no member named ?tatus??comm.c:111: warning: implicit declaration of function ?PI_Get_count??comm.c:111: error: ?trlType??has no member named ?tatus??comm.c:120: error: ?trlType??has no member named ?req??comm.c:120: error: ?trlType??has no member named ?tatuses??comm.c: In function ?lobalSEMax__??
comm.c:132: warning: implicit declaration of function ?PI_Allreduce??comm.c:132: error: ?PI_INT??undeclared (first use in this function)
comm.c:132: error: ?PI_MAX??undeclared (first use in this function)
comm.c:132: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMaxDouble__??
comm.c:144: error: ?PI_DOUBLE??undeclared (first use in this function)
comm.c:144: error: ?PI_MAX??undeclared (first use in this function)
comm.c:144: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMin__??
comm.c:158: error: ?PI_INT??undeclared (first use in this function)
comm.c:158: error: ?PI_MIN??undeclared (first use in this function)
comm.c:158: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSESum__??
comm.c:170: error: ?PI_INT??undeclared (first use in this function)
comm.c:170: error: ?PI_SUM??undeclared (first use in this function)
comm.c:170: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMaxFloat__??
comm.c:183: error: ?PI_FLOAT??undeclared (first use in this function)
comm.c:183: error: ?PI_MAX??undeclared (first use in this function)
comm.c:183: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMinFloat__??
comm.c:197: error: ?PI_FLOAT??undeclared (first use in this function)
comm.c:197: error: ?PI_MIN??undeclared (first use in this function)
comm.c:197: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSESumFloat__??
comm.c:209: error: ?PI_FLOAT??undeclared (first use in this function)
comm.c:209: error: ?PI_SUM??undeclared (first use in this function)
comm.c:209: error: ?trlType??has no member named ?omm??make: *** [Make/linux64Gcc4DPOpt/comm.o] Error 1
+ wmake libso
Making dependency list for source file decompositionMethod/decompositionMethod.C
Making dependency list for source file geomDecomp/geomDecomp.C
Making dependency list for source file simpleGeomDecomp/simpleGeomDecomp.C
Making dependency list for source file hierarchGeomDecomp/hierarchGeomDecomp.C
Making dependency list for source file metisDecomp/metisDecomp.C
Making dependency list for source file manualDecomp/manualDecomp.C
Making dependency list for source file parMetisDecomp/parMetisDecomp.C
SOURCE=decompositionMethod/decompositionMethod.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/decompositionMethod.o
SOURCE=geomDecomp/geomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/geomDecomp.o
SOURCE=simpleGeomDecomp/simpleGeomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/simpleGeomDecomp.o
SOURCE=hierarchGeomDecomp/hierarchGeomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/hierarchGeomDecomp.o
SOURCE=metisDecomp/metisDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/metisDecomp.o
In file included from lnInclude/metis.h:25,
from metisDecomp/metisDecomp.C:36:
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:17:17: error: mpi.h: No such file or directory
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:59: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:65: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:68: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:74: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:78: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:84: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:88: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:94: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:104: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:109: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:112: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:117: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:122: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:127: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:132: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:137: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:142: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:146: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:150: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:160: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:164: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:168: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:172: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:176: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:180: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:184: error: ?PI_Comm??has not been declared
make: *** [Make/linux64Gcc4DPOpt/metisDecomp.o] Error 1
phsieh@sun:~/OpenFOAM/OpenFOAM-1.4/applications/utilities/parallelProcessing/decomposition Methods>
hsieh is offline   Reply With Quote

Old   April 17, 2007, 14:06
Default If you can live without Metis/
  #6
Super Moderator
 
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,416
Rep Power: 16
mattijs is on a distinguished road
If you can live without Metis/ParMetis:

in parallelProcessing/decompositionMethods:
1) in Allwmake comment out wmake libso of all Metis stuff:

#wmake libso parMetisDecomp/ParMetis-3.1/METISLib
#wmake libso parMetisDecomp/ParMetis-3.1/ParMETISLib
#wmake libso metisDecomp/metis-4.0/Lib

2) in Make/files comment out lines for metisDecomp.C, parMetisDecomp.C

3) in Make/options comment out whole LIB_LIBS line.
mattijs is offline   Reply With Quote

Old   April 17, 2007, 15:41
Default Hi, Mattijs, I have done wh
  #7
Senior Member
 
Pei-Ying Hsieh
Join Date: Mar 2009
Posts: 317
Rep Power: 9
hsieh is on a distinguished road
Hi, Mattijs,

I have done what you suggested and Allwmake was successful. But, now, when I tried to run decomposePar, I got "command not found" (even after a reboot of the cluster).

Any idea?

Pei
hsieh is offline   Reply With Quote

Old   April 18, 2007, 03:37
Default Possibly it didn't get rebuilt
  #8
Super Moderator
 
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,416
Rep Power: 16
mattijs is on a distinguished road
Possibly it didn't get rebuilt before since the libdecompositionMethods.so wasn't built?

What happens if you rebuild it?

cd $FOAM_UTILITIES/parallelProcessing/decomposePar

wmake
mattijs is offline   Reply With Quote

Old   April 18, 2007, 09:20
Default Thanks a lot Mattijs! It wo
  #9
Senior Member
 
Pei-Ying Hsieh
Join Date: Mar 2009
Posts: 317
Rep Power: 9
hsieh is on a distinguished road
Thanks a lot Mattijs!

It worked.

Pei
hsieh is offline   Reply With Quote

Old   June 28, 2007, 15:45
Default Hi, I finally got OF-1.4 co
  #10
Senior Member
 
Jens Klostermann
Join Date: Mar 2009
Posts: 117
Rep Power: 8
jens_klostermann is on a distinguished road
Hi,

I finally got OF-1.4 compiled with openmpi (infinyband: mvapi) running and an Allwmake in utilities/parallelProcessing/decompositionMethods also just worked fine.

but a decompositition with parMetis gives the following error:

Selecting decompositionMethod parMetis
*** An error occurred in MPI_comm_size
*** before MPI was initialized
*** MPI_ERRORS_ARE_FATAL (goodbye)
[stokes:12178] Abort before MPI_INIT completed successfully; not able to guarantee that all other processes were killed!

Has anybody an idea, where to dig further?

Jens
jens_klostermann is offline   Reply With Quote

Old   June 28, 2007, 16:15
Default Are you running in parallel (-
  #11
Super Moderator
 
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,416
Rep Power: 16
mattijs is on a distinguished road
Are you running in parallel (-parallel)? parMetis only makes sense when running redistributeMeshPar.

If this is the case try compiling the decompositionMethod library with debug info (-DFULLDEBUG -g -O0 in EXE_INC in Make/options)
mattijs is offline   Reply With Quote

Old   June 28, 2007, 17:51
Default Hi Mattijs No I didn't. So
  #12
Senior Member
 
Jens Klostermann
Join Date: Mar 2009
Posts: 117
Rep Power: 8
jens_klostermann is on a distinguished road
Hi Mattijs

No I didn't. So this should solve the problem?!
But As you might guess, I still have problem with the concepts and usage(syntax for using) of parMetis. Can please you give me some hints, what the (dis)advantages over normal metis are.

Thanks Jens
jens_klostermann is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
DecomposePar jadavis1 OpenFOAM Running, Solving & CFD 0 January 28, 2009 16:07
CFD and CFX links... JP CFX 1 July 22, 2008 09:24
Two Turbulence Categories links Michail CFD-Wiki 1 January 21, 2008 03:16
Please help with making links Michail CFD-Wiki 3 October 15, 2005 17:35
is it laminar or is it not (links included)... Dean Schrage Main CFD Forum 7 September 7, 2001 19:57


All times are GMT -4. The time now is 10:03.