CFD Online Discussion Forums

CFD Online Discussion Forums (https://www.cfd-online.com/Forums/)
-   OpenFOAM Bugs (https://www.cfd-online.com/Forums/openfoam-bugs/)
-   -   DecomposePar links against liblamso0 with OpenMPI (https://www.cfd-online.com/Forums/openfoam-bugs/62569-decomposepar-links-against-liblamso0-openmpi.html)

jens_klostermann April 16, 2007 09:05

Description: decomposePar ask
 
Description:
decomposePar asks for liblam.so.0 if OpenMPI is set for multiprocessor comunication

decomposePar: error while loading shared libraries: liblam.so.0: cannot open shared object file: No such file or directory

Solver/Application:
decomposePar

Source file:

Testcase:
damBreak4phaseFine (or all other)

Platform:
all

Version:
OF-1.4

Notes:
If I change back to lam decomposing works fine.
Why does the decomposePar try to link against to this obvious lam library and where should I look to fix it?

Jens

henry April 16, 2007 09:17

It may be a consequence of dec
 
It may be a consequence of decomposePar indirectly linking libparmetis.so which links the mpi libraries direcly rather then indirectly using the Pstream library as for the rest of the OpenFOAM applications. This problem could be avoided by linking only the metis library in the decompositionMethod library and removing the parMetisDecomp/parMetisDecomp.C file from the files. Alternatively you could recompile the parMetis library in decompositionMethods with OpenMPI.

Henry

hsieh April 16, 2007 14:12

Hi, Henry, I am using GAMMA
 
Hi, Henry,

I am using GAMMA. I have the same problem. Do I need to recompile parMetis library with OpenMPI still? What do I have to change to link parMetis library with OpenMPI? Thanks!

Pei

mattijs April 16, 2007 14:24

Do an Allwmake in utilities/pa
 
Do an Allwmake in utilities/parallelProcessing/decompositionMethods/

It will use the current wmake rules to pick up the same mpi files as the Pstream library.

hsieh April 17, 2007 13:45

Hi, Mattijs, I did the Allw
 
Hi, Mattijs,

I did the Allwmake. But, got the following errors.

Pei
----------------
phsieh@sun:~/OpenFOAM/OpenFOAM-1.4/applications/utilities/parallelProcessing/decomposition Methods> ./Allwmake
+ wmake libso parMetisDecomp/ParMetis-3.1/METISLib
Making dependency list for source file coarsen.c
Making dependency list for source file fm.c
Making dependency list for source file initpart.c
Making dependency list for source file match.c
Making dependency list for source file ccgraph.c
Making dependency list for source file pmetis.c
Making dependency list for source file pqueue.c
Making dependency list for source file refine.c
Making dependency list for source file util.c
Making dependency list for source file timing.c
Making dependency list for source file debug.c
Making dependency list for source file bucketsort.c
Making dependency list for source file graph.c
Making dependency list for source file stat.c
Making dependency list for source file kmetis.c
Making dependency list for source file kwayrefine.c
Making dependency list for source file kwayfm.c
Making dependency list for source file balance.c
Making dependency list for source file ometis.c
Making dependency list for source file srefine.c
Making dependency list for source file sfm.c
Making dependency list for source file separator.c
Making dependency list for source file mincover.c
Making dependency list for source file mmd.c
Making dependency list for source file mesh.c
Making dependency list for source file meshpart.c
Making dependency list for source file frename.c
Making dependency list for source file fortran.c
Making dependency list for source file myqsort.c
Making dependency list for source file compress.c
Making dependency list for source file parmetis.c
Making dependency list for source file estmem.c
Making dependency list for source file mpmetis.c
Making dependency list for source file mcoarsen.c
Making dependency list for source file mmatch.c
Making dependency list for source file minitpart.c
Making dependency list for source file mbalance.c
Making dependency list for source file mutil.c
Making dependency list for source file mkmetis.c
Making dependency list for source file mkwayrefine.c
Making dependency list for source file mkwayfmh.c
Making dependency list for source file mrefine2.c
Making dependency list for source file minitpart2.c
Making dependency list for source file mbalance2.c
Making dependency list for source file mfm2.c
Making dependency list for source file kvmetis.c
Making dependency list for source file kwayvolrefine.c
Making dependency list for source file kwayvolfm.c
Making dependency list for source file subdomains.c
Making dependency list for source file mfm.c
Making dependency list for source file memory.c
Making dependency list for source file mrefine.c
Making dependency list for source file checkgraph.c
SOURCE=coarsen.c ; gcc -m64 -Dlinux64 -DDP -Wall -march=opteron -O3 -fno-gcse -I/usr/include -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/coarsen.o
In file included from lnInclude/metis.h:25,
from coarsen.c:13:
./../parmetis.h:17:17: error: mpi.h: No such file or directory
In file included from lnInclude/metis.h:25,
from coarsen.c:13:
./../parmetis.h:59: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:65: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:68: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:74: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:78: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:84: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:88: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:94: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:104: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:109: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:112: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:117: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:122: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:127: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:132: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:142: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:146: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:150: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:160: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:164: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:168: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:172: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:176: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:180: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:184: error: expected declaration specifiers or ??..??before ?PI_Comm??make: *** [Make/linux64Gcc4DPOpt/coarsen.o] Error 1
+ wmake libso parMetisDecomp/ParMetis-3.1/ParMETISLib
Making dependency list for source file comm.c
Making dependency list for source file util.c
Making dependency list for source file debug.c
Making dependency list for source file setup.c
Making dependency list for source file grsetup.c
Making dependency list for source file timer.c
Making dependency list for source file node_refine.c
Making dependency list for source file initmsection.c
Making dependency list for source file order.c
Making dependency list for source file xyzpart.c
Making dependency list for source file pspases.c
Making dependency list for source file frename.c
Making dependency list for source file iintsort.c
Making dependency list for source file iidxsort.c
Making dependency list for source file ikeysort.c
Making dependency list for source file ikeyvalsort.c
Making dependency list for source file kmetis.c
Making dependency list for source file gkmetis.c
Making dependency list for source file ometis.c
Making dependency list for source file initpart.c
Making dependency list for source file match.c
Making dependency list for source file coarsen.c
Making dependency list for source file kwayfm.c
Making dependency list for source file kwayrefine.c
Making dependency list for source file kwaybalance.c
Making dependency list for source file remap.c
Making dependency list for source file stat.c
Making dependency list for source file fpqueue.c
Making dependency list for source file ametis.c
Making dependency list for source file rmetis.c
Making dependency list for source file lmatch.c
Making dependency list for source file initbalance.c
Making dependency list for source file mdiffusion.c
Making dependency list for source file diffutil.c
Making dependency list for source file wave.c
Making dependency list for source file csrmatch.c
Making dependency list for source file redomylink.c
Making dependency list for source file balancemylink.c
Making dependency list for source file selectq.c
Making dependency list for source file akwayfm.c
Making dependency list for source file serial.c
Making dependency list for source file move.c
Making dependency list for source file mmetis.c
Making dependency list for source file mesh.c
Making dependency list for source file memory.c
Making dependency list for source file weird.c
Making dependency list for source file backcompat.c
SOURCE=comm.c ; gcc -m64 -Dlinux64 -DDP -Wall -march=opteron -O3 -fno-gcse -I/usr/include -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/comm.o
In file included from lnInclude/parmetislib.h:19,
from comm.c:11:
lnInclude/stdheaders.h:24:17: error: mpi.h: No such file or directory
In file included from lnInclude/parmetislib.h:20,
from comm.c:11:
./../parmetis.h:59: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:65: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:68: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:74: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:78: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:84: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:88: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:94: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:104: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:109: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:112: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:117: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:122: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:127: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:132: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:142: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:146: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:150: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:160: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:164: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:168: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:172: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:176: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:180: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:184: error: expected declaration specifiers or ??..??before ?PI_Comm??In file included from lnInclude/parmetislib.h:28,
from comm.c:11:
lnInclude/struct.h:258: error: expected specifier-qualifier-list before ?PI_Comm??In file included from lnInclude/parmetislib.h:30,
from comm.c:11:
lnInclude/proto.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:282: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:321: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:323: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:324: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:326: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:330: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:331: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:332: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:335: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:338: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:339: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:340: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:341: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:345: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:348: error: expected declaration specifiers or ??..??before ?PI_Comm??comm.c: In function ?ommInterfaceData__??
comm.c:34: warning: implicit declaration of function ?PI_Irecv??comm.c:34: error: ?PI_INT??undeclared (first use in this function)
comm.c:34: error: (Each undeclared identifier is reported only once
comm.c:34: error: for each function it appears in.)
comm.c:35: error: ?trlType??has no member named ?omm??comm.c:35: error: ?trlType??has no member named ?req??comm.c:44: warning: implicit declaration of function ?PI_Isend??comm.c:45: error: ?trlType??has no member named ?omm??comm.c:45: error: ?trlType??has no member named ?req??comm.c:49: warning: implicit declaration of function ?PI_Waitall??comm.c:49: error: ?trlType??has no member named ?req??comm.c:49: error: ?trlType??has no member named ?tatuses??comm.c:50: error: ?trlType??has no member named ?req??comm.c:50: error: ?trlType??has no member named ?tatuses??comm.c: In function ?ommChangedInterfaceData__??
comm.c:80: error: ?PI_INT??undeclared (first use in this function)
comm.c:81: error: ?trlType??has no member named ?omm??comm.c:81: error: ?trlType??has no member named ?req??comm.c:100: error: ?trlType??has no member named ?omm??comm.c:100: error: ?trlType??has no member named ?req??comm.c:105: error: ?trlType??has no member named ?omm??comm.c:105: error: ?trlType??has no member named ?req??comm.c:110: warning: implicit declaration of function ?PI_Wait??comm.c:110: error: ?trlType??has no member named ?req??comm.c:110: error: ?trlType??has no member named ?tatus??comm.c:111: warning: implicit declaration of function ?PI_Get_count??comm.c:111: error: ?trlType??has no member named ?tatus??comm.c:120: error: ?trlType??has no member named ?req??comm.c:120: error: ?trlType??has no member named ?tatuses??comm.c: In function ?lobalSEMax__??
comm.c:132: warning: implicit declaration of function ?PI_Allreduce??comm.c:132: error: ?PI_INT??undeclared (first use in this function)
comm.c:132: error: ?PI_MAX??undeclared (first use in this function)
comm.c:132: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMaxDouble__??
comm.c:144: error: ?PI_DOUBLE??undeclared (first use in this function)
comm.c:144: error: ?PI_MAX??undeclared (first use in this function)
comm.c:144: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMin__??
comm.c:158: error: ?PI_INT??undeclared (first use in this function)
comm.c:158: error: ?PI_MIN??undeclared (first use in this function)
comm.c:158: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSESum__??
comm.c:170: error: ?PI_INT??undeclared (first use in this function)
comm.c:170: error: ?PI_SUM??undeclared (first use in this function)
comm.c:170: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMaxFloat__??
comm.c:183: error: ?PI_FLOAT??undeclared (first use in this function)
comm.c:183: error: ?PI_MAX??undeclared (first use in this function)
comm.c:183: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMinFloat__??
comm.c:197: error: ?PI_FLOAT??undeclared (first use in this function)
comm.c:197: error: ?PI_MIN??undeclared (first use in this function)
comm.c:197: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSESumFloat__??
comm.c:209: error: ?PI_FLOAT??undeclared (first use in this function)
comm.c:209: error: ?PI_SUM??undeclared (first use in this function)
comm.c:209: error: ?trlType??has no member named ?omm??make: *** [Make/linux64Gcc4DPOpt/comm.o] Error 1
+ wmake libso
Making dependency list for source file decompositionMethod/decompositionMethod.C
Making dependency list for source file geomDecomp/geomDecomp.C
Making dependency list for source file simpleGeomDecomp/simpleGeomDecomp.C
Making dependency list for source file hierarchGeomDecomp/hierarchGeomDecomp.C
Making dependency list for source file metisDecomp/metisDecomp.C
Making dependency list for source file manualDecomp/manualDecomp.C
Making dependency list for source file parMetisDecomp/parMetisDecomp.C
SOURCE=decompositionMethod/decompositionMethod.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/decompositionMethod.o
SOURCE=geomDecomp/geomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/geomDecomp.o
SOURCE=simpleGeomDecomp/simpleGeomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/simpleGeomDecomp.o
SOURCE=hierarchGeomDecomp/hierarchGeomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/hierarchGeomDecomp.o
SOURCE=metisDecomp/metisDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/metisDecomp.o
In file included from lnInclude/metis.h:25,
from metisDecomp/metisDecomp.C:36:
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:17:17: error: mpi.h: No such file or directory
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:59: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:65: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:68: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:74: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:78: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:84: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:88: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:94: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:104: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:109: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:112: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:117: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:122: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:127: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:132: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:137: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:142: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:146: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:150: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:160: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:164: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:168: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:172: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:176: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:180: error: ?PI_Comm??has not been declared
parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:184: error: ?PI_Comm??has not been declared
make: *** [Make/linux64Gcc4DPOpt/metisDecomp.o] Error 1
phsieh@sun:~/OpenFOAM/OpenFOAM-1.4/applications/utilities/parallelProcessing/decomposition Methods>

mattijs April 17, 2007 14:06

If you can live without Metis/
 
If you can live without Metis/ParMetis:

in parallelProcessing/decompositionMethods:
1) in Allwmake comment out wmake libso of all Metis stuff:

#wmake libso parMetisDecomp/ParMetis-3.1/METISLib
#wmake libso parMetisDecomp/ParMetis-3.1/ParMETISLib
#wmake libso metisDecomp/metis-4.0/Lib

2) in Make/files comment out lines for metisDecomp.C, parMetisDecomp.C

3) in Make/options comment out whole LIB_LIBS line.

hsieh April 17, 2007 15:41

Hi, Mattijs, I have done wh
 
Hi, Mattijs,

I have done what you suggested and Allwmake was successful. But, now, when I tried to run decomposePar, I got "command not found" (even after a reboot of the cluster).

Any idea?

Pei

mattijs April 18, 2007 03:37

Possibly it didn't get rebuilt
 
Possibly it didn't get rebuilt before since the libdecompositionMethods.so wasn't built?

What happens if you rebuild it?

cd $FOAM_UTILITIES/parallelProcessing/decomposePar

wmake

hsieh April 18, 2007 09:20

Thanks a lot Mattijs! It wo
 
Thanks a lot Mattijs!

It worked.

Pei

jens_klostermann June 28, 2007 15:45

Hi, I finally got OF-1.4 co
 
Hi,

I finally got OF-1.4 compiled with openmpi (infinyband: mvapi) running and an Allwmake in utilities/parallelProcessing/decompositionMethods also just worked fine.

but a decompositition with parMetis gives the following error:

Selecting decompositionMethod parMetis
*** An error occurred in MPI_comm_size
*** before MPI was initialized
*** MPI_ERRORS_ARE_FATAL (goodbye)
[stokes:12178] Abort before MPI_INIT completed successfully; not able to guarantee that all other processes were killed!

Has anybody an idea, where to dig further?

Jens

mattijs June 28, 2007 16:15

Are you running in parallel (-
 
Are you running in parallel (-parallel)? parMetis only makes sense when running redistributeMeshPar.

If this is the case try compiling the decompositionMethod library with debug info (-DFULLDEBUG -g -O0 in EXE_INC in Make/options)

jens_klostermann June 28, 2007 17:51

Hi Mattijs No I didn't. So
 
Hi Mattijs

No I didn't. So this should solve the problem?!
But As you might guess, I still have problem with the concepts and usage(syntax for using) of parMetis. Can please you give me some hints, what the (dis)advantages over normal metis are.

Thanks Jens


All times are GMT -4. The time now is 19:20.