|
[Sponsors] |
DecomposePar links against liblamso0 with OpenMPI |
|
LinkBack | Thread Tools | Search this Thread | Display Modes |
April 16, 2007, 09:05 |
Description:
decomposePar ask
|
#1 |
Senior Member
Jens Klostermann
Join Date: Mar 2009
Posts: 117
Rep Power: 17 |
Description:
decomposePar asks for liblam.so.0 if OpenMPI is set for multiprocessor comunication decomposePar: error while loading shared libraries: liblam.so.0: cannot open shared object file: No such file or directory Solver/Application: decomposePar Source file: Testcase: damBreak4phaseFine (or all other) Platform: all Version: OF-1.4 Notes: If I change back to lam decomposing works fine. Why does the decomposePar try to link against to this obvious lam library and where should I look to fix it? Jens |
|
April 16, 2007, 09:17 |
It may be a consequence of dec
|
#2 |
Senior Member
Join Date: Mar 2009
Posts: 854
Rep Power: 22 |
It may be a consequence of decomposePar indirectly linking libparmetis.so which links the mpi libraries direcly rather then indirectly using the Pstream library as for the rest of the OpenFOAM applications. This problem could be avoided by linking only the metis library in the decompositionMethod library and removing the parMetisDecomp/parMetisDecomp.C file from the files. Alternatively you could recompile the parMetis library in decompositionMethods with OpenMPI.
Henry |
|
April 16, 2007, 14:12 |
Hi, Henry,
I am using GAMMA
|
#3 |
Senior Member
Pei-Ying Hsieh
Join Date: Mar 2009
Posts: 317
Rep Power: 18 |
Hi, Henry,
I am using GAMMA. I have the same problem. Do I need to recompile parMetis library with OpenMPI still? What do I have to change to link parMetis library with OpenMPI? Thanks! Pei |
|
April 16, 2007, 14:24 |
Do an Allwmake in utilities/pa
|
#4 |
Senior Member
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,419
Rep Power: 26 |
Do an Allwmake in utilities/parallelProcessing/decompositionMethods/
It will use the current wmake rules to pick up the same mpi files as the Pstream library. |
|
April 17, 2007, 13:45 |
Hi, Mattijs,
I did the Allw
|
#5 |
Senior Member
Pei-Ying Hsieh
Join Date: Mar 2009
Posts: 317
Rep Power: 18 |
Hi, Mattijs,
I did the Allwmake. But, got the following errors. Pei ---------------- phsieh@sun:~/OpenFOAM/OpenFOAM-1.4/applications/utilities/parallelProcessing/decomposition Methods> ./Allwmake + wmake libso parMetisDecomp/ParMetis-3.1/METISLib Making dependency list for source file coarsen.c Making dependency list for source file fm.c Making dependency list for source file initpart.c Making dependency list for source file match.c Making dependency list for source file ccgraph.c Making dependency list for source file pmetis.c Making dependency list for source file pqueue.c Making dependency list for source file refine.c Making dependency list for source file util.c Making dependency list for source file timing.c Making dependency list for source file debug.c Making dependency list for source file bucketsort.c Making dependency list for source file graph.c Making dependency list for source file stat.c Making dependency list for source file kmetis.c Making dependency list for source file kwayrefine.c Making dependency list for source file kwayfm.c Making dependency list for source file balance.c Making dependency list for source file ometis.c Making dependency list for source file srefine.c Making dependency list for source file sfm.c Making dependency list for source file separator.c Making dependency list for source file mincover.c Making dependency list for source file mmd.c Making dependency list for source file mesh.c Making dependency list for source file meshpart.c Making dependency list for source file frename.c Making dependency list for source file fortran.c Making dependency list for source file myqsort.c Making dependency list for source file compress.c Making dependency list for source file parmetis.c Making dependency list for source file estmem.c Making dependency list for source file mpmetis.c Making dependency list for source file mcoarsen.c Making dependency list for source file mmatch.c Making dependency list for source file minitpart.c Making dependency list for source file mbalance.c Making dependency list for source file mutil.c Making dependency list for source file mkmetis.c Making dependency list for source file mkwayrefine.c Making dependency list for source file mkwayfmh.c Making dependency list for source file mrefine2.c Making dependency list for source file minitpart2.c Making dependency list for source file mbalance2.c Making dependency list for source file mfm2.c Making dependency list for source file kvmetis.c Making dependency list for source file kwayvolrefine.c Making dependency list for source file kwayvolfm.c Making dependency list for source file subdomains.c Making dependency list for source file mfm.c Making dependency list for source file memory.c Making dependency list for source file mrefine.c Making dependency list for source file checkgraph.c SOURCE=coarsen.c ; gcc -m64 -Dlinux64 -DDP -Wall -march=opteron -O3 -fno-gcse -I/usr/include -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/coarsen.o In file included from lnInclude/metis.h:25, from coarsen.c:13: ./../parmetis.h:17:17: error: mpi.h: No such file or directory In file included from lnInclude/metis.h:25, from coarsen.c:13: ./../parmetis.h:59: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:65: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:68: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:74: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:78: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:84: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:88: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:94: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:104: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:109: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:112: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:117: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:122: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:127: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:132: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:142: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:146: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:150: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:160: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:164: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:168: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:172: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:176: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:180: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:184: error: expected declaration specifiers or ??..??before ?PI_Comm??make: *** [Make/linux64Gcc4DPOpt/coarsen.o] Error 1 + wmake libso parMetisDecomp/ParMetis-3.1/ParMETISLib Making dependency list for source file comm.c Making dependency list for source file util.c Making dependency list for source file debug.c Making dependency list for source file setup.c Making dependency list for source file grsetup.c Making dependency list for source file timer.c Making dependency list for source file node_refine.c Making dependency list for source file initmsection.c Making dependency list for source file order.c Making dependency list for source file xyzpart.c Making dependency list for source file pspases.c Making dependency list for source file frename.c Making dependency list for source file iintsort.c Making dependency list for source file iidxsort.c Making dependency list for source file ikeysort.c Making dependency list for source file ikeyvalsort.c Making dependency list for source file kmetis.c Making dependency list for source file gkmetis.c Making dependency list for source file ometis.c Making dependency list for source file initpart.c Making dependency list for source file match.c Making dependency list for source file coarsen.c Making dependency list for source file kwayfm.c Making dependency list for source file kwayrefine.c Making dependency list for source file kwaybalance.c Making dependency list for source file remap.c Making dependency list for source file stat.c Making dependency list for source file fpqueue.c Making dependency list for source file ametis.c Making dependency list for source file rmetis.c Making dependency list for source file lmatch.c Making dependency list for source file initbalance.c Making dependency list for source file mdiffusion.c Making dependency list for source file diffutil.c Making dependency list for source file wave.c Making dependency list for source file csrmatch.c Making dependency list for source file redomylink.c Making dependency list for source file balancemylink.c Making dependency list for source file selectq.c Making dependency list for source file akwayfm.c Making dependency list for source file serial.c Making dependency list for source file move.c Making dependency list for source file mmetis.c Making dependency list for source file mesh.c Making dependency list for source file memory.c Making dependency list for source file weird.c Making dependency list for source file backcompat.c SOURCE=comm.c ; gcc -m64 -Dlinux64 -DDP -Wall -march=opteron -O3 -fno-gcse -I/usr/include -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/comm.o In file included from lnInclude/parmetislib.h:19, from comm.c:11: lnInclude/stdheaders.h:24:17: error: mpi.h: No such file or directory In file included from lnInclude/parmetislib.h:20, from comm.c:11: ./../parmetis.h:59: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:65: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:68: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:74: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:78: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:84: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:88: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:94: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:104: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:109: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:112: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:117: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:122: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:127: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:132: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:142: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:146: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:150: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:160: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:164: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:168: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:172: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:176: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:180: error: expected declaration specifiers or ??..??before ?PI_Comm??./../parmetis.h:184: error: expected declaration specifiers or ??..??before ?PI_Comm??In file included from lnInclude/parmetislib.h:28, from comm.c:11: lnInclude/struct.h:258: error: expected specifier-qualifier-list before ?PI_Comm??In file included from lnInclude/parmetislib.h:30, from comm.c:11: lnInclude/proto.h:137: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:282: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:321: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:323: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:324: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:326: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:330: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:331: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:332: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:335: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:338: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:339: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:340: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:341: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:345: error: expected declaration specifiers or ??..??before ?PI_Comm??lnInclude/proto.h:348: error: expected declaration specifiers or ??..??before ?PI_Comm??comm.c: In function ?ommInterfaceData__?? comm.c:34: warning: implicit declaration of function ?PI_Irecv??comm.c:34: error: ?PI_INT??undeclared (first use in this function) comm.c:34: error: (Each undeclared identifier is reported only once comm.c:34: error: for each function it appears in.) comm.c:35: error: ?trlType??has no member named ?omm??comm.c:35: error: ?trlType??has no member named ?req??comm.c:44: warning: implicit declaration of function ?PI_Isend??comm.c:45: error: ?trlType??has no member named ?omm??comm.c:45: error: ?trlType??has no member named ?req??comm.c:49: warning: implicit declaration of function ?PI_Waitall??comm.c:49: error: ?trlType??has no member named ?req??comm.c:49: error: ?trlType??has no member named ?tatuses??comm.c:50: error: ?trlType??has no member named ?req??comm.c:50: error: ?trlType??has no member named ?tatuses??comm.c: In function ?ommChangedInterfaceData__?? comm.c:80: error: ?PI_INT??undeclared (first use in this function) comm.c:81: error: ?trlType??has no member named ?omm??comm.c:81: error: ?trlType??has no member named ?req??comm.c:100: error: ?trlType??has no member named ?omm??comm.c:100: error: ?trlType??has no member named ?req??comm.c:105: error: ?trlType??has no member named ?omm??comm.c:105: error: ?trlType??has no member named ?req??comm.c:110: warning: implicit declaration of function ?PI_Wait??comm.c:110: error: ?trlType??has no member named ?req??comm.c:110: error: ?trlType??has no member named ?tatus??comm.c:111: warning: implicit declaration of function ?PI_Get_count??comm.c:111: error: ?trlType??has no member named ?tatus??comm.c:120: error: ?trlType??has no member named ?req??comm.c:120: error: ?trlType??has no member named ?tatuses??comm.c: In function ?lobalSEMax__?? comm.c:132: warning: implicit declaration of function ?PI_Allreduce??comm.c:132: error: ?PI_INT??undeclared (first use in this function) comm.c:132: error: ?PI_MAX??undeclared (first use in this function) comm.c:132: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMaxDouble__?? comm.c:144: error: ?PI_DOUBLE??undeclared (first use in this function) comm.c:144: error: ?PI_MAX??undeclared (first use in this function) comm.c:144: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMin__?? comm.c:158: error: ?PI_INT??undeclared (first use in this function) comm.c:158: error: ?PI_MIN??undeclared (first use in this function) comm.c:158: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSESum__?? comm.c:170: error: ?PI_INT??undeclared (first use in this function) comm.c:170: error: ?PI_SUM??undeclared (first use in this function) comm.c:170: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMaxFloat__?? comm.c:183: error: ?PI_FLOAT??undeclared (first use in this function) comm.c:183: error: ?PI_MAX??undeclared (first use in this function) comm.c:183: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSEMinFloat__?? comm.c:197: error: ?PI_FLOAT??undeclared (first use in this function) comm.c:197: error: ?PI_MIN??undeclared (first use in this function) comm.c:197: error: ?trlType??has no member named ?omm??comm.c: In function ?lobalSESumFloat__?? comm.c:209: error: ?PI_FLOAT??undeclared (first use in this function) comm.c:209: error: ?PI_SUM??undeclared (first use in this function) comm.c:209: error: ?trlType??has no member named ?omm??make: *** [Make/linux64Gcc4DPOpt/comm.o] Error 1 + wmake libso Making dependency list for source file decompositionMethod/decompositionMethod.C Making dependency list for source file geomDecomp/geomDecomp.C Making dependency list for source file simpleGeomDecomp/simpleGeomDecomp.C Making dependency list for source file hierarchGeomDecomp/hierarchGeomDecomp.C Making dependency list for source file metisDecomp/metisDecomp.C Making dependency list for source file manualDecomp/manualDecomp.C Making dependency list for source file parMetisDecomp/parMetisDecomp.C SOURCE=decompositionMethod/decompositionMethod.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/decompositionMethod.o SOURCE=geomDecomp/geomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/geomDecomp.o SOURCE=simpleGeomDecomp/simpleGeomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/simpleGeomDecomp.o SOURCE=hierarchGeomDecomp/hierarchGeomDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/hierarchGeomDecomp.o SOURCE=metisDecomp/metisDecomp.C ; g++ -m64 -Dlinux64 -DDP -Wall -Wno-strict-aliasing -Wextra -Wno-unused-parameter -Wold-style-cast -march=opteron -O3 -DNoRepository -ftemplate-depth-40 -I/usr/include -IparMetisDecomp/ParMetis-3.1/ParMETISLib -IparMetisDecomp/ParMetis-3.1 -IlnInclude -I. -I/home/phsieh/OpenFOAM/OpenFOAM-1.4/src/OpenFOAM/lnInclude -fPIC -c $SOURCE -o Make/linux64Gcc4DPOpt/metisDecomp.o In file included from lnInclude/metis.h:25, from metisDecomp/metisDecomp.C:36: parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:17:17: error: mpi.h: No such file or directory parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:59: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:65: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:68: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:74: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:78: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:84: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:88: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:94: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:104: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:109: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:112: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:117: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:122: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:127: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:132: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:137: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:142: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:146: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:150: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:160: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:164: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:168: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:172: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:176: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:180: error: ?PI_Comm??has not been declared parMetisDecomp/ParMetis-3.1/ParMETISLib/../parmetis.h:184: error: ?PI_Comm??has not been declared make: *** [Make/linux64Gcc4DPOpt/metisDecomp.o] Error 1 phsieh@sun:~/OpenFOAM/OpenFOAM-1.4/applications/utilities/parallelProcessing/decomposition Methods> |
|
April 17, 2007, 14:06 |
If you can live without Metis/
|
#6 |
Senior Member
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,419
Rep Power: 26 |
If you can live without Metis/ParMetis:
in parallelProcessing/decompositionMethods: 1) in Allwmake comment out wmake libso of all Metis stuff: #wmake libso parMetisDecomp/ParMetis-3.1/METISLib #wmake libso parMetisDecomp/ParMetis-3.1/ParMETISLib #wmake libso metisDecomp/metis-4.0/Lib 2) in Make/files comment out lines for metisDecomp.C, parMetisDecomp.C 3) in Make/options comment out whole LIB_LIBS line. |
|
April 17, 2007, 15:41 |
Hi, Mattijs,
I have done wh
|
#7 |
Senior Member
Pei-Ying Hsieh
Join Date: Mar 2009
Posts: 317
Rep Power: 18 |
Hi, Mattijs,
I have done what you suggested and Allwmake was successful. But, now, when I tried to run decomposePar, I got "command not found" (even after a reboot of the cluster). Any idea? Pei |
|
April 18, 2007, 03:37 |
Possibly it didn't get rebuilt
|
#8 |
Senior Member
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,419
Rep Power: 26 |
Possibly it didn't get rebuilt before since the libdecompositionMethods.so wasn't built?
What happens if you rebuild it? cd $FOAM_UTILITIES/parallelProcessing/decomposePar wmake |
|
April 18, 2007, 09:20 |
Thanks a lot Mattijs!
It wo
|
#9 |
Senior Member
Pei-Ying Hsieh
Join Date: Mar 2009
Posts: 317
Rep Power: 18 |
Thanks a lot Mattijs!
It worked. Pei |
|
June 28, 2007, 15:45 |
Hi,
I finally got OF-1.4 co
|
#10 |
Senior Member
Jens Klostermann
Join Date: Mar 2009
Posts: 117
Rep Power: 17 |
Hi,
I finally got OF-1.4 compiled with openmpi (infinyband: mvapi) running and an Allwmake in utilities/parallelProcessing/decompositionMethods also just worked fine. but a decompositition with parMetis gives the following error: Selecting decompositionMethod parMetis *** An error occurred in MPI_comm_size *** before MPI was initialized *** MPI_ERRORS_ARE_FATAL (goodbye) [stokes:12178] Abort before MPI_INIT completed successfully; not able to guarantee that all other processes were killed! Has anybody an idea, where to dig further? Jens |
|
June 28, 2007, 16:15 |
Are you running in parallel (-
|
#11 |
Senior Member
Mattijs Janssens
Join Date: Mar 2009
Posts: 1,419
Rep Power: 26 |
Are you running in parallel (-parallel)? parMetis only makes sense when running redistributeMeshPar.
If this is the case try compiling the decompositionMethod library with debug info (-DFULLDEBUG -g -O0 in EXE_INC in Make/options) |
|
June 28, 2007, 17:51 |
Hi Mattijs
No I didn't. So
|
#12 |
Senior Member
Jens Klostermann
Join Date: Mar 2009
Posts: 117
Rep Power: 17 |
Hi Mattijs
No I didn't. So this should solve the problem?! But As you might guess, I still have problem with the concepts and usage(syntax for using) of parMetis. Can please you give me some hints, what the (dis)advantages over normal metis are. Thanks Jens |
|
Thread Tools | Search this Thread |
Display Modes | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
DecomposePar | jadavis1 | OpenFOAM Running, Solving & CFD | 0 | January 28, 2009 15:07 |
CFD and CFX links... | JP | CFX | 1 | July 22, 2008 09:24 |
Two Turbulence Categories links | Michail | CFD-Wiki | 1 | January 21, 2008 02:16 |
Please help with making links | Michail | CFD-Wiki | 3 | October 15, 2005 17:35 |
is it laminar or is it not (links included)... | Dean Schrage | Main CFD Forum | 7 | September 7, 2001 19:57 |