[Pranto]

I am trying to build OpenFOAM from source with MPICH-3.3.2 but got

g++ -std=c++11 -m64 -Dlinux64 -DWM_ARCH_OPTION=64 -DWM_DP -DWM_LABEL_SIZE=32 -Wall -Wextra -Wold-style-cast -Wnon-virtual-dtor -Wno-unused-parameter -Wno-invalid-offsetof -Wno-attributes -O3  -DNoRepository -ftemplate-depth-100  -I -IlnInclude -I. -I/home/pranto/OpenFOAM-dev/src/OpenFOAM/lnInclude -I/home/pranto/OpenFOAM-dev/src/OSspecific/POSIX/lnInclude   -fPIC -c PstreamGlobals.C -o /home/pranto/OpenFOAM-dev/platforms/linux64GccDPInt32OptSYSTEMMPI/src/Pstream/mpi/PstreamGlobals.o
UPstream.C:30:17: fatal error: mpi.h: No such file or directory
compilation terminated.
/home/pranto/OpenFOAM-dev/wmake/rules/General/transform:25: recipe for target '/home/pranto/OpenFOAM-dev/platforms/linux64GccDPInt32OptSYSTEMMPI/src/Pstream/mpi/UPstream.o' failed
make[4]: *** [/home/pranto/OpenFOAM-dev/platforms/linux64GccDPInt32OptSYSTEMMPI/src/Pstream/mpi/UPstream.o] Error 1
make[4]: *** Waiting for unfinished jobs....
In file included from PstreamGlobals.C:26:0:
PstreamGlobals.H:41:17: fatal error: mpi.h: No such file or directory
compilation terminated.
In file included from UIPread.C:30:0:
PstreamGlobals.H:41:17: fatal error: mpi.h: No such file or directory
compilation terminated.

Although I set

export WM_MPLIB=SYSTEMMPI

But with openmpi everything is ok.



What are the additional settings I have to consider to build OpenFOAM with MPICH-3.3.2?

[olesen]

Your compilation indicates "SYSTEMMPI" but you claim to have mpich-3.3.2 installed. Where is it located?

[Pranto]

Basically, I want to compile OpenFOAM using my system installed MPI library which is in my case MPICH 3.3.2.


How am I supposed to tell OpenFOAM to use my system MPI library during compile?

etc/bashrc

#- MPI implementation:

#    WM_MPLIB = SYSTEMOPENMPI | OPENMPI | SYSTEMMPI | MPICH | MPICH-GM | HPMPI
#               | MPI | FJMPI | QSMPI | SGIMPI | INTELMPI


if [[ -z "${WM_MPLIB}" ]] then

           export WM_MPLIB=SYSTEMOPENMPIfi
export MPI_ARCH_PATH=$MPI_ROOT

Which I changed in

 export WM_MPLIB=MPICH

What are the additional things I have to consider to compile using my system installed MPI library?

Btw, I installed MPICH using the following command.
sudo apt install mpich libmpich-dev

[olesen]

Originally Posted by Pranto

Basically, I want to compile OpenFOAM using my system installed MPI library which is in my case MPICH 3.3.2.

How am I supposed to tell OpenFOAM to use my system MPI library during compile?
...
What are the additional things I have to consider to compile using my system installed MPI library?

Btw, I installed MPICH using the following command.
sudo apt install mpich libmpich-dev

Configuring for different MPI versions and types is indeed quite a pain. We have some overrides for commonly used setups, but not for mpich. The file you want to examine and modify (yes, very ugly) is the etc/config.sh/mpi.


If you look for the various cases, you will see that MPI corresponds to the system mpi, stored under /opt and MPICH is a version of that is assumed to have been bundled into OpenFOAM's own ThirdParty directory.


You have something different and will need to adjust accordingly. If you devise a better of defining all of these different configs, I would be happy to adjust them.

[Pranto]

How am I supposed to adjust all these configs? Can you kindly help me?

[olesen]

Originally Posted by Pranto

How am I supposed to adjust all these configs? Can you kindly help me?

Take a look at what the other MPI things are doing (in the same file). You'll typically have to define MPI_ARCH_PATH, and make sure that the LD_LIBRARY_PATH makes sense.

[Pranto]

Originally Posted by olesen

Take a look at what the other MPI things are doing (in the same file). You'll typically have to define MPI_ARCH_PATH, and make sure that the LD_LIBRARY_PATH makes sense.

Sorry for the late reply here

Now I switched back to openmpi 2.2.1.

cp -r OpenFOAM-dev/etc/config.sh/example/prefs.sh OpenFOAM-dev/etc/

export WM_MPLIB=SYSTEMOPENMPI

Now I got the following error

 In file included from PstreamGlobals.H:41:0,                  

 from UIPread.C:30: /usr/lib/x86_64-linux-gnu/openmpi/include/mpi.h:330:37: error: conflicting declaration ‘typedef struct ompi_communicator_t* MPI_Comm’  typedef struct ompi_communicator_t *MPI_Comm;                                      ^~~~~~~~

Is there anything I missed here?

[olesen]

With all the changes, you might have old symbols linked in. Best to wclean src/Pstream and rebuild it.

[Pranto]

I fixed the problem by manually installing MPICH. Just one more question, when I try to compile with system install mpich with the following env variable in etc/prefs.sh

export MPI_ROOT=/usr
export MPI_ARCH_LIBS="-L/usr/lib/x86_64-linux-gnu -lmpich"
export WM_MPLIB=SYSTEMMPI
export MPI_ARCH_FLAGS="-Wl,-Bsymbolic-functions -Wl,-z,relro"
export MPI_ARCH_INC="-I/usr/include -L/usr/lib/x86_64-linux-gnu"

I got mpi.h: no such file or directory. But With manually installing mpich and env variable

export MPI_ROOT=$HOME/MPICH
export MPI_ARCH_FLAGS="-Wl,-Bsymbolic-functions -Wl,-z,relro"
export MPI_ARCH_LIBS="-L$HOME/MPICH/lib -lmpich"
export MPI_ARCH_INC="-I$HOME/MPICH/include/ -L$HOME/MPICH/lib"
export WM_MPLIB=SYSTEMMPI

I didn't see the above error anymore. Why I got error in the first place and didn't see any error in the second place?