[voingiappone]

Hello everybody...

here I go with a hard question. I hope somebody there would like to help me to figure out a solution.

Long (loooong) story short: I have 2 boxes with OpenFOAM 1.6 installed and I want them to run in parallel:

kumori ---> i386
PS3 ---> PPC64

It took me a long time to compile the FOAM over the PS3 and now it is working like a charm. I'm still trying to run the damBreak tutorial, however when I launch the mpirun command it spits out an error like this:

 
mpirun -np 1 -host kumori interFoam -parallel : -np 1 -host ps3 interFoam -parallel


/*---------------------------------------------------------------------------*\
| =========                 |                                                 |
| \\      /  F ield         | OpenFOAM: The Open Source CFD Toolbox           |
|  \\    /   O peration     | Version:  1.6                                   |
|   \\  /    A nd           | Web:      www.OpenFOAM.org                      |
|    \\/     M anipulation  |                                                 |
\*---------------------------------------------------------------------------*/
Build  : 1.6-53b7f692aa41
Exec   : interFoam -parallel
Date   : Sep 22 2011
Time   : 16:13:07
Host   : kumori
PID    : 32267
[PS3:29504] *** Process received signal ***
[PS3:29504] Signal: Segmentation fault (11)
[PS3:29504] Signal code: Address not mapped (1)
[PS3:29504] Failing at address: 0xa28c2c7a
[PS3:29504] [ 0] [0xfff82960418]
[PS3:29504] [ 1] /home/piota/OpenFOAM/OpenFOAM-1.6/lib/linuxPPC64GccDPOpt/libOpenFOAM.so(_ZN4Foam8IPstream4readERNS_5tokenE-0x3a21ec) [0xfff80e947d4]
[PS3:29504] [ 2] /home/piota/OpenFOAM/OpenFOAM-1.6/lib/linuxPPC64GccDPOpt/libOpenFOAM.so(_ZN4Foam5tokenC1ERNS_7IstreamE-0x3b7e4c) [0xfff80e7d2e4]
[PS3:29504] [ 3] /home/piota/OpenFOAM/OpenFOAM-1.6/lib/linuxPPC64GccDPOpt/libOpenFOAM.so(_ZN4FoamrsERNS_7IstreamERNS_6stringE-0x3d24d0) [0xfff80e613d0]
[PS3:29504] [ 4] /home/piota/OpenFOAM/OpenFOAM-1.6/lib/linuxPPC64GccDPOpt/libOpenFOAM.so(_ZN4FoamrsINS_6stringEEERNS_7IstreamES3_RNS_4ListIT_EE-0x3e1908) [0xfff80e50ae0]
[PS3:29504] [ 5] /home/piota/OpenFOAM/OpenFOAM-1.6/lib/linuxPPC64GccDPOpt/libOpenFOAM.so(_ZN4Foam7argListC1ERiRPPcbb-0x3eb320) [0xfff80e471b8]
[PS3:29504] [ 6] interFoam() [0x1001f7fc]
[PS3:29504] [ 7] /lib64/libc.so.6(+0x4f5e8) [0xfff808875e8]
[PS3:29504] [ 8] /lib64/libc.so.6(__libc_start_main-0x1534f8) [0xfff80887800]
[PS3:29504] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 1 with PID 29504 on node ps3 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

The OF installation on the PS3 has been compiled against the lib64/libc.so.6 so this should not be the problem.

Final HINTS... maybe the problem is here:

1)
both machines' openmpi installation had to be recompiled including the option "--enable-heterogeneous" because of the difference between the architectures. Maybe the library included in the openfoam.so during previous compile is outated and it gets a SIGSEGV?

2)
if in the above command I remove the "-parallel" switch, the program runs flawlessly but only on the remote pc.

Please help me to get out from this trap

Thank you!

Luca