Parallel & hostfile
 

Hello, I have the similar problem using OpenMPI for the lesCavitatingFoam tutorial.

I have two different machines for OpenFOAM 1.5:
1. foam-8: Suse 10.3 64bit 4GB gcc 4.2.1, OpenFoam installed from binary dp64 distribution

2. foam-9: Ubuntu Studio 8.04 4GB 32bit gcc 4.3.1, OpenFoam installed from binary dp distribution

Both installations pass the foamInstallationTest (foam-8 has gcc issue, never mind?). Maybe you check this too, -mAx-?

For both machines, it is possible to issue ssh commands for both machines without entering a password.

/home/rae/OpenFOAM/rae-1.5/ is a nfs share provided by foam-9 to foam-8

Running :

mpirun --hostfile system/machines -np 4 lesCavitatingFoam -case /home/rae/OpenFOAM/rae-1.5/tutorials/lesCavitatingFoam/throttle3D -parallel

depending on the machines file, gives following results:

1. system/machines contains the submitting machine name only: 4 Processes run on 1 host (2 cores) successfully

2. system/machines contains:

foam-8 cpu=2
foam-9 cpu=2

where foam-8 is the submitting host then: orted starts up immediately on both hosts. After very long time, on both machines two processes lesCavitationFoam execute, but no CPU load, and finally comes the error report:

/*---------------------------------------------------------------------------*\
| ========= | |
| \\ / F ield | OpenFOAM: The Open Source CFD Toolbox |
| \\ / O peration | Version: 1.5 |
| \\ / A nd | Web: http://www.OpenFOAM.org |
| \\/ M anipulation | |
\*---------------------------------------------------------------------------*/
Exec : lesCavitatingFoam -case /home/rae/OpenFOAM/rae-1.5/tutorials/lesCavitatingFoam/throttle3D -parallel
Date : Jun 18 2009
Time : 18:27:33
Host : foam-8
PID : 11518
[1]
[1]
[1] Expected a ')' or a '}' while reading List, found on line 0 the word 'o'
[1]
[1] file: IOstream at line [3] 0.
[1]
[1] From function Istream::readEndList(const char*)
[1] in file db/IOstreams/IOstreams/Istream.C
[3]
[3] at line 159.
[1]
FOAM parallel run exiting
[1]
Expected a ')' or a '}' while reading List, found on line 0 the word 'o'
[3]
[foam-9:10614] MPI_ABORT invoked on rank 1 in communicator MPI_COMM_WORLD with errorcode 1
[3] file: IOstream at line 0.
[3]
[3] From function Istream::readEndList(const char*)
[3] in file db/IOstreams/IOstreams/Istream.C at line 159.
[3]
FOAM parallel run exiting
[3]
[foam-9:10615] MPI_ABORT invoked on rank 3 in communicator MPI_COMM_WORLD with errorcode 1
mpirun noticed that job rank 0 with PID 11518 on node foam-8 exited on signal 15 (Terminated).
1 additional process aborted (not shown)

---------
If I omit the "-parallel", 4 processes run as expected, but they run all the same stuff I guess. Thus, mpirun does its job correctly?

Does this description fit your experience? Any Ideas? Thanks

my problem is "solved".
I don't know why I had this problem, but now it runs perfectly. Test are running under 8 machines without problem.
For info, I don't install OF on each machine, I share the OF-installation with NFS. So as you mentionned that both machines succeded the foamInstallationTest, then you may do it only for the master (as you use NFS too)