CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Running, Solving & CFD

Parallel runs across a network broken with OpenMPI -- SSH issue--no bashrc?

Register Blogs Community New Posts Updated Threads Search

 
 
LinkBack Thread Tools Search this Thread Display Modes
Prev Previous Post   Next Post Next
Old   March 15, 2009, 19:51
Default Parallel runs across a network broken with OpenMPI -- SSH issue--no bashrc?
  #1
New Member
 
db
Join Date: Mar 2009
Posts: 3
Rep Power: 17
carcass is on a distinguished road
Hi,

Glad to see the new forums are up and running. I have a question for the group, and I wouldn't be surprised if this were a common problem (at least I'm hoping so, for my sake).

I have run a parallel case decomposed for two processors on a single machine successfully. I set up a second computer running an identical OS (Ubuntu 8.10) with the same update level, etc. as my primary box. Both computers have identical paths to the OpenFOAM installation as well as the case files.

I decomposed the case for four processors, two per machine, and executed the project per the instructions in the documentation. At this point I began to have problems with the remote machine not being able to find the icoFoam executable (nor any OpenFOAM executable, for that matter).

I tested running some simple system commands using a nearly identical mpirun command and succeeded running them on all four processors.

e.g.: mpirun --hostfile ./machines -np 4 uptime returns:

carcass@Esker:~/user-files/Works/scrubber-icoFoam$ time mpirun --hostfile ./machines -np 4 uptime
20:54:46 up 1 day, 4:24, 2 users, load average: 0.00, 0.00, 0.00
20:54:46 up 1 day, 4:24, 2 users, load average: 0.00, 0.00, 0.00
20:54:40 up 23:13, 5 users, load average: 0.40, 0.40, 0.39
20:54:40 up 23:13, 5 users, load average: 0.40, 0.40, 0.39

real 0m0.480s
user 0m0.048s
sys 0m0.056s


The problem seems to stem from SSH not executing any setup files (.bashrc, .profile, .bash_profile, /etc/profile, /etc/bash.bashrc, etc ad nauseam) when running a non-interactive, non-login shell.

I can duplicate the problem by executing:

mpirun --hostfile ./machines -np 4 which icoFoam

carcass@Esker:~/user-files/Works/scrubber-icoFoam$ mpirun --hostfile ./machines -np 4 which icoFoam
/home/carcass/OpenFOAM/OpenFOAM-1.5/applications/bin/linux64GccDPOpt/icoFoam
/home/carcass/OpenFOAM/OpenFOAM-1.5/applications/bin/linux64GccDPOpt/icoFoam

(only two processors return)

The problem appears to be that I cannot get the OpenFoam-1.5/etc/bashrc file to be evaluated upon ssh connecting to the remote machine. The problem recurs no matter which machine is the local and which is the remote (the configuration is exactly equivalent on the two machines).

I have done a bunch of searching around on the internet and have found many references to OpenSSH being broken as far as bash goes because the new OpenSSH uses pipes, not sockets, to connect, and hence will not be recognized by bash as needing execution of the environment setup files. Some have suggested rebuilding bash, but I'm really not at all interested in doing that.

Has anyone in the OpenFOAM community experienced a similar problem? I'd greatly appreciate some assistance. As I mentioned, I can successfully run on two processors on a local machine, but I'm really interested in getting networked machines into the mix as well.

Thanks in advance!
carcass is offline   Reply With Quote

 


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
SnappyHexMesh in parallel openmpi wikstrom OpenFOAM Bugs 18 November 26, 2008 05:55
[snappyHexMesh] SnappyHexMesh in parallel openmpi wikstrom OpenFOAM Meshing & Mesh Conversion 7 November 24, 2008 09:52
Cant run in parallel on two nodes using OpenMPI CHristofer Main CFD Forum 0 October 26, 2007 09:54
parallel runs Andy F CFX 1 March 5, 2006 16:32
Network Interface for parallel processing mAx FLUENT 1 November 10, 2005 11:07


All times are GMT -4. The time now is 09:16.