|
[Sponsors] |
Parallel runs across a network broken with OpenMPI -- SSH issue--no bashrc? |
|
LinkBack | Thread Tools | Search this Thread | Display Modes |
March 15, 2009, 19:51 |
Parallel runs across a network broken with OpenMPI -- SSH issue--no bashrc?
|
#1 |
New Member
db
Join Date: Mar 2009
Posts: 3
Rep Power: 17 |
Hi,
Glad to see the new forums are up and running. I have a question for the group, and I wouldn't be surprised if this were a common problem (at least I'm hoping so, for my sake). I have run a parallel case decomposed for two processors on a single machine successfully. I set up a second computer running an identical OS (Ubuntu 8.10) with the same update level, etc. as my primary box. Both computers have identical paths to the OpenFOAM installation as well as the case files. I decomposed the case for four processors, two per machine, and executed the project per the instructions in the documentation. At this point I began to have problems with the remote machine not being able to find the icoFoam executable (nor any OpenFOAM executable, for that matter). I tested running some simple system commands using a nearly identical mpirun command and succeeded running them on all four processors. e.g.: mpirun --hostfile ./machines -np 4 uptime returns: carcass@Esker:~/user-files/Works/scrubber-icoFoam$ time mpirun --hostfile ./machines -np 4 uptime 20:54:46 up 1 day, 4:24, 2 users, load average: 0.00, 0.00, 0.00 20:54:46 up 1 day, 4:24, 2 users, load average: 0.00, 0.00, 0.00 20:54:40 up 23:13, 5 users, load average: 0.40, 0.40, 0.39 20:54:40 up 23:13, 5 users, load average: 0.40, 0.40, 0.39 real 0m0.480s user 0m0.048s sys 0m0.056s The problem seems to stem from SSH not executing any setup files (.bashrc, .profile, .bash_profile, /etc/profile, /etc/bash.bashrc, etc ad nauseam) when running a non-interactive, non-login shell. I can duplicate the problem by executing: mpirun --hostfile ./machines -np 4 which icoFoam carcass@Esker:~/user-files/Works/scrubber-icoFoam$ mpirun --hostfile ./machines -np 4 which icoFoam /home/carcass/OpenFOAM/OpenFOAM-1.5/applications/bin/linux64GccDPOpt/icoFoam /home/carcass/OpenFOAM/OpenFOAM-1.5/applications/bin/linux64GccDPOpt/icoFoam (only two processors return) The problem appears to be that I cannot get the OpenFoam-1.5/etc/bashrc file to be evaluated upon ssh connecting to the remote machine. The problem recurs no matter which machine is the local and which is the remote (the configuration is exactly equivalent on the two machines). I have done a bunch of searching around on the internet and have found many references to OpenSSH being broken as far as bash goes because the new OpenSSH uses pipes, not sockets, to connect, and hence will not be recognized by bash as needing execution of the environment setup files. Some have suggested rebuilding bash, but I'm really not at all interested in doing that. Has anyone in the OpenFOAM community experienced a similar problem? I'd greatly appreciate some assistance. As I mentioned, I can successfully run on two processors on a local machine, but I'm really interested in getting networked machines into the mix as well. Thanks in advance! |
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
SnappyHexMesh in parallel openmpi | wikstrom | OpenFOAM Bugs | 18 | November 26, 2008 05:55 |
[snappyHexMesh] SnappyHexMesh in parallel openmpi | wikstrom | OpenFOAM Meshing & Mesh Conversion | 7 | November 24, 2008 09:52 |
Cant run in parallel on two nodes using OpenMPI | CHristofer | Main CFD Forum | 0 | October 26, 2007 09:54 |
parallel runs | Andy F | CFX | 1 | March 5, 2006 16:32 |
Network Interface for parallel processing | mAx | FLUENT | 1 | November 10, 2005 11:07 |