CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Running, Solving & CFD

OpenFoam2.3 project path error in Rocks6.1.1 using qsub

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   December 16, 2015, 12:57
Default OpenFoam2.3 project path error in Rocks6.1.1 using qsub
  #1
Senior Member
 
aerospain
Join Date: Sep 2009
Location: Madrid, Spain
Posts: 149
Rep Power: 16
aerospain is on a distinguished road
Send a message via Skype™ to aerospain
Hello everyone,

My qsub scripts are not running on our group's server because the node receiving the job looks for the 0, constant, system directories where it it not supposed to.
These scripts used to work some time ago, there has been some updates in this server but our administrators don't see any reason why my scripts are not running any longer.

I am pasting the files I use below in case someone can give me some hints:

***
run.sh
***
#!/bin/bash
#
#$ -cwd
#$ -j y
#$ -S /bin/bash
#$ -pe * 8
#$ -v MPI_BUFFER_SIZE=200000000

# ACTIVATE OPENFOAM ENVIRONMENT
# source /share/apps/centFOAM/OpenFOAM/OpenFOAM-2.1.0/etc/bashrc
# or
. /share/apps/OpenFOAM/OpenFOAM-2.3.0/etc/bashrc

# Shouldn't be necessary, since the OpenFOAM should already have this defined
export PATH=$PATH:/opt/openmpi/bin

# FORMATO GENERAL:
# mpirun -np <nProcs> <foamExec> <otherArgs> -parallel > log &

mpirun -np 8 simpleFoam -parallel > log.simpleFoam


I use the following command to submit my job:
>>> qsub -N hembase -q <computation_node> run.sh

And the following error message is received:
Cannot read "/<home>/<user>/system/decomposeParDict"

When that file is at:
/<home>/<user>/OpenFOAM/carlos-2.3.0/run/<project>/system/decomposeParDict

Some time ago I had to create a bashrc file in:
/<home>/<user>/OpenFOAM/bashrc
to overwrite the bashrc file that OpenFOAM installs at the 'etc' directory inside the installation path.

Any hints?

Thanks!!!
aerospain is offline   Reply With Quote

Old   December 16, 2015, 17:09
Default
  #2
Senior Member
 
Alexey Matveichev
Join Date: Aug 2011
Location: Nancy, France
Posts: 1,930
Rep Power: 38
alexeym has a spectacular aura aboutalexeym has a spectacular aura about
Send a message via Skype™ to alexeym
Hi,

Usually I prepend execution of the solver in PBS script with

Code:
cd $PBS_O_WORKDIR
and then submit job from case folder. Or you can pass the path with -case solver flag i.e.

Code:
mpirun -np 8 simpleFoam -parallel -case $PBS_O_WORKDIR > log.simpleFoam
According to the error, job was executed from your home folder. Guess, it is default location for execution of users jobs.
alexeym is offline   Reply With Quote

Old   December 17, 2015, 03:39
Default
  #3
Senior Member
 
aerospain
Join Date: Sep 2009
Location: Madrid, Spain
Posts: 149
Rep Power: 16
aerospain is on a distinguished road
Send a message via Skype™ to aerospain
Dear Alexey,

Thanksfor your reply!

The job was 'q'submitted from the project folder, the same way it's done when working on a local computer. The error message tells me that the node receiving the job through 'qsub' doesn't know about the openfoam paths. But, if I 'ssh' to that node and run the case locally on it (from the project folder), it's all fun&games.

I am guessing now that the qsub command doesn't "tell" the node to start the job from the folder it was launched.

The policy in our cluster is to always use 'qsub', if we 'ssh' to the node we want to use, the administrators lose the ability to manage properly the system.

By the way, I get no information if I "echo $PBS_O_WORKDIR".

cheers!
aerospain is offline   Reply With Quote

Old   December 17, 2015, 12:50
Default
  #4
Senior Member
 
Alexey Matveichev
Join Date: Aug 2011
Location: Nancy, France
Posts: 1,930
Rep Power: 38
alexeym has a spectacular aura aboutalexeym has a spectacular aura about
Send a message via Skype™ to alexeym
Hi,

Did not pay attention to the syntax of configuration comments. So in fact it is SGE and not OpenPBS derivative and variable name should be SGE_O_WORKDIR. Or just use man qsub to figure out name for your job scheduler.

Using qsub in fact a question of optimal cluster resources distribution.
alexeym is offline   Reply With Quote

Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
CoCoons Project - Community-driven Documentation on OpenFOAMŪ Technology holger_marschall OpenFOAM Announcements from Other Sources 6 February 2, 2022 15:42
OF 1.6 | Ubuntu 9.10 (64bit) | GLIBCXX_3.4.11 not found piprus OpenFOAM Installation 22 February 25, 2010 14:43


All times are GMT -4. The time now is 09:15.