mpirun stops

lasherwc · July 28, 2018, 15:34

Hi:

I just bought a 20-core workstation and occasionally my job will stop with the following message:

[1]+ Exit 65 mpirun -np 20 twoPhaseEulerFoam -parallel > log

I'll get the same message with other numbers of processors. The log file seems to be fine, and if I simply restart the job it will run ok. I don't see anything else unusual on the console.

Any idea what this means?

Thanks

vivek05 · July 29, 2018, 02:14

Have you divided your solution domain into 20 sub domains?
If not Use decomposePar command
after that run mpirun -np 20 ....etc

lasherwc · July 29, 2018, 11:51

Hi:

Yes, I did subdivide the domain. It runs fine most of the time, just stops for no apparent reason occasionally. If I just restart it it works fine, so I don't think the problem is with OpenFOAM - I think it's either an MPI problem or perhaps a hardware problem.

Bill

pete20r2 · July 30, 2018, 20:01

I think you have an issue with the environment setup. Are you using the MPI that came with OF?

lasherwc · July 31, 2018, 11:23

Hi Peter:

The MPI environment variable WM_MPLIB is set to SYSTEMOPENMPI. This is set in /opt/openfoam6/etc/bashrc. Notice that mpirun usually works, it just ends sometimes for no apparent reason.

Bill

July 28, 2018, 15:34	mpirun stops	#1
lasherwc Member Bill Lasher Join Date: Jun 2009 Posts: 36 Rep Power: 16	Hi: I just bought a 20-core workstation and occasionally my job will stop with the following message: [1]+ Exit 65 mpirun -np 20 twoPhaseEulerFoam -parallel > log I'll get the same message with other numbers of processors. The log file seems to be fine, and if I simply restart the job it will run ok. I don't see anything else unusual on the console. Any idea what this means? Thanks

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
what is wrong with the mpirun parameter -mca ?	donno	OpenFOAM	7	February 2, 2023 21:12
MPIrun Problem with FoamJob Workaround	kaszt	OpenFOAM Running, Solving & CFD	3	October 4, 2018 12:55
Simulation stops at simulation but doesn't diverge mpirun error	Dar87	OpenFOAM Running, Solving & CFD	0	March 28, 2018 03:52
mpirun unable to find SU2_PRT	Apollinaris	SU2 Installation	1	May 10, 2017 05:31
using mpirun	EmadTandis	OpenFOAM Running, Solving & CFD	1	December 4, 2016 14:29

July 29, 2018, 02:14		#2
vivek05 Member Vivek Join Date: Mar 2018 Location: India Posts: 54 Rep Power: 8	Have you divided your solution domain into 20 sub domains? If not Use decomposePar command after that run mpirun -np 20 ....etc

July 29, 2018, 11:51		#3
lasherwc Member Bill Lasher Join Date: Jun 2009 Posts: 36 Rep Power: 16	Hi: Yes, I did subdivide the domain. It runs fine most of the time, just stops for no apparent reason occasionally. If I just restart it it works fine, so I don't think the problem is with OpenFOAM - I think it's either an MPI problem or perhaps a hardware problem. Bill

July 30, 2018, 20:01		#4
pete20r2 Senior Member Peter Baskovich Join Date: Jul 2014 Posts: 127 Rep Power: 11	I think you have an issue with the environment setup. Are you using the MPI that came with OF?

July 31, 2018, 11:23		#5
lasherwc Member Bill Lasher Join Date: Jun 2009 Posts: 36 Rep Power: 16	Hi Peter: The MPI environment variable WM_MPLIB is set to SYSTEMOPENMPI. This is set in /opt/openfoam6/etc/bashrc. Notice that mpirun usually works, it just ends sometimes for no apparent reason. Bill