CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Running, Solving & CFD

parallel run error cma-permission-denied

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   February 22, 2022, 11:12
Default parallel run error cma-permission-denied
  #1
New Member
 
Tencho
Join Date: Dec 2014
Posts: 12
Rep Power: 11
supvato is on a distinguished road
Hello.

I am having some trouble with a parallel run using twoPhaseEulerFoam, and I was hoping someone here could give me some guidance on how to solve the issue.

I want to run twoPhaseEulerFoam in parallel using Ubuntu in WSL with OpenFOAM v2006. I have a mesh with ~2.4M elements, which runs ok (but slow) in series. decomposePar runs without any errors. When I run twoPhaseEulerFoam in parallel

Code:
mpirun -np 8 twoPhaseEulerFoam -parallel
it runs, but it gives me warning:

Code:
WARNING: Linux kernel CMA support was requested via the
btl_vader_single_copy_mechanism MCA variable, but CMA support is
not available due to restrictive ptrace settings.

The vader shared memory BTL will fall back on another single-copy
mechanism if one is available. This may result in lower performance.
I then attempted to run the depthCharge3D tutorial and get this:

Code:
tutorial/multiphase/compressibleInterFoam/laminar/depthCharge3D$ mpirun -np 6 compressibleInterFoam -parallel
--------------------------------------------------------------------------
WARNING: Linux kernel CMA support was requested via the
btl_vader_single_copy_mechanism MCA variable, but CMA support is
not available due to restrictive ptrace settings.

The vader shared memory BTL will fall back on another single-copy
mechanism if one is available. This may result in lower performance.

  Local host: DESKTOP-O9OILL4
--------------------------------------------------------------------------
/*---------------------------------------------------------------------------*\
| =========                 |                                                 |
| \\      /  F ield         | OpenFOAM: The Open Source CFD Toolbox           |
|  \\    /   O peration     | Version:  v2006                                 |
|   \\  /    A nd           | Website:  www.openfoam.com                      |
|    \\/     M anipulation  |                                                 |
\*---------------------------------------------------------------------------*/
Build  : _b45f8f6f58-20200629 OPENFOAM=2006
Arch   : "LSB;label=32;scalar=64"
Exec   : compressibleInterFoam -parallel
Date   : Feb 11 2022
Time   : 10:48:30
Host   : DESKTOP-O9OILL4
PID    : 953
I/O    : uncollated
Case   : /mnt/d/OpenFOAM/tutorial/multiphase/compressibleInterFoam/laminar/depthCharge3D
nProcs : 6
Hosts  :
(
    (DESKTOP-O9OILL4 6)
)
Pstream initialized with:
    floatTransfer      : 0
    nProcsSimpleSum    : 0
    commsType          : nonBlocking
    polling iterations : 0
trapFpe: Floating point exception trapping enabled (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 5, maxFileModificationPolls 20)
allowSystemOperations : Allowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time

Create mesh for time = 0.5
I looked around on google, and found that you could modify the ptrace configuration in

Code:
etc/sysctl.d/10-ptrace.conf
I went and changed the specific line dealing with ptrace, but nothing changed.

I also tried running the parallel test application

Code:
foamJob -p -s Test-parallel
and the execution goes for a while but quits with an error. I've pasted part of the output below.

Code:
user@DESKTOP:/mnt/d/OpenFOAM/case_x$ foamJob -p -s Test-parallel
Application : Test-parallel (8 processes)
Output      : log
Executing   : /home/.../OpenFOAM/ThirdParty-v2006/platforms/linux64Gcc63/openmpi-4.0.3/bin/mpirun -n 8 /home/.../OpenFOAM/OpenFOAM-v2006/bin/tools/foamExec Test-parallel -parallel
--------------------------------------------------------------------------
WARNING: Linux kernel CMA support was requested via the
btl_vader_single_copy_mechanism MCA variable, but CMA support is
not available due to restrictive ptrace settings.

The vader shared memory BTL will fall back on another single-copy
mechanism if one is available. This may result in lower performance.

  Local host: DESKTOP
--------------------------------------------------------------------------
/*---------------------------------------------------------------------------*\
| =========                 |                                                 |
| \\      /  F ield         | OpenFOAM: The Open Source CFD Toolbox           |
|  \\    /   O peration     | Version:  v2006                                 |
|   \\  /    A nd           | Website:  www.openfoam.com                      |
|    \\/     M anipulation  |                                                 |
\*---------------------------------------------------------------------------*/
Build  : _b45f8f6f58-20200629 OPENFOAM=2006
Arch   : "LSB;label=32;scalar=64"
Exec   : Test-parallel -parallel
Date   : Feb 11 2022
Time   : 10:25:35
Host   : DESKTOP
PID    : 23465
I/O    : uncollated
Case   : /mnt/d/OpenFOAM/case_x
nProcs : 8
Hosts  :
(
    (DESKTOP 8)
)
Pstream initialized with:
    floatTransfer      : 0
    nProcsSimpleSum    : 0
    commsType          : nonBlocking
    polling iterations : 0
trapFpe: Floating point exception trapping enabled (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 5, maxFileModificationPolls 20)
allowSystemOperations : Allowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time

--> FOAM Warning :
    From void Foam::Time::setControls()
    in file db/Time/Time.C at line 244
    Increasing the timePrecision from 6 to 18 to support the formatting of the current time directory 34.4500292216046304

[0] test transfer (N4Foam6VectorIdEE): (0 1 2)
[0]
[0] master receiving from slave 1
[0] (0 1 2)
[0] master receiving from slave 2
[0] (0 1 2)
[0] master receiving from slave 3
[0] (0 1 2)
[0] master receiving from slave 4
[0] (0 1 2)
[0] master receiving from slave 5
[0] (0 1 2)
[0] master receiving from slave 6
[0] (0 1 2)
[0] master receiving from slave 7
[0] (0 1 2)
[0] [1] complexData:
[1] 115
[1] (
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[1] (1 3(1 2 3))
[2] complexData:
[2] 106
[2] (
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[2] (2 3(1 2 3))
[5] complexData:
[5] 87
[5] (
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[5] (5 3(1 2 3))
[6] complexData:
[6] 106
[6] (
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[6] (6 3(1 2 3))
[7] complexData:
[7] 84
[7] (
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[7] (7 3(1 2 3))
[0] complexData:
[0] 99
[0] (
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))
[0] (0 3(1 2 3))

[0] test tokenized "a"
[0]
[0] master receiving from slave 1
[0] on line 0: word 'a'
[0] master receiving from slave 2
[0] on line 0: word 'a'
[0] master receiving from slave 3
[0] on line 0: word 'a'
[0] master receiving from slave 4
[0] on line 0: word 'a'
[0] master receiving from slave 5
[0] on line 0: word 'a'
[0] master receiving from slave 6
[0] on line 0: word 'a'
[0] master receiving from slave 7
[0] on line 0: word 'a'
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized "$"
[0]
[0] master receiving from slave 1
[0] on line 0: error
[0] master receiving from slave 2
[0] on line 0: error
[0] master receiving from slave 3
[0] on line 0: error
[0] master receiving from slave 4
[0] on line 0: error
[0] master receiving from slave 5
[0] on line 0: error
[0] master receiving from slave 6
[0] on line 0: error
[0] master receiving from slave 7
[0] on line 0: error
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized ""test   string1""
[0]
[0] master receiving from slave 1
[0] on line 0: string "test   string1"
[0] master receiving from slave 2
[0] on line 0: string "test   string1"
[0] master receiving from slave 3
[0] on line 0: string "test   string1"
[0] master receiving from slave 4
[0] on line 0: string "test   string1"
[0] master receiving from slave 5
[0] on line 0: string "test   string1"
[0] master receiving from slave 6
[0] on line 0: string "test   string1"
[0] master receiving from slave 7
[0] on line 0: string "test   string1"
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized "test   string1"
[0]
[0] master receiving from slave 1
[0] on line 0: word 'teststring1'
[0] master receiving from slave 2
[0] on line 0: word 'teststring1'
[0] master receiving from slave 3
[0] on line 0: word 'teststring1'
[0] master receiving from slave 4
[0] on line 0: word 'teststring1'
[0] master receiving from slave 5
[0] on line 0: word 'teststring1'
[0] master receiving from slave 6
[0] on line 0: word 'teststring1'
[0] master receiving from slave 7
[0] on line 0: word 'teststring1'
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized "3.141 59"
[0]
[0] master receiving from slave 1
[0] on line 0: word '3.141 59'
[0] master receiving from slave 2
[0] on line 0: word '3.141 59'
[0] master receiving from slave 3
[0] on line 0: word '3.141 59'
[0] master receiving from slave 4
[0] on line 0: word '3.141 59'
[0] master receiving from slave 5
[0] on line 0: word '3.141 59'
[0] master receiving from slave 6
[0] on line 0: word '3.141 59'
[0] master receiving from slave 7
[0] on line 0: word '3.141 59'
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized ""  a ""
[0]
[0] master receiving from slave 1
[0] on line 0: string "  a "
[0] master receiving from slave 2
[0] on line 0: string "  a "
[0] master receiving from slave 3
[0] on line 0: string "  a "
[0] master receiving from slave 4
[0] on line 0: string "  a "
[0] master receiving from slave 5
[0] on line 0: string "  a "
[0] master receiving from slave 6
[0] on line 0: string "  a "
[0] master receiving from slave 7
[0] on line 0: string "  a "
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized "  a "
[0]
[0] master receiving from slave 1
[0] on line 0: word 'a'
[0] master receiving from slave 2
[0] on line 0: word 'a'
[0] master receiving from slave 3
[0] on line 0: word 'a'
[0] master receiving from slave 4
[0] on line 0: word 'a'
[0] master receiving from slave 5
[0] on line 0: word 'a'
[0] master receiving from slave 6
[0] on line 0: word 'a'
[0] master receiving from slave 7
[0] on line 0: word 'a'
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized ""  $ ""
[0]
[0] master receiving from slave 1
[0] on line 0: string "  $ "
[0] master receiving from slave 2
[0] on line 0: string "  $ "
[0] master receiving from slave 3
[0] on line 0: string "  $ "
[0] master receiving from slave 4
[0] on line 0: string "  $ "
[0] master receiving from slave 5
[0] on line 0: string "  $ "
[0] master receiving from slave 6
[0] on line 0: string "  $ "
[0] master receiving from slave 7
[0] on line 0: string "  $ "
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized "  $ "
[0]
[0] master receiving from slave 1
[0] on line 0: error
[0] master receiving from slave 2
[0] on line 0: error
[0] master receiving from slave 3
[0] on line 0: error
[0] master receiving from slave 4
[0] on line 0: error
[0] master receiving from slave 5
[0] on line 0: error
[0] master receiving from slave 6
[0] on line 0: error
[0] master receiving from slave 7
[0] on line 0: error
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized ""  $$ ""
[0]
[0] master receiving from slave 1
[0] on line 0: string "  $$ "
[0] master receiving from slave 2
[0] on line 0: string "  $$ "
[0] master receiving from slave 3
[0] on line 0: string "  $$ "
[0] master receiving from slave 4
[0] on line 0: string "  $$ "
[0] master receiving from slave 5
[0] on line 0: string "  $$ "
[0] master receiving from slave 6
[0] on line 0: string "  $$ "
[0] master receiving from slave 7
[0] on line 0: string "  $$ "
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[0] test tokenized "  $$ "
[0]
[0] master receiving from slave 1
[0] on line 0: word '$$'
[0] master receiving from slave 2
[0] on line 0: word '$$'
[0] master receiving from slave 3
[0] on line 0: word '$$'
[0] master receiving from slave 4
[0] on line 0: word '$$'
[0] master receiving from slave 5
[0] on line 0: word '$$'
[0] master receiving from slave 6
[0] on line 0: word '$$'
[0] master receiving from slave 7
[0] on line 0: word '$$'
[0] master sending to slave 1
[0] master sending to slave 2
[0] master sending to slave 3
[0] master sending to slave 4
[0] master sending to slave 5
[0] master sending to slave 6
[0] master sending to slave 7
[DESKTOP:23460] 7 more processes have sent help message help-btl-vader.txt / cma-permission-denied
[DESKTOP:23460] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
I have uploaded the full output here, in case someone needs to look at it.

Does anyone have any ideas on how to solve this issue?

Thanks for any help.
supvato is offline   Reply With Quote

Old   March 2, 2022, 15:05
Default Is this the right place?
  #2
New Member
 
Tencho
Join Date: Dec 2014
Posts: 12
Rep Power: 11
supvato is on a distinguished road
Since I haven't gotten any replies, is there a better section to ask about such issues?
supvato is offline   Reply With Quote

Old   May 14, 2022, 14:42
Default
  #3
New Member
 
Gauteng
Join Date: Jul 2020
Posts: 6
Rep Power: 5
fromanza is on a distinguished road
Howdy, did you get any feedback on how to solve this issue or what the issue actually is?
fromanza is offline   Reply With Quote

Old   October 10, 2022, 05:48
Default
  #4
New Member
 
Join Date: Sep 2020
Posts: 12
Rep Power: 5
PrasantKaredla is on a distinguished road
Hi,

If you are using wsl 1, you will get these errors. Try to change your wsl version to 2. then these errors will disappear and may encounter graphical errors if you need to open GUI applications like paraview, gnuplot etc from ubuntu terminal.

If anyone have better ideas, please share.

Best Regards
Prasant K
PrasantKaredla is offline   Reply With Quote

Reply

Tags
openfoam, parallel execution

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Problem with foam-extend 4.0 ggi parallel run Metikurke OpenFOAM Running, Solving & CFD 1 December 6, 2018 16:51
problem during mpi in server: expected Scalar, found on line 0 the word 'nan' muth OpenFOAM Running, Solving & CFD 3 August 27, 2018 05:18
Some questions about a multi region case run in parallel zfaraday OpenFOAM Running, Solving & CFD 5 February 23, 2017 11:25
OpenFOAM can't be run in parallel in cluster sibo OpenFOAM Running, Solving & CFD 4 February 21, 2017 17:29
parallel Grief: BoundaryFields ok in single CPU but NOT in Parallel JR22 OpenFOAM Running, Solving & CFD 2 April 19, 2013 17:49


All times are GMT -4. The time now is 09:35.