|
[Sponsors] |
February 22, 2022, 10:12 |
parallel run error cma-permission-denied
|
#1 |
New Member
Tencho
Join Date: Dec 2014
Posts: 12
Rep Power: 11 |
Hello.
I am having some trouble with a parallel run using twoPhaseEulerFoam, and I was hoping someone here could give me some guidance on how to solve the issue. I want to run twoPhaseEulerFoam in parallel using Ubuntu in WSL with OpenFOAM v2006. I have a mesh with ~2.4M elements, which runs ok (but slow) in series. decomposePar runs without any errors. When I run twoPhaseEulerFoam in parallel Code:
mpirun -np 8 twoPhaseEulerFoam -parallel Code:
WARNING: Linux kernel CMA support was requested via the btl_vader_single_copy_mechanism MCA variable, but CMA support is not available due to restrictive ptrace settings. The vader shared memory BTL will fall back on another single-copy mechanism if one is available. This may result in lower performance. Code:
tutorial/multiphase/compressibleInterFoam/laminar/depthCharge3D$ mpirun -np 6 compressibleInterFoam -parallel -------------------------------------------------------------------------- WARNING: Linux kernel CMA support was requested via the btl_vader_single_copy_mechanism MCA variable, but CMA support is not available due to restrictive ptrace settings. The vader shared memory BTL will fall back on another single-copy mechanism if one is available. This may result in lower performance. Local host: DESKTOP-O9OILL4 -------------------------------------------------------------------------- /*---------------------------------------------------------------------------*\ | ========= | | | \\ / F ield | OpenFOAM: The Open Source CFD Toolbox | | \\ / O peration | Version: v2006 | | \\ / A nd | Website: www.openfoam.com | | \\/ M anipulation | | \*---------------------------------------------------------------------------*/ Build : _b45f8f6f58-20200629 OPENFOAM=2006 Arch : "LSB;label=32;scalar=64" Exec : compressibleInterFoam -parallel Date : Feb 11 2022 Time : 10:48:30 Host : DESKTOP-O9OILL4 PID : 953 I/O : uncollated Case : /mnt/d/OpenFOAM/tutorial/multiphase/compressibleInterFoam/laminar/depthCharge3D nProcs : 6 Hosts : ( (DESKTOP-O9OILL4 6) ) Pstream initialized with: floatTransfer : 0 nProcsSimpleSum : 0 commsType : nonBlocking polling iterations : 0 trapFpe: Floating point exception trapping enabled (FOAM_SIGFPE). fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 5, maxFileModificationPolls 20) allowSystemOperations : Allowing user-supplied system call operations // * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * // Create time Create mesh for time = 0.5 Code:
etc/sysctl.d/10-ptrace.conf I also tried running the parallel test application Code:
foamJob -p -s Test-parallel Code:
user@DESKTOP:/mnt/d/OpenFOAM/case_x$ foamJob -p -s Test-parallel Application : Test-parallel (8 processes) Output : log Executing : /home/.../OpenFOAM/ThirdParty-v2006/platforms/linux64Gcc63/openmpi-4.0.3/bin/mpirun -n 8 /home/.../OpenFOAM/OpenFOAM-v2006/bin/tools/foamExec Test-parallel -parallel -------------------------------------------------------------------------- WARNING: Linux kernel CMA support was requested via the btl_vader_single_copy_mechanism MCA variable, but CMA support is not available due to restrictive ptrace settings. The vader shared memory BTL will fall back on another single-copy mechanism if one is available. This may result in lower performance. Local host: DESKTOP -------------------------------------------------------------------------- /*---------------------------------------------------------------------------*\ | ========= | | | \\ / F ield | OpenFOAM: The Open Source CFD Toolbox | | \\ / O peration | Version: v2006 | | \\ / A nd | Website: www.openfoam.com | | \\/ M anipulation | | \*---------------------------------------------------------------------------*/ Build : _b45f8f6f58-20200629 OPENFOAM=2006 Arch : "LSB;label=32;scalar=64" Exec : Test-parallel -parallel Date : Feb 11 2022 Time : 10:25:35 Host : DESKTOP PID : 23465 I/O : uncollated Case : /mnt/d/OpenFOAM/case_x nProcs : 8 Hosts : ( (DESKTOP 8) ) Pstream initialized with: floatTransfer : 0 nProcsSimpleSum : 0 commsType : nonBlocking polling iterations : 0 trapFpe: Floating point exception trapping enabled (FOAM_SIGFPE). fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 5, maxFileModificationPolls 20) allowSystemOperations : Allowing user-supplied system call operations // * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * // Create time --> FOAM Warning : From void Foam::Time::setControls() in file db/Time/Time.C at line 244 Increasing the timePrecision from 6 to 18 to support the formatting of the current time directory 34.4500292216046304 [0] test transfer (N4Foam6VectorIdEE): (0 1 2) [0] [0] master receiving from slave 1 [0] (0 1 2) [0] master receiving from slave 2 [0] (0 1 2) [0] master receiving from slave 3 [0] (0 1 2) [0] master receiving from slave 4 [0] (0 1 2) [0] master receiving from slave 5 [0] (0 1 2) [0] master receiving from slave 6 [0] (0 1 2) [0] master receiving from slave 7 [0] (0 1 2) [0] [1] complexData: [1] 115 [1] ( [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [1] (1 3(1 2 3)) [2] complexData: [2] 106 [2] ( [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [2] (2 3(1 2 3)) [5] complexData: [5] 87 [5] ( [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [5] (5 3(1 2 3)) [6] complexData: [6] 106 [6] ( [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [6] (6 3(1 2 3)) [7] complexData: [7] 84 [7] ( [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [7] (7 3(1 2 3)) [0] complexData: [0] 99 [0] ( [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] (0 3(1 2 3)) [0] test tokenized "a" [0] [0] master receiving from slave 1 [0] on line 0: word 'a' [0] master receiving from slave 2 [0] on line 0: word 'a' [0] master receiving from slave 3 [0] on line 0: word 'a' [0] master receiving from slave 4 [0] on line 0: word 'a' [0] master receiving from slave 5 [0] on line 0: word 'a' [0] master receiving from slave 6 [0] on line 0: word 'a' [0] master receiving from slave 7 [0] on line 0: word 'a' [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized "$" [0] [0] master receiving from slave 1 [0] on line 0: error [0] master receiving from slave 2 [0] on line 0: error [0] master receiving from slave 3 [0] on line 0: error [0] master receiving from slave 4 [0] on line 0: error [0] master receiving from slave 5 [0] on line 0: error [0] master receiving from slave 6 [0] on line 0: error [0] master receiving from slave 7 [0] on line 0: error [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized ""test string1"" [0] [0] master receiving from slave 1 [0] on line 0: string "test string1" [0] master receiving from slave 2 [0] on line 0: string "test string1" [0] master receiving from slave 3 [0] on line 0: string "test string1" [0] master receiving from slave 4 [0] on line 0: string "test string1" [0] master receiving from slave 5 [0] on line 0: string "test string1" [0] master receiving from slave 6 [0] on line 0: string "test string1" [0] master receiving from slave 7 [0] on line 0: string "test string1" [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized "test string1" [0] [0] master receiving from slave 1 [0] on line 0: word 'teststring1' [0] master receiving from slave 2 [0] on line 0: word 'teststring1' [0] master receiving from slave 3 [0] on line 0: word 'teststring1' [0] master receiving from slave 4 [0] on line 0: word 'teststring1' [0] master receiving from slave 5 [0] on line 0: word 'teststring1' [0] master receiving from slave 6 [0] on line 0: word 'teststring1' [0] master receiving from slave 7 [0] on line 0: word 'teststring1' [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized "3.141 59" [0] [0] master receiving from slave 1 [0] on line 0: word '3.141 59' [0] master receiving from slave 2 [0] on line 0: word '3.141 59' [0] master receiving from slave 3 [0] on line 0: word '3.141 59' [0] master receiving from slave 4 [0] on line 0: word '3.141 59' [0] master receiving from slave 5 [0] on line 0: word '3.141 59' [0] master receiving from slave 6 [0] on line 0: word '3.141 59' [0] master receiving from slave 7 [0] on line 0: word '3.141 59' [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized "" a "" [0] [0] master receiving from slave 1 [0] on line 0: string " a " [0] master receiving from slave 2 [0] on line 0: string " a " [0] master receiving from slave 3 [0] on line 0: string " a " [0] master receiving from slave 4 [0] on line 0: string " a " [0] master receiving from slave 5 [0] on line 0: string " a " [0] master receiving from slave 6 [0] on line 0: string " a " [0] master receiving from slave 7 [0] on line 0: string " a " [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized " a " [0] [0] master receiving from slave 1 [0] on line 0: word 'a' [0] master receiving from slave 2 [0] on line 0: word 'a' [0] master receiving from slave 3 [0] on line 0: word 'a' [0] master receiving from slave 4 [0] on line 0: word 'a' [0] master receiving from slave 5 [0] on line 0: word 'a' [0] master receiving from slave 6 [0] on line 0: word 'a' [0] master receiving from slave 7 [0] on line 0: word 'a' [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized "" $ "" [0] [0] master receiving from slave 1 [0] on line 0: string " $ " [0] master receiving from slave 2 [0] on line 0: string " $ " [0] master receiving from slave 3 [0] on line 0: string " $ " [0] master receiving from slave 4 [0] on line 0: string " $ " [0] master receiving from slave 5 [0] on line 0: string " $ " [0] master receiving from slave 6 [0] on line 0: string " $ " [0] master receiving from slave 7 [0] on line 0: string " $ " [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized " $ " [0] [0] master receiving from slave 1 [0] on line 0: error [0] master receiving from slave 2 [0] on line 0: error [0] master receiving from slave 3 [0] on line 0: error [0] master receiving from slave 4 [0] on line 0: error [0] master receiving from slave 5 [0] on line 0: error [0] master receiving from slave 6 [0] on line 0: error [0] master receiving from slave 7 [0] on line 0: error [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized "" $$ "" [0] [0] master receiving from slave 1 [0] on line 0: string " $$ " [0] master receiving from slave 2 [0] on line 0: string " $$ " [0] master receiving from slave 3 [0] on line 0: string " $$ " [0] master receiving from slave 4 [0] on line 0: string " $$ " [0] master receiving from slave 5 [0] on line 0: string " $$ " [0] master receiving from slave 6 [0] on line 0: string " $$ " [0] master receiving from slave 7 [0] on line 0: string " $$ " [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [0] test tokenized " $$ " [0] [0] master receiving from slave 1 [0] on line 0: word '$$' [0] master receiving from slave 2 [0] on line 0: word '$$' [0] master receiving from slave 3 [0] on line 0: word '$$' [0] master receiving from slave 4 [0] on line 0: word '$$' [0] master receiving from slave 5 [0] on line 0: word '$$' [0] master receiving from slave 6 [0] on line 0: word '$$' [0] master receiving from slave 7 [0] on line 0: word '$$' [0] master sending to slave 1 [0] master sending to slave 2 [0] master sending to slave 3 [0] master sending to slave 4 [0] master sending to slave 5 [0] master sending to slave 6 [0] master sending to slave 7 [DESKTOP:23460] 7 more processes have sent help message help-btl-vader.txt / cma-permission-denied [DESKTOP:23460] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages Does anyone have any ideas on how to solve this issue? Thanks for any help. |
|
March 2, 2022, 14:05 |
Is this the right place?
|
#2 |
New Member
Tencho
Join Date: Dec 2014
Posts: 12
Rep Power: 11 |
Since I haven't gotten any replies, is there a better section to ask about such issues?
|
|
May 14, 2022, 13:42 |
|
#3 |
New Member
Gauteng
Join Date: Jul 2020
Posts: 6
Rep Power: 6 |
Howdy, did you get any feedback on how to solve this issue or what the issue actually is?
|
|
October 10, 2022, 04:48 |
|
#4 |
New Member
Join Date: Sep 2020
Posts: 18
Rep Power: 6 |
Hi,
If you are using wsl 1, you will get these errors. Try to change your wsl version to 2. then these errors will disappear and may encounter graphical errors if you need to open GUI applications like paraview, gnuplot etc from ubuntu terminal. If anyone have better ideas, please share. Best Regards Prasant K |
|
Tags |
openfoam, parallel execution |
Thread Tools | Search this Thread |
Display Modes | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Problem with foam-extend 4.0 ggi parallel run | Metikurke | OpenFOAM Running, Solving & CFD | 1 | December 6, 2018 15:51 |
problem during mpi in server: expected Scalar, found on line 0 the word 'nan' | muth | OpenFOAM Running, Solving & CFD | 3 | August 27, 2018 04:18 |
Some questions about a multi region case run in parallel | zfaraday | OpenFOAM Running, Solving & CFD | 5 | February 23, 2017 10:25 |
OpenFOAM can't be run in parallel in cluster | sibo | OpenFOAM Running, Solving & CFD | 4 | February 21, 2017 16:29 |
parallel Grief: BoundaryFields ok in single CPU but NOT in Parallel | JR22 | OpenFOAM Running, Solving & CFD | 2 | April 19, 2013 16:49 |