CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > ANSYS > CFX

Problem with parallel run

Register Blogs Community New Posts Updated Threads Search

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   June 8, 2015, 11:15
Default Problem with parallel run
  #1
New Member
 
Join Date: Apr 2015
Posts: 16
Rep Power: 11
boubou is on a distinguished road
Hi,

There is here a copy of a run in progress, my problem is the value of my variable for the slave processor 7. Why is it different from the other slave processors ? I don't understand...

I used a User Fortran routine but the problem does not seem to come from this.

Thanks !

Quote:
================================================== ====================
OUTER LOOP ITERATION = 9 CPU SECONDS = 1.013E+03
Start function USER_DEBIT
TEMP = 8.9183311E+01
End function USER_DEBIT
----------------------------------------------------------------------
| Equation | Rate | RMS Res | Max Res | Linear Solution |
+----------------------+------+---------+---------+------------------+
| Wallscale | 0.70 | 6.6E-07 | 4.6E-05 | 44.6 2.5E-01 ok|
+----------------------+------+---------+---------+------------------+
| U-Mom | 0.78 | 1.8E-03 | 7.9E-02 | 2.3E-02 OK|
| V-Mom | 0.68 | 1.7E-03 | 3.2E-02 | 1.6E-02 OK|
| W-Mom | 0.62 | 8.8E-04 | 2.3E-02 | 2.3E-02 OK|
| P-Mass | 0.74 | 5.9E-05 | 3.1E-03 | 19.7 8.0E-02 OK|
+----------------------+------+---------+---------+------------------+
| K-TurbKE | 0.90 | 5.7E-03 | 2.6E-01 | 6.3 2.8E-03 OK|
| O-TurbFreq | 0.70 | 7.5E-04 | 3.3E-02 | 8.2 6.8E-04 OK|
+----------------------+------+---------+---------+------------------+
Slave: 2 Start function USER_DEBIT
Slave: 2 TEMP = 8.9183311E+01
Slave: 2 End function USER_DEBIT
Slave: 3 Start function USER_DEBIT
Slave: 3 TEMP = 8.9183311E+01
Slave: 3 End function USER_DEBIT
Slave: 4 Start function USER_DEBIT
Slave: 4 TEMP = 8.9183311E+01
Slave: 4 End function USER_DEBIT
Slave: 5 Start function USER_DEBIT
Slave: 5 TEMP = 8.9183311E+01
Slave: 5 End function USER_DEBIT
Slave: 6 Start function USER_DEBIT
Slave: 6 TEMP = 8.9183311E+01
Slave: 6 End function USER_DEBIT
Slave: 7 Start function USER_DEBIT
Slave: 7 TEMP = 8.9551163E+01
Slave: 7 End function USER_DEBIT
Slave: 8 Start function USER_DEBIT
Slave: 8 TEMP = 8.9183311E+01
Slave: 8 End function USER_DEBIT
Slave: 7 Start function USER_DEBIT
Slave: 7 TEMP = 8.9628439E+01
Slave: 7 End function USER_DEBIT
boubou is offline   Reply With Quote

Old   June 8, 2015, 12:24
Default
  #2
Senior Member
 
Join Date: Jun 2009
Posts: 1,804
Rep Power: 32
Opaque will become famous soon enough
Your code (user fortran) is writing some value of temperature from each partition, and you are asking why they are different. Is that value the temperature at ? say: node, boundary, global maximum, average etc ?

Describing what your goal is, how you are trying to achieve it, and the current symptoms could help others in the forum to pitch in; otherwise, it is nearly impossible to contribute.
Opaque is online now   Reply With Quote

Old   June 8, 2015, 15:10
Default
  #3
New Member
 
Join Date: Apr 2015
Posts: 16
Rep Power: 11
boubou is on a distinguished road
Yes I realize that I have not been very explicit.

TEMP is not a temperature, it is a variable that I set. This variable depends on the mass flow rate which is the inlet boundary condition of my problem.

The goal of TEMP is to calculate at each iteration a criteria that measures the convergence.

What I don't understand is the execution of the parallel run. On my other calculations the structure was :
Slave 2 : ...
Slave 3 : ...
Slave 4 : ...
Slave 5 : ...
Slave 6 : ...
Slave 7 : ...
Slave 8 : ...

Now it is :
Slave 2 : ...
Slave 3 : ...
Slave 4 : ...
Slave 5 : ...
Slave 6 : ...
Slave 7 : ...
Slave 8 : ...
Slave 7 : ...

Why there is an other execution of slave 7 at the end ?
boubou is offline   Reply With Quote

Old   June 8, 2015, 15:40
Default
  #4
Senior Member
 
Join Date: Jun 2009
Posts: 1,804
Rep Power: 32
Opaque will become famous soon enough
Let us review,

Describing what your goal is,
Quote:
The goal of TEMP is to calculate at each iteration a criteria that measures the convergence.
how you are trying to achieve it,
Quote:
????
the current symptoms
Quote:
What I don't understand is the execution of the parallel run. On my other calculations the structure was :
Slave 2 : ...
Slave 3 : ...
Slave 4 : ...
Slave 5 : ...
Slave 6 : ...
Slave 7 : ...
Slave 8 : ...

Now it is :
Slave 2 : ...
Slave 3 : ...
Slave 4 : ...
Slave 5 : ...
Slave 6 : ...
Slave 7 : ...
Slave 8 : ...
Slave 7 : ...
You are still missing important information for anybody to help you.. How are you approaching your solution via the custom code ? UserCEL, or JunctionBox ? Do you understand how ANSYS CFX breaks down the mesh on the specific locale the user code is called ?

In any case, you seem to be assuming a specific parallel programming paradigm (say: one ordered call per XXX) when writing your custom code (User Fortran); however, the software is free to call your custom code "on demand" and it is up to you to handle such events.

Imagine the software could call the custom code on the inlet for a sub-group of element faces at a time? For example, lets say you have 100 faces on the inlet, and the code breaks them down in 3 groups of 30 and 1 group of 10 for a serial run. Then , the custom code for the inlet will be called 3 times. In a parallel run, the situation is more complex because some partitions will have faces on the inlet and some will not. Have you accounted for such situations ?
Opaque is online now   Reply With Quote

Old   June 10, 2015, 04:15
Default
  #5
New Member
 
Join Date: Apr 2015
Posts: 16
Rep Power: 11
boubou is on a distinguished road
Thanks for your reply Opaque !

Quote:
You are still missing important information for anybody to help you.. How are you approaching your solution via the custom code ?
Sorry, I understand but I don't have permission to explain what I do... However I admit that I that I didn't understand how a parallel run works and your example is very clear, I will try to see in details my partitions.
boubou is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
area does not match neighbour by ... % -- possible face ordering problem St.Pacholak OpenFOAM 10 February 7, 2024 21:50
First Parallel Run - need some help Gian Maria OpenFOAM 3 June 17, 2011 12:08
nonNewtonianIcoFoam - problem with parallel run chris_sev OpenFOAM Bugs 4 April 1, 2009 09:13
Parallel run with engineFoam francesco OpenFOAM Bugs 1 November 25, 2008 07:06
Problem on Parallel Run Setup Hamidur Rahman CFX 0 September 23, 2007 17:11


All times are GMT -4. The time now is 10:20.