CFD Online Discussion Forums

CFD Online Discussion Forums (https://www.cfd-online.com/Forums/)
-   Main CFD Forum (https://www.cfd-online.com/Forums/main/)
-   -   How to decide PDE type for 1st order scalar PDE's (https://www.cfd-online.com/Forums/main/15260-how-decide-pde-type-1st-order-scalar-pdes.html)

shantanu June 3, 2008 06:34

How to decide PDE type for 1st order scalar PDE's
 
Hello, can anyone please help me to decide the PDE type viz. elliptic, parabolic or hyperbolic if we have 1st order scalar PDE (eg. 1st order wave equation i.e. du/dt + c*du/dx=0).

Thanks, Shantanu.

Vinayender June 4, 2008 03:14

Re: How to decide PDE type for 1st order scalar PD
 
Hi,

One method to find wether a pde is hyperbolic, ellliptic or parabolic as follows....

Hyperbolic problems are Initial value problems.

Elliptic problems are Boundary value problems.

Parabolic problems are Initial,Boundary value problmes.

So take your equation ::

du/dt + c*du/dx=0 ---------- 1 now write this equation can be compared with.

du/dt *dt + du/dx *dx = du which is same as

du/dt + du/dx * (dx/dt) = du/dt ----------- 2

comparing 1 and 2 we can say that along dx/dt is c du = 0, that is along the curve dx/dt = c pde is converted to ODE that is du = 0; which can be integrated and see the solution.

There fore the solution is u = constant (along dx/dt = c) and the value of constant can be found by u(0) i.e, initial values.

There fore final soution is u = u(0) (along dx/dt = c) and hence it is an initial value problem. And hence your given equation is an Hyperbolic....

Similarly if you want to solve an elliptic problem you need solution on a closed boundary ..for example you can solve (del**2)U =0 mathematically and see that you need solution on a closed by a boundary to solve such equations and hence will be elliptic .... similrly for parabolic...

Also there is some mathematical procedure for finding a given pde is which one, that is if a pde admits wave like solution then the equation will be hyperbolic equation and the details of this procedure can be found in book by Hrish name is some thing like computational FD for external and internal flows........

Thanks, Vinayender.

Jed June 4, 2008 06:51

Re: How to decide PDE type for 1st order scalar PD
 
I agree with the general message here, but it's not so clear cut. For instance, Hyberbolic problems usually need boundary conditions too unless the domain is infinite and many boundary value problems don't satisfy ellipticity. Especially for nonlinear problems, such classification is not particularly meaningful. What you are really interested in is what initial/boundary conditions and function spaces are necessary and sufficient to have well posedness (often a very hard problem). Finding coercive bilinear forms is also very relevant numerically since it tells you about what kind of preconditioning may be needed.

Vinayender June 4, 2008 08:15

Re: How to decide PDE type for 1st order scalar PD
 
Hi Jed,

First of all thank you very much for your comment on my message, it is always helps me to know wether my understanding is correct or not ?

When I related initial value problem to Hyperbolic problem, I mean that to solve a hyperbolic problem initially we require the solution along some dataum line (which can be in time t=0 ,or space say a curve or surface) and we can find the solution to these pde by marching along (time or space)the characteristics lines (in the current example these lines are dx/dt = c). This explanation is in consistant with physics that a distrabance in a medium (governed by hyperbolic law)will propogate along charactersistic lines.

And when I related boundary value problem to elliptic problem, I mean that to solve an elliptic pde we require solution all along the "CLOSED BOUNDARY" to solve for interior solution. Again this explanation is in consistant with the physics that for a disturbance in a medium (governed by hyperbolic law) will prapogate in all directions.

Thanks, Vinayender.

John June 4, 2008 08:58

Re: How to decide PDE type for 1st order scalar PD
 
shantanu: at others said you should specify IC and/ro BC first then determin type of eq., however, it is formal to take *t* as time and assume an IC, and take *x* as space, further you should determin solution domain, bounded, unbounded, etc. and define some BC for *u* there.

your PDE seems to be both parabolic and hyperbolic.

Jed:

>Finding coercive bilinear forms is also ...

Interesting, can you clarify, what you mean from *coercive*?

Vinayender June 4, 2008 09:42

Re: How to decide PDE type for 1st order scalar PD
 
Hi Jhon,

Above pde is Hyperbolic.........independent of wether t is time or spacial coordinate. But physically in that equation t is time and that equation represents "sclar linear convective equation".

Jhon please read my 2nd post in this thread, where I told what I mean by Initial and boundary.. I should have used like this, prior represents knowing solution on some cure or surface which will not make a closed volume (area in case of 2d) and the later one is some curve or surface which makes a closed area or volume in 2d and 3d respectivly...

Thanks, Vinayender.

John June 4, 2008 10:20

Re: How to decide PDE type for 1st order scalar PD
 
i am not very expert but to my knowledge due to presence of time variable (and spatially hyperbolic), this PDE is always parabolic with respect to time, notice that in parabolic pde we have just one characteristic and have one sided propagation of informations along its direction, i.e., information never propagate backward in time, while in hyperbolic type information could propagate forward or backward, of course based on specific problem

am i miss something?

Tom June 5, 2008 07:04

Re: How to decide PDE type for 1st order scalar PD
 
First order scalar pdes in two variables are always hyperbolic. The difference comes when you go to systems and/or higher order derivatives where the characteristic equation is less trivial; e.g. for a second order pde or a system of two first order pdes the characteristic equation will be a quadratic which can have either real roots (hyperbolic), imaginary conjugate roots (elliptic) or a single repeated root (parabolic).


Vinayender June 5, 2008 10:30

Re: How to decide PDE type for 1st order scalar PD
 
Hi John,

You only said that "while in hyperbolic type information could propagate forward OR backward" which is right. You used "forward OR backward" not "forward AND backward" and hence information can propogate either forward OR backward, in the above equation it always propogates in farward in time and hence it is hyperbolic.

Please refer book "Computational Gas Dynamics" by Laney about this equation.

Thanks, Vinayender.

Vinayender June 5, 2008 10:31

Re: How to decide PDE type for 1st order scalar PD
 
Hi John,

You only said that "while in hyperbolic type information could propagate forward OR backward" which is right. You used "forward OR backward" not "forward AND backward" and hence information can propogate either forward OR backward, in the above equation it always propogates in farward in time and hence it is hyperbolic.

Please refer book "Computational Gas Dynamics" by Laney about this equation.

Thank you John, have fun reading in that book.

Thanks, Vinayender.

John June 5, 2008 12:01

Re: How to decide PDE type for 1st order scalar PD
 
Hi Vinayender,

Ok, that book could helps, but i did not still understand why this PDE can not be parabolic (of course hyper with respect to space), please clarify?

do you mean we should always select between elliptic/hyper/parabolic just one (not mixed behavior)?

Vinayender June 6, 2008 02:00

Re: How to decide PDE type for 1st order scalar PD
 
Hi John,

Please read the book that I mentioned (you can read only the correspondig topic) and also if popssible read Classifications of Pde's from CFD book by Anderson and please get back to me we will discuss.

Have fun in reading those books.

Thanks, Vinayender.

John June 6, 2008 10:10

Re: How to decide PDE type for 1st order scalar PD
 
Hmm, if i be man of reading these books, i do not spend time here to shortcut, it was just out of curiosity and does not has so priority to enforce me to refre to some books which are not included in my personal library.

anyway thanks for your comments

Good luck.

Jed June 6, 2008 13:07

Re: How to decide PDE type for 1st order scalar PD
 
These general rules are fine.

Classification doesn't make a lot of sense for nonlinear PDE. For linear PDE, classification often tells us about what sort of boundary conditions may be required, which function spaces we can expect solutions to be in, and what sort of well posedness results to expect. Those are the results that are actually relevant. In the nonlinear case, many of these general results don't exist so we have special proofs for particular problems or we just experiment and run with it hoping that results for similar linear PDE carry over.

John: Coercivity of a bilinear form a : H^2 -> R means that a(x,x) >= C |x|^2 for all x in H. This condition is usually needed to show that the associated quadratic functional attains its minimum. If a is also symmetric then it defines an inner product on H which makes convergence proofs easy, but also means that when we discretize, we can expect a symmetric positive definite matrix. Even without symmetry, we can expect a definite matrix where multigrid and domain decomposition methods should work.

Consider the Stokes operator which is indefinite over the usual spaces. That is, if x is a pure pressure mode, then a(x,x) = 0. However, the momentum part of the Stokes equation over the space of divergence-free fields is definite. Unfortunately, it is hard to define a global function space which is divergence-free and has reasonable approximation properties, so we usually work over the full space including the pressure term. Of course standard preconditioners fail miserably here, but Schur complement preconditioners are much more effective because they work over the correct spaces.

John June 6, 2008 14:49

Re: How to decide PDE type for 1st order scalar PD
 
thanks, so does this mean that coercivity is rather than symmetric positive definiteness (SPD condition), it seems that it covers SPD condition?

Jed June 7, 2008 08:04

Re: How to decide PDE type for 1st order scalar PD
 
SPD refers to finite dimensional operators (matrices) while coercivity applies to infinite dimensional operators. Also, a bilinear form can be coercive without being symmetric.

John June 7, 2008 08:26

Re: How to decide PDE type for 1st order scalar PD
 
what text u recommend to read more on theoritical side of PDE solution, in particular as minimum as possible?

It seems that u r expert in theoritical analysis of PDEs, so please let me to introduce of question:

consider minimization of functional

J(u) = 1/2 \int_\omega (\nabla u)^2

dJ/du = div(\nabla u)

nessesary condition for stationary point is dJ/du = 0

a very common method for minimization of this is called gradient flow, i.e., implicit time stepping of dJ/du, like this

u^{n+1} = n^n + dt * div( \nabla u^{n+1} )

dt artificial time stepping.

my question: how this method could be convergent? (i.e., J^{n+1} < J^n)

it seems that global convergence is identical, how we expect global convergence without line search?

any idea is wellcome.

Thanks.

PS: assume sufficient regularity for u, e.g., assume u \in H_0^1

Jed June 7, 2008 10:44

Re: How to decide PDE type for 1st order scalar PD
 
I really like Evans ``Partial Differential Equations'', as it makes an excellent reference, but it is not at all numerical. I am certainly not an expert in PDE regularity, but I'm familiar with some of the standard results. If the iteration you described looks like

u^{n+1} = u^n + dt * (b - A u^n)

(take b=0, Au = -div(grad u)) it is a Richardson iteration in which case convergence depends on the choice of dt relative to the spectrum of A. The spectrum of A is dependent on discretization. It is almost always better to apply a Krylov method to solve the linear system. For nonlinear minimization problems, I prefer (Jacobian-free) Newton-Krylov methods due to excellent convergence properties and the ability to easily use existing software. While line search and trust region algorithms help for globalization of Newton methods they do not guarantee convergence and even when they converge, it can be unreasonably slow. I generally prefer continuation methods as the primary means of globalization with LS or TR as backup in case of a slightly too large step.

John June 7, 2008 12:48

Re: How to decide PDE type for 1st order scalar PD
 
Jed,

Thanks for your comments.

based on your argument, you relate convergence on spectral redius of A, but what about convergence study in infinite-dimensional spaces? how to study its?

also, I see this

u^{n+1} = u^n + dt * div(grad u)

very similar to the classic steepest descent method but without line search to find step size (dt), but instead there is a difference u^{n+1} here is coupled with gradient of functional, this maybe ensure convergence, do u have any comment?


Jed June 7, 2008 14:24

Re: How to decide PDE type for 1st order scalar PD
 
The Laplacian is unbounded (with respect to L^2 norm) so it does not have finite spectral radius. When we discretize, the spectral radius is mesh dependent so the convergence rates are as well. Mesh independent convergence rates are generally hard to get. You pretty much need multigrid or multilevel domain decomposition.

I don't see how the Richardson iteration corresponds to a steepest descent. What is the relation between the direction of the residual and the steepest descent direction?

I believe that for (somewhat) robust convergence in the nonlinear case, you would have to adapt your step (dt) to the spectral radius of the Jacobian at (u^n). This is not an easy thing to do, so a line search is more common.

I think it is generally a good idea to separate solving linear systems from solving nonlinear ones. Newton-Krylov with multigrid preconditioning is almost always faster than nonlinear multigrid and a Richardson iteration is usually a very bad way to solve a linear system. Correctness and modularity is another reason to use Newton-Krylov. Everything specialized goes in the preconditioner so you can experiment wildly the PC and not worry about converging to the answer of a different problem. Fortuitously, the fastest known methods use this approach so you tend to get a performance boost rather than penalty by introducing this modularity.

John June 7, 2008 15:34

Re: How to decide PDE type for 1st order scalar PD
 
>I don't see how the Richardson iteration corresponds to a steepest descent. What is the relation between the direction of the residual and the steepest descent direction?

it is very clear: assume grad J = G

steetest descent iteration is like this x_new = x_old - alpha G, alpha is computed from line search

my previous problem is match with this structure if we use explicit time stepping but it does not have line search, the formal method is to use implicit time stepping to prevent divergence, note that this method is very common in literature of image analysis (differential geometry), but I could not find any convergence theory.

your statement implies that the Laplacian operator is not a infinite dimensional smoother, but i think there should be some theory, at least stablisihng minimizing sequence, if u have further comment please continue, elase thanks for your contribution.


shantanu June 22, 2008 23:20

Re: How to decide PDE type for 1st order scalar PD
 
Hi Vinayender, thanks for your replies. I studied all responses and referred some books. here is what I concluded.

1. 1-D Hyperbolic problems need initial condition (at t=0) and boundary condition (say at x=0) but not necessarily closed one. (Please refer eg. 3.1 from Laney's book on computational gasdynamics).

2. for first order scalar PDE's, sometimes we don't need boundary condition if input function is a wave as here boundary condition is implicitly defined (no need to explicitly provide any boundary condition).

3. Explanation given in Laney is what I was looking for. so according to it, all first order scalar PDE's will be hyperbolic as they will be time marching (or which ever variable is your y axis). Same has been said by Mr. Tom in his reply to this post. I agree with him.

Thanks again.

regards, Shantanu.

shantanu June 22, 2008 23:22

Re: How to decide PDE type for 1st order scalar PD
 
Hi Jed,

thanks for your replies. I studied all responses and referred some books. here is what I concluded.

you are correct that classification makes sense only for linear PDE's.

1. 1-D Hyperbolic problems need initial condition (at t=0) and boundary condition (say at x=0) but not necessarily closed one. (Please refer eg. 3.1 from Laney's book on computational gasdynamics).

2. for first order linear scalar PDE's, sometimes we don't need boundary condition if input function is a wave as here boundary condition is implicitly defined (no need to explicitly provide any boundary condition).

3. Explanation given in Laney is what I was looking for. so according to it, all first order scalar PDE's will be hyperbolic as they will be time marching (or which ever variable is your y axis). Same has been said by Mr. Tom in his reply to this post. I agree with him. you can check it.

Thanks again.

regards, Shantanu.

shantanu June 22, 2008 23:27

Re: How to decide PDE type for 1st order scalar PD
 
Hi John,

thanks for your replies. I studied all responses and referred some books. here is what I concluded.

1. 1-D Hyperbolic problems need initial condition (at t=0) and boundary condition (say at x=0) but not necessarily closed one. (Please refer eg. 3.1 from Laney's book on computational gasdynamics).

2. for first order scalar PDE's, sometimes we don't need boundary condition if input function is a wave as here boundary condition is implicitly defined (no need to explicitly provide any boundary condition).

3. Explanation given in Laney is what I was looking for. so according to it, all first order scalar PDE's will be hyperbolic as they will be time marching (or which ever variable is your y axis). Same has been said by Mr. Tom in his reply to this post. I agree with him.

4. The PDE given in this post is also hyperbolic rather than both hyperbolic and parabolic. Explanation to this is that in a parabolic PDE, disturbance at a point is felt in both forward and backward directions but if we see in this problem (linear advection equation or first order wave equation), disturbance at a point is felt only in forward direction, which is nature of hyperbolic problems.

Thanks again.

regards, Shantanu.

shantanu June 22, 2008 23:29

Re: How to decide PDE type for 1st order scalar PD
 
Hi Tom,

thanks for your reply. I studied all responses and referred some books. here is what I concluded.

1. 1-D Hyperbolic problems need initial condition (at t=0) and boundary condition (say at x=0) but not necessarily closed one. (Please refer eg. 3.1 from Laney's book on computational gasdynamics).

2. for first order scalar PDE's, sometimes we don't need boundary condition if input function is a wave as here boundary condition is implicitly defined (no need to explicitly provide any boundary condition).

3. Explanation given in Laney is what I was looking for. so according to it, all first order scalar PDE's will be hyperbolic as they will be time marching (or which ever variable is your y axis). Same has been said by you in your reply to this post. I agree with you.

Thanks again.

regards, Shantanu.

shantanu June 22, 2008 23:57

Re: How to decide PDE type for 1st order scalar PD
 
Hi Jed,

thanks for your replies. I studied all responses and referred some books. here is what I concluded.

you are correct that classification makes sense only for linear PDE's.

1. 1-D Hyperbolic problems need initial condition (at t=0) and boundary condition (say at x=0) but not necessarily closed one. (Please refer eg. 3.1 from Laney's book on computational gasdynamics).

2. for first order linear scalar PDE's, sometimes we don't need boundary condition if input function is a wave as here boundary condition is implicitly defined (no need to explicitly provide any boundary condition).

3. Explanation given in Laney is what I was looking for. so according to it, all first order scalar PDE's will be hyperbolic as they will be time marching (or which ever variable is your y axis). Same has been said by Mr. Tom in his reply to this post. I agree with him. you can check it.

Thanks again.

regards, Shantanu.

shantanu June 22, 2008 23:57

Re: How to decide PDE type for 1st order scalar PD
 
Hi John,

thanks for your replies. I studied all responses and referred some books. here is what I concluded.

1. 1-D Hyperbolic problems need initial condition (at t=0) and boundary condition (say at x=0) but not necessarily closed one. (Please refer eg. 3.1 from Laney's book on computational gasdynamics).

2. for first order scalar PDE's, sometimes we don't need boundary condition if input function is a wave as here boundary condition is implicitly defined (no need to explicitly provide any boundary condition).

3. Explanation given in Laney is what I was looking for. so according to it, all first order scalar PDE's will be hyperbolic as they will be time marching (or which ever variable is your y axis). Same has been said by Mr. Tom in his reply to this post. I agree with him.

4. The PDE given in this post is also hyperbolic rather than both hyperbolic and parabolic. Explanation to this is that in a parabolic PDE, disturbance at a point is felt in both forward and backward directions but if we see in this problem (linear advection equation or first order wave equation), disturbance at a point is felt only in forward direction, which is nature of hyperbolic problems.

Thanks again.

regards, Shantanu.

shantanu June 22, 2008 23:58

Re: How to decide PDE type for 1st order scalar PD
 
Hi Tom,

thanks for your reply. I studied all responses and referred some books. here is what I concluded.

1. 1-D Hyperbolic problems need initial condition (at t=0) and boundary condition (say at x=0) but not necessarily closed one. (Please refer eg. 3.1 from Laney's book on computational gasdynamics).

2. for first order scalar PDE's, sometimes we don't need boundary condition if input function is a wave as here boundary condition is implicitly defined (no need to explicitly provide any boundary condition).

3. Explanation given in Laney is what I was looking for. so according to it, all first order scalar PDE's will be hyperbolic as they will be time marching (or which ever variable is your y axis). Same has been said by you in your reply to this post. I agree with you.

Thanks again.

regards, Shantanu.

John June 23, 2008 13:48

Re: How to decide PDE type for 1st order scalar PD
 
Thanks.


All times are GMT -4. The time now is 11:40.