Sand box Approximation Schemes
This content is retrieved from Wikipedia and will be modified
S.K. Godunov's theorem
In numerical analysis and computational fluid dynamics, Godunov's theorem — also known as Godunov's order barrier theorem — is a mathematical theorem important in the development of the theory of high resolution schemes for the numerical solution of partial differential equations.
The theorem states that:
- Linear numerical schemes for solving partial differential equations (PDE's), having the property of not generating new extrema (monotone scheme), can be at most first-order accurate.
Professor Sergei K. Godunov originally proved the theorem as a Ph.D. student at Moscow State University. It is his most influential work in the area of applied and numerical mathematics and has had a major impact on science and engineering, particularly in the development of methodologies used in computational fluid dynamics (CFD) and other computational fields. One of his major contributions was to prove the theorem (Godunov, 1954; Godunov, 1959), that bears his name.
We generally follow Wesseling (2001).
Assume a continuum problem described by a PDE is to be computed using a numerical scheme based upon a uniform computational grid and a one-step, constant step-size, M grid point, integration algorithm, either implicit or explicit. Then if and , such a scheme can be described by
It is assumed that determines uniquely. Now, since the above equation represents a linear relationship between and we can perform a linear transformation to obtain the following equivalent form,
Theorem 1: Monotonicity preserving
The above scheme of equation (2) is monotonicity preserving if and only if
Proof - Godunov (1959)
Case 1: (sufficient condition)
Assume (3) applies and that is monotonically increasing with .
Then, because it therefore follows that because
This means that monotonicity is preserved for this case.
Case 2: (necessary condition)
For the same monotonically increasing , assume that for some and choose
Then from equation (2) we get
Now choose , to give
which implies that is NOT increasing, and we have a contradiction. Thus, monotonicity is NOT preserved for , which completes the proof.
Theorem 2: Godunov’s Order Barrier Theorem
Linear one-step second-order accurate numerical schemes for the convection equation
cannot be monotonicity preserving unless
where is the signed Courant–Friedrichs–Lewy condition (CFL) number.
Proof - Godunov (1959)
Assume a numerical scheme of the form described by equation (2) and choose
The exact solution is
If we assume the scheme to be at least second-order accurate, it should produce the following solution exactly
Substituting into equation (2) gives:
Suppose that the scheme IS monotonicity preserving, then according to the theorem 1 above, .
Now, it is clear from equation (15) that
Assume and choose such that . This implies that and .
It therefore follows that,
which contradicts equation (16) and completes the proof.
The exceptional situation whereby is only of theoretical interest, since this cannot be realised with variable coefficients. Also, integer CFL numbers greater than unity would not be feasible for practical problems.
- Godunov, Sergei K. (1954), Ph.D. Dissertation: Different Methods for Shock Waves, Moscow State University.
- Godunov, Sergei K. (1959), A Difference Scheme for Numerical Solution of Discontinuous Solution of Hydrodynamic Equations, Math. Sbornik, 47, 271-306, translated US Joint Publ. Res. Service, JPRS 7226, 1969.
- Wesseling, Pieter (2001), Principles of Computational Fluid Dynamics, Springer-Verlag.
- Hirsch, C. (1990), Numerical Computation of Internal and External Flows, vol 2, Wiley.
- Laney, Culbert B. (1998), Computational Gas Dynamics, Cambridge University Press.
- Toro, E. F. (1999), Riemann Solvers and Numerical Methods for Fluid Dynamics, Springer-Verlag.
- Tannehill, John C., et al., (1997), Computational Fluid mechanics and Heat Transfer, 2nd Ed., Taylor and Francis.
Total variation diminishing
In numerical methods, total variation diminishing (TVD) is a property of certain discretization schemes used to solve hyperbolic partial differential equations. The concept of TVD was introduced by Ami Harten.
the total variation (TV) is given by,
and the total variation for the discrete case is,
A numerical method is said to be total variation diminishing (TVD) if,
A system is said to be monotonicity preserving if the following properties are maintained as a function of t:
- No new local extrema can be created within the solution spatial domain,
- The value of a local minimum is non-decreasing, and the value of a local maximum is non-increasing.
Template:Harvnb proved the following properties for a numerical scheme,
- A monotone scheme is TVD, and
- A TVD scheme is monotonicity preserving.
Monotone schemes are attractive for solving engineering and scientific problems because they do not provide non-physical solutions.
Godunov's theorem proves that only first order linear schemes preserve monotonicity and are therefore TVD. Higher order linear schemes, although more accurate for smooth solutions, are not TVD and tend to introduce spurious oscillations (wiggles) where discontinuities or shocks arise. To overcome these drawbacks, various high-resolution, non-linear techniques have been developed, often using flux/slope limiters.
- Flux limiters
- Godunov's theorem
- High-resolution scheme
- MUSCL scheme
- Sergei K. Godunov
- Total variation
- Hirsch, C. (1990), Numerical Computation of Internal and External Flows, Vol 2, Wiley.
- Laney, C. B. (1998), Computational Gas Dynamics, Cambridge University Press.
- Toro, E. F. (1999), Riemann Solvers and Numerical Methods for Fluid Dynamics, Springer-Verlag.
- Tannehill, J. C., Anderson, D. A., and Pletcher, R. H. (1997), Computational Fluid Mechanics and Heat Transfer, 2nd Ed., Taylor & Francis.
- Wesseling, P. (2001), Principles of Computational Fluid Dynamics, Springer-Verlag.
Flux limiters are used in high resolution schemes — numerical schemes used to solve problems in science and engineering, particularly fluid dynamics, described by partial differential equations (PDE's). They are used in high resolution schemes, such as the MUSCL scheme, to avoid the spurious oscillations (wiggles) that would otherwise occur with high order spatial discretization schemes due to shocks, discontinuities or sharp changes in the solution domain. Use of flux limiters, together with an appropriate high resolution scheme, make the solutions total variation diminishing (TVD).
Note that flux limiters are also referred to as slope limiters because they both have the same mathematical form, and both have the effect of limiting the solution gradient near shocks or discontinuities. In general, the term flux limiter is used when the limiter acts on system fluxes, and slope limiter is used when the limiter acts on system states.
How they work
The main idea behind the construction of flux limiter schemes is to limit the spatial derivatives to realistic values - for scientific and engineering problems this usually means physically realisable values. They are used in high resolution schemes for solving problems described by PDEs and only come into operation when sharp wave fronts are present. For smoothly changing waves, the flux limiters do not operate and the spatial derivatives can be represented by higher order approximations without introducing non-real oscillations. Consider the 1D semi-discrete scheme below,
where, and represent edge fluxes for the ith cell. If these edge fluxes can be represented by low and high resolution schemes, then a flux limiter can switch between these schemes depending upon the gradients close to the particular cell, as follows,
- low resolution flux,
- high resolution flux,
- flux limiter function,
and represents the ratio of successive gradients on the solution mesh, i.e.,
The limiter function is constrained to be greater than or equal to zero, i.e., . Therefore, when the limiter is equal to zero (sharp gradient, opposite slopes or zero gradient), the flux is represented by a low resolution scheme. Similarly, when the limiter is equal to 1 (smooth solution), it is represented by a high resolution scheme. The various limiters have differing switching characteristics and are selected according to the particular problem and solution scheme. No particular limiter has been found to work well for all problems, and a particular choice is usually made on a trial and error basis.
The following are common forms of flux/slope limiter function, :
CHARM [not 2nd order TVD] (Zhou, 1995)
HCUS [not 2nd order TVD] (Waterson & Deconinck, 1995)
HQUICK [not 2nd order TVD] (Waterson & Deconinck, 1995)
Koren (Koren, 1993)
minmod - symmetric (Roe, 1986)
monotonized central (MC) - symmetric (van Leer, 1977)
Osher (Chatkravathy and Osher, 1983)
ospre - symmetric (Waterson & Deconinck, 1995)
smart [not 2nd order TVD] (Gaskell & Lau, 1988)
superbee - symmetric (Roe, 1986)
Sweby - symmetric (Sweby, 1984)
UMIST (Lien & Leschziner, 1994)
van Albada 1 - symmetric (van Albada, et al., 1982)
van Albada 2 Alternative form [not 2nd order TVD] used on high spatial order schemes (Kermani, 2003)
van Leer - symmetric (van Leer, 1974)
All the above limiters indicated as being symmetric, exhibit the following symmetry property,
This is a desirable property as it ensures that the limiting actions for forward and backward gradients operate in the same way.
Unless indicated to the contrary, the above limiter functions are second order TVD. This means that they are designed such that they pass through a certain region of the solution, known as the TVD region, in order to guarantee stability of the scheme. Second-order, TVD limiters satisfy at least the following criteria:
The admissible limiter region for second-order TVD schemes is shown in the Sweby Diagram opposite (Sweby, 1984), and plots showing limiter functions overlaid onto the TVD region are shown below. In this image, plots for the Osher and Sweby limiters have been generated using .
Generalised minmod limiter
An additional limiter that has an interesting form is the van-Leer's one-parameter family of minmod limiters (van Leer, 1979; Harten and Osher, 1987; Kurganov and Tadmor, 2000). It is defined as follows
where the multivariable minmod limiter is defined as
Note: is most dissipative for when it reduces to and is least dissipative for .
- Chakravarthy, S.R. & S. Osher (1983), "High resolution applications of the Osher upwind scheme for the Euler equations", Proc. AIAA 6th Computational Fluid Dynamics Conference, AIAA Paper 83-1943, at 363–373
- Gaskell, P.H. & A.K.C. Lau (1988), "Curvature-compensated convective transport: SMART, a new boundedness-preserving transport algorithm", Int. J. Num. Meth. Fluids 8 (6): 617–641, DOI:10.1002/fld.1650080602
- Harten, A. & S. Osher (1987), "Uniformly high-order accurate nonoscillatory schemes. I", SIAM J. Numer. Anal. 24 (2): 279–309, DOI:10.1137/0724022
- Hirsch, C. (1990), Numerical Computation of Internal and External Flows. Volume 2: Computational Methods for Inviscid and Viscous Flows, Wiley
- Kermani, M.J.; A.G. Gerber & J.M. Stockie (2003), "Thermodynamically Based Moisture Prediction Using Roe’s Scheme", 4th Conference of Iranian AeroSpace Society, Amir Kabir University of Technology, Tehran, Iran, January 27–29
- Koren, B. (1993), "A robust upwind discretisation method for advection, diffusion and source terms", in Vreugdenhil, C.B. & B. Koren, Numerical Methods for Advection-Diffusion Problems, Braunschweig: Vieweg, ISBN 3528076453, at 117
- Kurganov, A. & E. Tadmor (2000), Solution of Two-Dimensional Riemann problems for Gas Dynamics without Riemann Problem Solvers, Report by Dept. of Mathematics, Univ. Michigan Available on-line at: CiteSeer.
- Lien, F.S. & M.A. Leschziner (1994), "Upstream monotonic interpolation for scalar transport with application to complex turbulent flows", Int. J. Num. Meth. Fluids 19 (6): 527–548, DOI:10.1002/fld.1650190606
- Leonard, B.P.; M.A. Leschziner & J. McGuirk (1978), "The QUICK algorithm: a uniformly 3rd-order finite-difference method for highly convective flows", Proc. 1st Conf. on Numerical Methods in Laminar & Turbulent Flow, Swansea, at 807
- Roe, P.L. (1986), "Characteristic-based schemes for the Euler equations", Ann. Rev. Fluid Mech. 18: 337–365, DOI:10.1146/annurev.fl.18.010186.002005
- Sweby, P.K. (1984), "High resolution schemes using flux-limiters for hyperbolic conservation laws", SIAM J. Num. Anal. 21 (5): 995–1011, DOI:10.1137/0721062
- Van Albada, G.D.; B. Van Leer & W.W. Roberts (1982), "A comparative study of computational methods in cosmic gas dynamics", Astron. Astrophysics 108: 76–84
- Van Leer, B. (1974), "Towards the ultimate conservative difference scheme II. Monotonicity and conservation combined in a second order scheme", J. Comp. Phys. 14 (4): 361–370, DOI:10.1016/0021-9991(74)90019-9
- Van Leer, B. (1977), "Towards the ultimate conservative difference scheme III. Upstream-centered finite-difference schemes for ideal compressible flow", J. Comp. Phys. 23 (3): 263–275, DOI:10.1016/0021-9991(77)90094-8
- Van Leer, B. (1979), "Towards the ultimate conservative difference scheme V. A second order sequel to Godunov's method", J. Comp. Phys. 32: 101–136, DOI:10.1016/0021-9991(79)90145-1
- Waterson, N.P. & H. Deconinck (1995), A unified approach to the design and application of bounded higher-order convection schemes
- Zhou, G. (1995), Numerical simulations of physical discontinuities in single and multi-fluid flows for arbitrary Mach numbers, Goteborg, Sweden: Chalmers Univ. of Tech.
- Hirsch, C. (1990), Numerical Computation of Internal and External Flows, Volume 2: Computational Methods for Inviscid and Viscous Flows, Wiley, ISBN 978-0-471-92452-4
- Laney, Culbert B. (1998), Computational Gasdynamics, Cambridge University Press, ISBN 9780521570695, DOI:10.2277/0521570697
- LeVeque, Randall (1990), Numerical Methods for Conservation Laws, Birkhauser-Verlag, ISBN 3764324643
- LeVeque, Randall (2002), Finite Volume Methods for Hyperbolic Problems, Cambridge University Press, ISBN 0-521-00924-3
- Toro, E.F. (1999), Riemann Solvers and Numerical Methods for Fluid Dynamics (2nd ed.), Springer-Verlag, ISBN 3540659668
- Tannehill, John C.; Dale Arden Anderson & Richard H. Pletcher (1997), Computational Fluid Mechanics and Heat Transfer (2nd ed.), Taylor and Francis, ISBN 156032046X
- Wesseling, Pieter (2001), Principles of Computational Fluid Dynamics, Springer-Verlag, ISBN 3540678530