# Iterative methods

(Difference between revisions)
 Revision as of 22:33, 17 September 2005 (view source)Zxaar (Talk | contribs)← Older edit Revision as of 22:38, 17 September 2005 (view source)Zxaar (Talk | contribs) Newer edit → Line 22: Line 22: #Successive Overrelaxation  (SOR) method and #Successive Overrelaxation  (SOR) method and #Symmetric Successive Overrelaxation  (SSOR) method #Symmetric Successive Overrelaxation  (SSOR) method + + + ===Nonstationary Iterative Methods=== + When during the iterations '''B''' and '''c''' changes during the iterations, the method is called Nonstationary Iterative Method.  Typically, constants '''B''' and '''c''' are computed by taking inner products of residuals or other vectors arising from the iterative method.
+ + Some examples are:
+ #Conjugate Gradient Method (CG) + #MINRES and SYMMLQ + #Generalized Minimal Residual (GMRES) + #BiConjugate Gradient (BiCG) + #Quasi-Minimal Residual (QMR) + #Conjugate Gradient Squared Method (CGS) + #BiConjugate Gradient Stabilized (Bi-CGSTAB) + #Chebyshev Iteration

## Revision as of 22:38, 17 September 2005

For solving a set of linear equations, we seek the solution to the problem:

$AX = Q$

After k iterations we obtain an approaximation to the solution as:

$Ax^{(k)} = Q - r^{(k)}$

where $r^{(k)}$ is the residual after k iterations.
Defining:

$\varepsilon ^{(k)} = x - x^{(k)}$

as the difference between the exact and approaximate solution.
we obtain :

$A\varepsilon ^{(k)} = r^{(k)}$

the purpose of iterations is to drive this residual to zero.

### Stationary Iterative Methods

Iterative methods that can be expressed in the simple form:

$x^{(k)} = Bx^{(k)} + c$

When neither B nor c depend upon the iteration count (k), the iterative method is called stationary iterative method. Some of the stationary iterative methods are:

1. Jacobi method
2. Gauss-Seidel method
3. Successive Overrelaxation (SOR) method and
4. Symmetric Successive Overrelaxation (SSOR) method

### Nonstationary Iterative Methods

When during the iterations B and c changes during the iterations, the method is called Nonstationary Iterative Method. Typically, constants B and c are computed by taking inner products of residuals or other vectors arising from the iterative method.

Some examples are: