# Iterative methods

(Difference between revisions)
 Revision as of 22:38, 17 September 2005 (view source)Zxaar (Talk | contribs)← Older edit Revision as of 03:03, 19 September 2005 (view source)Praveen (Talk | contribs) (→Stationary Iterative Methods)Newer edit → Line 14: Line 14: Iterative methods that can be expressed in the simple form:
Iterative methods that can be expressed in the simple form:
:$:[itex] - x^{(k)} = Bx^{(k)} + c + x^{(k+1)} = Bx^{(k)} + c$
[/itex]
Line 22: Line 22: #Successive Overrelaxation  (SOR) method and #Successive Overrelaxation  (SOR) method and #Symmetric Successive Overrelaxation  (SSOR) method #Symmetric Successive Overrelaxation  (SSOR) method - ===Nonstationary Iterative Methods=== ===Nonstationary Iterative Methods===

## Revision as of 03:03, 19 September 2005

For solving a set of linear equations, we seek the solution to the problem:

$AX = Q$

After k iterations we obtain an approaximation to the solution as:

$Ax^{(k)} = Q - r^{(k)}$

where $r^{(k)}$ is the residual after k iterations.
Defining:

$\varepsilon ^{(k)} = x - x^{(k)}$

as the difference between the exact and approaximate solution.
we obtain :

$A\varepsilon ^{(k)} = r^{(k)}$

the purpose of iterations is to drive this residual to zero.

### Stationary Iterative Methods

Iterative methods that can be expressed in the simple form:

$x^{(k+1)} = Bx^{(k)} + c$

When neither B nor c depend upon the iteration count (k), the iterative method is called stationary iterative method. Some of the stationary iterative methods are:

1. Jacobi method
2. Gauss-Seidel method
3. Successive Overrelaxation (SOR) method and
4. Symmetric Successive Overrelaxation (SSOR) method

### Nonstationary Iterative Methods

When during the iterations B and c changes during the iterations, the method is called Nonstationary Iterative Method. Typically, constants B and c are computed by taking inner products of residuals or other vectors arising from the iterative method.

Some examples are:

2. MINRES and SYMMLQ
3. Generalized Minimal Residual (GMRES)
5. Quasi-Minimal Residual (QMR)
6. Conjugate Gradient Squared Method (CGS)
8. Chebyshev Iteration