# Introduction to turbulence/Statistical analysis/Estimation from a finite number of realizations

### From CFD-Wiki

(→Bias and convergence of estimators) |
(→Bias and convergence of estimators) |
||

Line 73: | Line 73: | ||

where the next to last step follows from the fact that the <math>x_{n}</math> are assumed to be statistically independent samples (and hence uncorrelated), and the last step from the definition of the variance. It follows immediately by substitution into equation 2.49 that the square of the variability of the estimator, <math>X_{N}</math>, is given by: | where the next to last step follows from the fact that the <math>x_{n}</math> are assumed to be statistically independent samples (and hence uncorrelated), and the last step from the definition of the variance. It follows immediately by substitution into equation 2.49 that the square of the variability of the estimator, <math>X_{N}</math>, is given by: | ||

+ | |||

+ | <table width="100%"><tr><td> | ||

+ | :<math> | ||

+ | \begin{matrix} | ||

+ | \epsilon^{2}_{X_{N}}& =& \frac{1}{N}\frac{var\left\{x\right\}}{X^{2}} \\ | ||

+ | & = & \frac{1}{N} \left[ \frac{\sigma_{x}}{X} \right]^{2} \\ | ||

+ | \end{matrix} | ||

+ | </math> | ||

+ | </td><td width="5%">(2)</td></tr></table> |

## Revision as of 07:09, 10 June 2006

## Estimators for averaged quantities

Since there can never an infinite number of realizations from which ensemble averages (and probability densities) can be computed, it is essential to ask: *How many realizations are enough?* The answer to this question must be sought by looking at the statistical properties of estimators based on a finite number of realization. There are two questions which must be answered. The first one is:

- Is the expected value (or mean value) of the estimator equal to the true ensemble mean? Or in other words, is yje estimator
*unbiased?*

The second question is

- Does the difference between the and that of the true mean decrease as the number of realizations increases? Or in other words, does the estimator
*converge*in a statistical sense (or converge in probability). Figure 2.9 illustrates the problems which can arise.

## Bias and convergence of estimators

A procedure for answering these questions will be illustrated by considerind a simple **estimator** for the mean, the arithmetic mean considered above, . For independent realizations where is finite, is given by:

| (2) |

Now, as we observed in our simple coin-flipping experiment, since the are random, so must be the value of the estimator . For the estimator to be *unbiased*, the mean value of must be true ensemble mean, , i.e.

| (2) |

It is easy to see that since the operations of averaging adding commute,

| (2) |

(Note that the expected value of each is just since the are assumed identically distributed). Thus is, in fact, an *unbiased estimator for the mean*.

The question of *convergence* of the estimator can be addressed by defining the square of **variability of the estimator**, say , to be:

| (2) |

Now we want to examine what happens to as the number of realizations increases. For the estimator to converge it is clear that should decrease as the number of sample increases. Obviously, we need to examine the variance of first. It is given by:

| (2) |

since from equation 2.46. Using the fact that operations of averaging and summation commute, the squared summation can be expanded as follows:

| (2) |

where the next to last step follows from the fact that the are assumed to be statistically independent samples (and hence uncorrelated), and the last step from the definition of the variance. It follows immediately by substitution into equation 2.49 that the square of the variability of the estimator, , is given by:

| (2) |