CFD Online Discussion Forums

CFD Online Discussion Forums (
-   FLUENT (
-   -   Single Precision and Double Precision (

wateraction May 27, 2011 04:36

Single Precision and Double Precision
Hi, everyone!
If I choose Single Precision, what level of decimal should I set for the criterion of residual error to make it meaningful. I mean, single precision might only manage 10^-3 or less, and it would be meaningless if I set 10^-6 as the criterion of residual error, while Double Presion might be necessary.

Amir May 27, 2011 12:16

single precision -> almost 1e-8
double precision -> almost 1e-16

All times are GMT -4. The time now is 13:58.