CFD Online Discussion Forums

CFD Online Discussion Forums (https://www.cfd-online.com/Forums/)
-   FLUENT (https://www.cfd-online.com/Forums/fluent/)
-   -   Single Precision and Double Precision (https://www.cfd-online.com/Forums/fluent/88828-single-precision-double-precision.html)

wateraction May 27, 2011 04:36

Single Precision and Double Precision
 
Hi, everyone!
If I choose Single Precision, what level of decimal should I set for the criterion of residual error to make it meaningful. I mean, single precision might only manage 10^-3 or less, and it would be meaningless if I set 10^-6 as the criterion of residual error, while Double Presion might be necessary.

Amir May 27, 2011 12:16

Hi,
single precision -> almost 1e-8
double precision -> almost 1e-16


All times are GMT -4. The time now is 19:32.