Single Precision and Double Precision
Hi, everyone!
If I choose Single Precision, what level of decimal should I set for the criterion of residual error to make it meaningful. I mean, single precision might only manage 10^-3 or less, and it would be meaningless if I set 10^-6 as the criterion of residual error, while Double Presion might be necessary. |
Hi,
single precision -> almost 1e-8 double precision -> almost 1e-16 |
All times are GMT -4. The time now is 19:32. |