CFD Online Logo CFD Online URL
Home > Forums > Software User Forums > ANSYS > FLUENT

Single Precision and Double Precision

Register Blogs Members List Search Today's Posts Mark Forums Read

LinkBack Thread Tools Display Modes
Old   May 27, 2011, 04:36
Default Single Precision and Double Precision
New Member
Join Date: Mar 2009
Posts: 26
Rep Power: 10
wateraction is on a distinguished road
Hi, everyone!
If I choose Single Precision, what level of decimal should I set for the criterion of residual error to make it meaningful. I mean, single precision might only manage 10^-3 or less, and it would be meaningless if I set 10^-6 as the criterion of residual error, while Double Presion might be necessary.
wateraction is offline   Reply With Quote

Old   May 27, 2011, 12:16
Senior Member
Amir's Avatar
Join Date: May 2009
Location: Montreal, QC
Posts: 739
Blog Entries: 1
Rep Power: 16
Amir is on a distinguished road
single precision -> almost 1e-8
double precision -> almost 1e-16
Amir is offline   Reply With Quote


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Single or double precision Jonas Larsson Main CFD Forum 16 June 20, 2017 06:53
Single v.s. double precision Confused CFX 15 November 10, 2016 05:42
Switch from single precision to double precision kk81 OpenFOAM Bugs 0 March 11, 2010 07:14
Missing math.h header Travis FLUENT 4 January 15, 2009 12:48
what's wrong about my code for 2d burgers equation morxio Main CFD Forum 3 April 27, 2007 10:38

All times are GMT -4. The time now is 07:59.