CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > FLUENT

Single Precision and Double Precision

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old   May 27, 2011, 04:36
Default Single Precision and Double Precision
  #1
New Member
 
Joe
Join Date: Mar 2009
Posts: 26
Rep Power: 8
wateraction is on a distinguished road
Hi, everyone!
If I choose Single Precision, what level of decimal should I set for the criterion of residual error to make it meaningful. I mean, single precision might only manage 10^-3 or less, and it would be meaningless if I set 10^-6 as the criterion of residual error, while Double Presion might be necessary.
wateraction is offline   Reply With Quote

Old   May 27, 2011, 12:16
Default
  #2
Senior Member
 
Amir's Avatar
 
Amir
Join Date: May 2009
Location: Shiraz, Iran
Posts: 739
Blog Entries: 1
Rep Power: 14
Amir is on a distinguished road
Hi,
single precision -> almost 1e-8
double precision -> almost 1e-16
Amir is offline   Reply With Quote

Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Switch from single precision to double precision kk81 OpenFOAM Bugs 0 March 11, 2010 07:14
Missing math.h header Travis FLUENT 4 January 15, 2009 12:48
what's wrong about my code for 2d burgers equation morxio Main CFD Forum 3 April 27, 2007 10:38
Single or double precision Jonas Larsson Main CFD Forum 15 March 26, 2007 23:15
Single v.s. double precision Confused CFX 9 April 19, 2004 18:33


All times are GMT -4. The time now is 15:25.