Home > Forums > Software User Forums > ANSYS > FLUENT

Single Precision and Double Precision

Updated Threads

Reply

Search this Thread

May 27, 2011, 04:36	Single Precision and Double Precision	#1
wateraction New Member Joe Join Date: Mar 2009 Posts: 26 Rep Power: 17	Hi, everyone! If I choose Single Precision, what level of decimal should I set for the criterion of residual error to make it meaningful. I mean, single precision might only manage 10^-3 or less, and it would be meaningless if I set 10^-6 as the criterion of residual error, while Double Presion might be necessary.

May 27, 2011, 12:16		#2
Amir Senior Member Amir Join Date: May 2009 Location: Montreal, QC Posts: 735 Blog Entries: 1 Rep Power: 22	Hi, single precision -> almost 1e-8 double precision -> almost 1e-16

Reply

« Previous Thread | Next Thread »

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Trackbacks are Off Pingbacks are On Refbacks are On Forum Rules

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Single or double precision	Jonas Larsson	Main CFD Forum	16	June 20, 2017 06:53
Single v.s. double precision	Confused	CFX	15	November 10, 2016 04:42
Switch from single precision to double precision	kk81	OpenFOAM Bugs	0	March 11, 2010 06:14
Missing math.h header	Travis	FLUENT	4	January 15, 2009 11:48
what's wrong about my code for 2d burgers equation	morxio	Main CFD Forum	3	April 27, 2007 10:38

All times are GMT -4. The time now is 10:02.