 |
 |
 |
|
|
|
[Sponsors] | ||||
August 25, 2011, 09:35
|
Scalar precision: float vs. double
|
#1 |
|
Senior Member
Hisham Elsafti
Join Date: Apr 2011
Location: Braunschweig, Germany
Posts: 257
Blog Entries: 10
Rep Power: 17  |
Hi
I use scalars to solve a (simple closed form) quadratic equation. Nevertheless, they always give a 6 digits precision (a float). I tried to declare the scalars as doubleScalar instead of just scalar. However, the result is still in 6 digits. I made sure that the solution can be more precise http://www.mathsisfun.com/quadratic-...on-solver.html |
|
|
|
|
| Tags |
| double, float, scalar |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Continuing User Defined Real Gas Model issues | aeroman | FLUENT | 6 | April 8, 2016 03:34 |
| Parallel User Defined Real Gas Model | aeroman | FLUENT | 4 | July 1, 2015 06:09 |
| Missing math.h header | Travis | FLUENT | 4 | January 15, 2009 11:48 |
| what's wrong about my code for 2d burgers equation | morxio | Main CFD Forum | 3 | April 27, 2007 10:38 |
| REAL GAS UDF | brian | FLUENT | 6 | September 11, 2006 08:23 |
Threaded Mode
