# CFX Post Expressions number decimals

 User Name Remember Me Password
 Register Blogs Members List Search Today's Posts Mark Forums Read

 November 29, 2013, 15:48 CFX Post Expressions number decimals #1 New Member   Join Date: Jun 2011 Posts: 5 Rep Power: 6 Hi, there, I am creating an expression in CFX post using the trendline created in the Excel as following: (-798936626.593750*z^6/1[m^6] + 4687121164.076870*z^5/1[m^5] - 11450097996.080200*z^4/1[m^4] + 14908481102.838800*z^3/1[m^3] - 10912008484.852500*z^2/1[m^2] + 4256979247.793130*z/1[m] - 691537634.412929)*1[K] when I evaluate the expression using 0.91 for z, the CFX gives me wrong number 1536K, while Excel is 762K. How do I change the decimal setup/precision in CFX? Thanks. Nan

 November 30, 2013, 05:40 #2 Super Moderator   Glenn Horrocks Join Date: Mar 2009 Location: Sydney, Australia Posts: 10,931 Rep Power: 85 When you start the solver select double precision. But I vaguely recall that CEL is evaluated in single precision even with the rest of the numerics being double precision. I am not certain of this, but keep it is mind.

 November 30, 2013, 09:29 #3 New Member   Join Date: Jun 2011 Posts: 5 Rep Power: 6 Hi, Glenn, Thanks. I do have double precision turned on for solver.

 December 13, 2013, 05:39 #4 Senior Member   Matthias Voß Join Date: Mar 2009 Location: Berlin, Germany Posts: 446 Rep Power: 11 maybe you can use the "function"-function from cfx pre to overcome the rounding errors if the expression is supposed to be used in the simulation. Be very careful about the resolution of the points being used in the function, because they will be interpolated piece-wise between two points. You can also import data (like *.csv) for comparison in post - directly within the graph-tool.

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is OffTrackbacks are On Pingbacks are On Refbacks are On Forum Rules

 Similar Threads Thread Thread Starter Forum Replies Last Post Irondome CFX 1 June 16, 2013 06:24 MInXD CFX 3 May 19, 2013 19:24 j_h_86 ANSYS 0 March 20, 2013 09:33 Kevin CFX 3 October 18, 2006 12:18 ARJUN CFX 9 July 13, 2006 20:38

All times are GMT -4. The time now is 20:58.

 Contact Us - CFD Online - Top