• 0 Vote(s) - 0 Average
• 1
• 2
• 3
• 4
• 5
 How to force precision in SAGE? jaydfox Long Time Fellow Posts: 440 Threads: 31 Joined: Aug 2007 08/18/2007, 10:30 PM I've been trying to remove some inaccuracy from my tetration library, and I keep getting precision limited to about 10-15 digits or so. I've finally figured out that despite using a RealField(256), which should provide at least a good 80 digits of precision, I'm getting truncations to double precision at some point. The net result is that I can perform a reversible series of transformations on 0 and get back numbers like -0.00000000718... Needless to say, it's very frustrating. I haven't found a global setting in SAGE for the precision of real arithmetic, so I'm stuck having to push all my reversible transformations (like e^z-1 and ln(z+1)) through a RealField variable. Even then, I'm still losing precision somewhere. What's the "right" way to use arbitrary precision math in SAGE? Please Help! ~ Jay Daniel Fox « Next Oldest | Next Newest »

 Messages In This Thread How to force precision in SAGE? - by jaydfox - 08/18/2007, 10:30 PM RE: How to force precision in SAGE? - by jaydfox - 08/18/2007, 11:06 PM RE: How to force precision in SAGE? - by jaydfox - 08/18/2007, 11:08 PM

 Possibly Related Threads... Thread Author Replies Views Last Post Attempt to find a limit point but each step needs doubling the precision... Gottfried 15 22,176 11/09/2014, 10:25 PM Last Post: tommy1729 Precision check on [pentation.gp] SOLVED Cherrina_Pixie 7 12,888 07/02/2011, 01:39 AM Last Post: Cherrina_Pixie Sage Question? rsgerard 1 4,466 05/09/2010, 11:40 AM Last Post: bo198214 SAGE code for computing flow matrix for exp(z)-1 jaydfox 4 9,404 08/21/2009, 05:32 PM Last Post: jaydfox How to free memory in SAGE? jaydfox 2 6,085 12/21/2007, 06:38 PM Last Post: andydude SAGE code implementing slog with acceleration jaydfox 4 8,006 10/22/2007, 12:59 AM Last Post: jaydfox Complete SAGE code for tetration eyu100 4 6,983 10/18/2007, 03:55 AM Last Post: jaydfox

Users browsing this thread: 1 Guest(s)