Charles Greathouse on Tue, 15 Mar 2016 22:23:29 +0100


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Increasing precision

Suppose I have a function which needs guard digits. How can I increase the precision of an existing variable?

\p 100
x=Pi;
\p 19
y=Pi;
x-y \\ -2E-19: precision is about 19 digits
x-precision(y,100) \\ -5E-20: precision is still about 19 digits

Charles Greathouse
Analyst/Programmer
Case Western Reserve University