Catastrophic Cancellation

Francesco Potorti` Potorti at isti.cnr.it
Thu Jul 3 06:39:49 CDT 2008


>But this particular example is designed specifically for machines
>with 16-bit precision.  If we rewrite the same routine using long
>doubles, which with glibc on Linux has roughly 19-bits,

What do you mean, exactly?

>the problem disappears except for a tiny region around zero.

This is true for any precision.

>						   Soon, the gcc
>compiler and glibc will support the float128 data type which will
>provide 32 bits of precision.

Again, what do you mean by "32 bits of precision"?

The precision of Octave's floating point representation is about 16
decimal digits: <https://www.cae.wisc.edu/pipermail/help-octave/2008-June/009755.html>

-- 
Francesco Potortì (ricercatore)        Voice: +39 050 315 3058 (op.2111)
ISTI - Area della ricerca CNR          Fax:   +39 050 315 2040
via G. Moruzzi 1, I-56124 Pisa         Email: Potorti at isti.cnr.it
(entrance 20, 1st floor, room C71)     Web:   http://fly.isti.cnr.it/


More information about the Help-octave mailing list