R: float to integer conversion anomalies
Marco Atzeri
marco_atzeri at yahoo.it
Tue Jun 30 04:55:16 CDT 2009
--- Mar 30/6/09, Levente Torok <toroklev at gmail.com> ha scritto:
> Da: Levente Torok <toroklev at gmail.com>
> Oggetto: float to integer conversion anomalies
> A: octave-maintainers at octave.org
> Data: Martedì 30 giugno 2009, 11:16
> Hi All,
>
> May be I am commenting something that has already been
> reported or even solved.
> On octave-3.0.5 I found a somewhat inconsistent behavior.
>
> octave:2> for i=.1:.1:2
> > i*10
> > endfor
> ans = 1
> ans = 2
> ans = 3..00000000000000 <-????
> ans = 4
> ans = 5
may I suggest
for i=.1:.1:2
round(i*10)
endfor
You are missing some ground on 0.3 representation
in base 2.
It is a periodic number so must be truncated.
> Levente
>
Marco
More information about the Octave-maintainers
mailing list