R: float to integer conversion anomalies

Marco Atzeri marco_atzeri at yahoo.it
Tue Jun 30 04:55:16 CDT 2009




--- Mar 30/6/09, Levente Torok <toroklev at gmail.com> ha scritto:

> Da: Levente Torok <toroklev at gmail.com>
> Oggetto: float to integer conversion anomalies
> A: octave-maintainers at octave.org
> Data: Martedì 30 giugno 2009, 11:16
> Hi All, 
> 
> May be I am commenting something that has already been
> reported or even solved.
> On octave-3.0.5 I found a somewhat inconsistent behavior.
> 
> octave:2> for i=.1:.1:2
> > i*10
> > endfor
> ans =  1
> ans =  2
> ans =  3..00000000000000  <-????
> ans =  4
> ans =  5

may I suggest 
for i=.1:.1:2
  round(i*10)
endfor

You are missing some ground on 0.3 representation
in base 2.  
It is a periodic number so must be truncated.

> Levente
> 

Marco



      




More information about the Octave-maintainers mailing list