[squeak-dev] Float rounding issue
Levente Uzonyi
leves at elte.hu
Mon May 7 01:55:36 UTC 2012
On Sun, 6 May 2012, Chris Muller wrote:
> With the latest trunk updates, I'm having trouble rounding to my
> desired precision:
>
> 0.9580000000000001 roundTo: 0.0001 " 0.9580000000000001"
>
> In Squeak 4.3 I get what I expect:
>
> 0.9580000000000001 roundTo: 0.0001 " 0.958"
>
>
I'm pretty sure it's just a difference in printing. 0.958 is unlikely to
have an exact base 2 representation.
Levente
More information about the Squeak-dev
mailing list
|