[squeakdev] Rounding to n significant digits?
karl ramberg
karlramberg at gmail.com
Thu Aug 4 12:56:05 UTC 2011
We have a issue in Etoys where this bites us.
We get a huge float instead of a expected zero.
http://tracker.squeakland.org/browse/SQ946
Karl
On Thu, Aug 4, 2011 at 2:20 PM, David T. Lewis <lewis at mail.msen.com> wrote:
> On Thu, Aug 04, 2011 at 11:20:41AM +0200, Bert Freudenberg wrote:
> > Hi,
> >
> > I'd like to print decimal Floats with at most n significant digits. E.g.
> >
> > 123456 roundToSignificantDigits: 3
> > => 123000
> > 0.00123456 roundToSignificantDigits: 3
> > => 0.00123
> >
> > Would this generally be useful? If so, what would a good selector be? And
> what a good implementation? Instead of rounding I'd be happy to just get a
> String.
>
> IMO, if it isn't considered useful, then it *should* be ;) Having grown
> up with slide rules, I'm always annoyed by display of numbers with more
> precision than is physically possible or computationally meaningful.
> So +1 from me.
>
> Answering a String seems good, because the typical use case would
> be to display a number to some number of significant digits, but
> not to change the value of the number itself.
>
> Dave
>
>
>
 next part 
An HTML attachment was scrubbed...
URL: http://lists.squeakfoundation.org/pipermail/squeakdev/attachments/20110804/8c306c4d/attachment.htm
More information about the Squeakdev
mailing list
