RE: Rounding figures?

Subject: RE: Rounding figures?
From: KMcLauchlan -at- chrysalis-its -dot- com
To: "TECHWR-L" <techwr-l -at- lists -dot- raycomm -dot- com>
Date: Tue, 13 Mar 2001 14:40:40 -0500


Geoff sez:

> So instead, we "unround" them
> and present numbers with more digits than the reader strictly
> needs, but
> that produce the right calculation results.

[snip]
> user ("hey, the
> inputs say 2+2 but the answer is 5!") and adds the need for readers to
> understand the plumbing of the software, when all they're
> really interested
> in is the results of the calculation. Adding that complexity
> when you could
> avoid it easily by fixing how the numbers are displayed
> strikes me as a bad
> idea.

Um, always be careful with this kind of thing.
If you pad your numbers out to x-many decimal places,
to make all the columns line up and to make the arithmetic
appear neater, you may be suggesting a level of precision
that is not valid. That is, your measuring tools/methods may
not have been capable of that degree of precision.

On the other hand, if you mix precision... where some
numbers are taken to three decimal places and others
to only one place, you are implying a level of precision in
any calculated results that probably does not exist
in the data. Your results should always be shown to
the coarsest resolution among all the numbers that
went into the calculations. If 59 numbers were 3-digit
precise, and one number was one-digit precise, then
your calculated results are valid only to one digit.

/kevin

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Develop HTML-Based Help with Macromedia Dreamweaver 4 ($100 STC Discount)
**New Dates!!** San Francisco (Apr 16-17), San Jose (Mar 29-30)
http://www.weisner.com/training/dreamweaver_help.htm or 800-646-9989.

IPCC 01, the IEEE International Professional Communication Conference,
October 24-27, 2001 at historic La Fonda in Santa Fe, New Mexico, USA.
CALL FOR PAPERS OPEN UNTIL MARCH 15. http://ieeepcs.org/2001/

---
You are currently subscribed to techwr-l as: archive -at- raycomm -dot- com
To unsubscribe send a blank email to leave-techwr-l-obscured -at- lists -dot- raycomm -dot- com
Send administrative questions to ejray -at- raycomm -dot- com -dot- Visit
http://www.raycomm.com/techwhirl/ for more resources and info.


Previous by Author: RE: writing quality
Next by Author: RE: writing quality
Previous by Thread: Rounding figures?
Next by Thread: RE: Rounding figures?


What this post helpful? Share it with friends and colleagues:


Sponsored Ads