this post was submitted on 24 Apr 2026
566 points (93.4% liked)

memes

21009 readers
1988 users here now

Community rules

1. Be civilNo trolling, bigotry or other insulting / annoying behaviour

2. No politicsThis is non-politics community. For political memes please go to !politicalmemes@lemmy.world

3. No recent repostsCheck for reposts when posting a meme, you can only repost after 1 month

4. No botsNo bots without the express approval of the mods or the admins

5. No Spam/Ads/AI SlopNo advertisements or spam. This is an instance rule and the only way to live. We also consider AI slop to be spam in this community and is subject to removal.

A collection of some classic Lemmy memes for your enjoyment

Sister communities

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] chiliedogg@lemmy.world 1 points 6 hours ago

Yes, but how do you record that precision without needing a qualifying statement. When precision matters, "0.25" represents a measurement that is known to be closer to 0.25 than it is to either 0.24 or 0.26. Something that is only precise to 1/4 of a unit isn't that precise. The decimal way to record a precision of 1/4 is "0.25 +/- 0.125".

The thing to understand about decimals and precision is that you're still recording a fractional measurement, but your denominator is fixed to powers of 10. 0.1 is 1/10. 0.01 is 1/100. So when increasing precision by less than a factor of 10 is difficult to represent.

This matters a lot for things like digital calipers, where a cheap set will show the same measurement as a nice set that's more precise because the good ones aren't 10 times as precise. But if they have a fractional setting, the nicer ones will read more precisely because that increased precision can be represented on the display.