this post was submitted on 30 Mar 2025
133 points (98.5% liked)

Asklemmy

47737 readers
770 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 6 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Squibbles@lemmy.ca 45 points 4 weeks ago (8 children)

I bought a cheap scientific calculator for math class. When I tried to multiply .5 by .5 it gave a long irrational number instead of .25. then I had to try to explain to the store clerk why that was wrong before they would accept the return

[–] scrubbles@poptalk.scrubbles.tech 23 points 4 weeks ago (4 children)

Ah floating point math. Works fine for 90% of use cases, until it doesn't.

[–] Squibbles@lemmy.ca 6 points 4 weeks ago

Weirdly though it wasn't remotely close to the right answer so I don't think it was floating point malarkey. I always assumed some defect but I guess we'll never know.now I wish I had kept it so I could have sent it to Matt Parker for his calculator reviews

load more comments (3 replies)
load more comments (6 replies)