Comment on Ok, some nerd please explain the switches on this IRL calculator app

• rockerface@lemm.ee ⁨4⁩ ⁨weeks⁩ ago

  F is likely Floating point - so, just regular precision. Not sure what A would be, then

  source

  • raccoon@sh.itjust.works ⁨4⁩ ⁨weeks⁩ ago

    Checks out, since floating point is “flyttal” in Swedish.

    source
• tyler@programming.dev ⁨4⁩ ⁨weeks⁩ ago

  For checking F try typing in an irrational number. Like 22/7

  source

  • ObviouslyNotBanana@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

    Yeah that certainly worked

    source

    • idiomaddict@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

      What does 22/7 get you under “A?”

      source

      • ObviouslyNotBanana@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

        Setting it to A and only punching the numbers divides 0.22/7 and gives the expected result of 0.03.

        Actually dividing 22/7 gives us some tasty π

        source
  • juliebean@lemm.ee ⁨4⁩ ⁨weeks⁩ ago

    did you just suggest a ratio as an irrational number?

    source

    • tyler@programming.dev ⁨4⁩ ⁨weeks⁩ ago

      Well he doesn’t have a pi button.

      source

      • ObviouslyNotBanana@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

        I wish I did but I ate a slice

        source
    • Excrubulent@slrpnk.net ⁨4⁩ ⁨weeks⁩ ago

      I noticed that too, but they are coprime with one another and they aren’t divisible by 10, so they would definitely create repeating digits. Could’ve used 1/3 for the same effect though.

      I just tried and it’s a pi approximation, which makes more sense.

      source