Open Menu
AllLocalCommunitiesAbout
lotide
AllLocalCommunitiesAbout
Login

Can LLMs Do Accounting? Evaluating LLMs on Real Long-Horizon Business Tasks

⁨16⁩ ⁨likes⁩

Submitted ⁨⁨3⁩ ⁨days⁩ ago⁩ by ⁨cm0002@lemmy.world⁩ to ⁨technology@lemmy.zip⁩

https://accounting.penrose.com/

source

Comments

Sort:hotnewtop
  • gravitas_deficiency@sh.itjust.works ⁨3⁩ ⁨days⁩ ago

    Oh my god that’s hilarious and insane. What a comically stupid application to plug LLMs into. You absolutely want your accounting software to be entirely deterministic. You do NOT want your accounting software to be stochastic.

    source
    • passepartout@feddit.org ⁨3⁩ ⁨days⁩ ago

      You absolutely want your accounting software to be entirely deterministic.

      This always bugs me with all the use cases LLMs get shoehorned into. Letting these do anything unsupervised is literally begging for chaos to happen.

      source
      • gravitas_deficiency@sh.itjust.works ⁨3⁩ ⁨days⁩ ago

        Right there with you. And it’s always pushed by people who don’t actual understand the implications and constraints of specific problems.

        source
  • owenfromcanada@lemmy.ca ⁨3⁩ ⁨days⁩ ago

    LLMs can’t do basic math, and can be convinced that 2 + 2 = potato. Don’t put it in charge of your finances.

    source
  • m4xie@lemmy.ca ⁨3⁩ ⁨days⁩ ago

    Why would anyone think a language model would be suited to mathematics?

    source
  • EdanGrey@sh.itjust.works ⁨3⁩ ⁨days⁩ ago

    I’m an accountant. I’m not convinced that AI is going to replace me. This did not change my mind one bit!

    source