Comment on How do companies that use AI for things like AI customer service representatives pay the AI company for its use ? It is a token based thing per call or just a weekly billing ?

Naich@piefed.world ⁨1⁩ ⁨day⁩ ago

• zerofk@lemmy.zip ⁨1⁩ ⁨day⁩ ago

  From personal anecdotal experience: chatting for hours would cost the company a few cents. In our company, developers are encouraged to try it out, and there are a few projects that use it a lot. The user with the highest cost has been using it in a loop, with minimal human intervention (and hence downtime), and it cost the company 2000 bucks for a month.

  With “normal” use, even extensive, it’s very hard to go above 50 bucks.

  I don’t know the company’s agreement with the provider - I’m guessing this is on top of a subscription cost - but either way if you want to make a real dent just chatting isn’t going to do it.

  source

  • Munkisquisher@lemmy.nz ⁨1⁩ ⁨day⁩ ago

    Ask it to calculate a few billions of places of pi between each answer

    source

    • RedirectedPotato@lemmy.world ⁨1⁩ ⁨day⁩ ago

      Nah, word volume between you and it burns tokens the most, so post the full bee movie script, and ask it to write a 5k essay about it, over and over

      source

      • Im_old@lemmy.world ⁨1⁩ ⁨day⁩ ago

        specifically, output tokens. The more it has to write back, the more it costs

        source