Comment on Square Enix says it wants generative AI to be doing 70% of its QA and debugging by the end of 2027

hoshikarakitaridia@lemmy.world ⁨1⁩ ⁨day⁩ ago

• UnderpantsWeevil@lemmy.world ⁨1⁩ ⁨day⁩ ago

  You don’t let AI check your work

  From a game dev perspective, user Q&A is often annoying and repetitive labor. Endlessly criss-crossing terran hitting different buttons to make sure you don’t snag a corner or click objects in a sequence that triggers a state freeze. Hooking a PS controller to Roomba logic and having a digital tool rapidly rerun routes and explore button combos over and over, looking for failed states, is significantly better for you than hoping a massive team of dummy players can recreate the failed state by tripping into it manually.

  source

  • subignition@fedia.io ⁨1⁩ ⁨day⁩ ago

    There's plenty of room for sophisticated automation without any need to involve AI.

    source

    • UnderpantsWeevil@lemmy.world ⁨1⁩ ⁨day⁩ ago

      I mean, as a branding exercise, every form of sophisticated automation is getting the “AI” label.

      Past that, advanced pathing algorithms are what Q&A systems need to validate all possible actions within a space. That’s the bread-and-butter of AI. Its also generally how you’d describe simulated end-users on a test system.

      source

      • subignition@fedia.io ⁨16⁩ ⁨hours⁩ ago

        I mean, as a branding exercise, every form of sophisticated automation is getting the "AI" label.
        The article is specifically talking about generative AI. I think we need to find new terminology to describe the kind of automation that was colloquially referred to as AI before chatgpt et al. came into existence.

        The important distinction, I think, is that these things are still purpose-built and (mostly) explainable. When you have a bunch of nails, you design a hammer. An "AI bot" QA tester the way Booty describes in the article isn't going to be an advanced algorithm that carries out specific tests. That exists already and has for years. He's asking for something that will figure out specific tests that are worth doing when given a vague or nonexistent test plan, most likely. You need a human, or an actual AGI, for something on that level, not generative AI. And explicitly with generative AI, as pertains to Square Enix's initiative in the article, there are the typical huge risks of verifiability and hallucination. However unpleasant you may think a QA worker's job is now, I guarantee you it will be even more unpleasant when the job consists of fact-checking AI bug reports all day instead of actually doing the testing.

        source
    • Grimy@lemmy.world ⁨22⁩ ⁨hours⁩ ago

      If it does the job better, who the fuck cares. No one actually cares about how you feel about the technology. Cry me a river.

      source

      • _stranger_@lemmy.world ⁨19⁩ ⁨hours⁩ ago

        The problem is that if it doesn’t do a better job, no one left in charge will even know enough to give a shit, so quality will go down.

        source
• zerofk@lemmy.zip ⁨1⁩ ⁨day⁩ ago

  its *

  Ironically, that’s definitely something AI could check for.

  source

  • hoshikarakitaridia@lemmy.world ⁨1⁩ ⁨day⁩ ago

    Spell check? Yeah fair enough. The misspelling has historical value now though so I have to keep it in :P

    source

    • then_three_more@lemmy.world ⁨23⁩ ⁨hours⁩ ago

      Ask it for many R’s there are in strawberry

      source