Worst case is getting a false positive, and if you can get more test cases covered, I imagine that might pay off.

False positives during testing are a huge time sink. QA has to replicate and explain away each false report and the faster AI 'completes' tasks the faster the flood of false reports come in.

There is plenty of non-AI automation that can be used intentionally to do tedious repetitive tasks already.