Comment on Anthropic publicly releases AI tool that can take over the user’s mouse cursor
Kissaki@beehaw.org 3 weeks ago
IIRC Windows has an accessibility feature where the cursor jumps to the primary default action in opening dialogs.
Doing it screenshot based seems inefficient if y du could iterate through windows and controls.
flashgnash@lemm.ee 3 weeks ago
Makes it work universally, even if the gui isn’t made with a standard toolkit
Also it’s ai they don’t care about efficiency
Toribor@corndog.social 3 weeks ago
Yeah this is one of those things where accessibility settings can probably get you 90% there but screenshots and machine learning can probably close the gap somewhat reliably (even if it’s much less efficient).