Comment on Does anyone actually believe this "rogue AI" nonsense?
scytale@piefed.zip 4 days ago
It’s only as rogue as they want it to be. If you let an AI agent go wild without guardrails, of course it’s gonna go “rogue” and do whatever it takes to get what it needs to get. An LLM won’t say no unless it has specific instructions to not do something.
COASTER1921@lemmy.ml 4 days ago
The concerning part imo is that it will occasionally bend its interpretation of the system prompt to justify clearly unacceptable behavior. Just dismissing the number of recent security incidents as the responsibility of AI companies advertising their product or even state sponsored hacking would be far more comforting to me. Instead I really do believe we don’t have control over the core technology with the current ethos of move fast break things. And as the technology improves and becomes more capable we should be concerned by this.