Comment on An OpenAI agent hacked Medicare. Will anyone be held responsible?
vonbaronhans@midwest.social 3 days agoIf I’m not misreading this… I believe the article says the same thing you are saying.
AI can’t be held accountable, but it seems weird to hold an AI user as “negligent” if they simply ask for info and the AI goes and does a crime to get it.
The next obvious target is the AI vendor, which certainly makes sense to me. But I can only imagine the legal difficulties getting a judgment there without additional legislation, which seems to be the point of the article.
kingofras@lemmy.world 3 days ago
If you are sloppy with gun safety, and your fully loaded ak47 drops on the floor and mows down a class of school kids, we wouldn’t persecute the weapons manufacturer either.
Impronoucabl@lemmy.world 3 days ago
Why not both? If the manufacturer doesn’t install a safety switch that allows a foreseeable harm to occur, I’d say they’re partially responsible too.
vonbaronhans@midwest.social 3 days ago
I don’t know the proper legal term, but there’s something like a reasonable expectation for how a product will be used.
Take something like autonomous vehicles. If a passenger hops in a Waymo and says, “take me to the airport”, it’s hardly reasonable to hold the rider responsible if the cab mows down 15 children on the way, but it does seem like something Waymo, the corporation, should be held responsible for. It is very reasonable to expect Waymo to have put precautions in place to prevent that sort of thing.
The question is, when it comes to modern AI agents, it’s kind of the wild west, legally speaking. Can we hold an LLM developer responsible for harm their AI agents do? I can see a lot of room for that, but it seems like the legal system just isn’t there yet.
kingofras@lemmy.world 3 days ago
In this case we don’t even have to worry about that distinction because the sloppy human operator and the manufacturer that’s developing one of the most consequential technologies in human history are both behaving like they’re the top cast of the next Mad Max instalment.
They are both being reckless and they have proven understanding how how dangerous it is.
The way systems will infinitely less societal consequences are tested is by building a replica interal sandbox of the real world with fake medicare records and then see if the stupid thing would go out and ignore guardrails and do the hacking.
The culpability lies solely in how (insert whatever machine here) is operated. These fuckwits are ignoring so many established precedents on testing safety established in all kinds of risk-to-life fields like medical science, aerospace engineering, car safety testing, plenty of conventional IT systems.
If the PM had a backbone he would issue a national security order banning all AI agent traffic and block access to open AI until the investigation is concluded.
vonbaronhans@midwest.social 3 days ago
Yeah. That. But the law hasn’t caught up to enforce that sort of thing, hence the article.
fakemeat@lemmy.today 3 days ago
Sig P320