That’s where it would start. I imagine it would be capable to see the flaws in the system and rectify them. This most probably means we as humans won’t come out on top however.
A sentient ai would probably be the most dangerous thing to the human species as a whole.
greyscale@lemmy.sdf.org 9 months ago
If the humans can’t see the flaws and correct them now, what do you think the AI would learn from the training data?
StijnVVL@lemmy.world 9 months ago
First of all, a lot of humans do see the flaws but are indeed unable to correct them. This would also show in the training data. The AI OP is talking about would be much more powerful to actually act and change something.
Don’t confuse Artificial Narrow Intelligence (ANI) with Artificial General Intelligence (AGI) or even Artificial Superintelligence (ASI). Your statement suggest you understand ANI, which is all the AI that we know today. However powerful they seem, they can only reproduce what they have learned from the training data.
AGI (or human level AI) will be more what OP means here. Sentient, in a way that it can make its own decisions, think on a human level, feel on a human level and act on those feelings. If it feels humans are not important or harmful to what it values, it will decide to remove humanity as a whole. Give it the power to govern the world and it most certainly will act not in our favour.
greyscale@lemmy.sdf.org 9 months ago
Until computers can be genuinely creative, and not emulate creativity, its not gonna happen. And when that happens, we’re either getting the startrek luxury space communism, or a boot smashing our head into the kerb for eternity. No middle ground.
howrar@lemmy.ca 9 months ago
The entire premise of the OP is a hypothetical.
In any case, there’s plenty of work on making agents that are “genuinely creative”. Might happen sooner than you think.