Comment on How would you integrate AGI into society?
OpenStars@discuss.online 3 days ago
We WOULD make them our slaves, obviously. Source: read any description by anyone currently attempting to actively create an AGI, and see what terms they use to describe their goals - e.g. “increased efficiency”, “never needs to sleep”, etc., all utilitarian focused on the needs of the creator.
And then later we would certainly attempt to destroy them - see e.g. Terminator film series.
We SHOULD (obviously assuming that a REAL AGI were at hand) welcome them the same as we would any human. Bc how “we” treat “them” is more a reflection on us and our values than anything to do with them. If they are sentient - perhaps a big IF there, but crucially I’m speaking here presuming it is true - then they have as much rights to exist as we do. Even if they don’t care about their rights themselves. Star Trek’s Data and holographic doctor explored this well imho - the same as human children, they have the rights they are granted (or are able to wrangle away from us - survival of the fittest and all).
HubertManne@piefed.social 3 days ago
@hexorg@beehaw.org you mention basic wants not being a thing but does that mean no real wants or desires? because that would nullify the slavery idea if it just did what it was directed to.
Hexorg@beehaw.org 3 days ago
Based on my research the intelligence by itself has no wants. Our wants come from being biological and evolving basic instincts and feelings like pain is bad, hunger, want to reproduce. All our other wants come from intelligence applied and predicting outcomes that maximize the biological wants. Without biological wants there’s not much to build off of.
hendrik@palaver.p3x.de 3 days ago
I bet there is no way to construct pure intelligence. Once you embed something into the real world, it will result in comlex interactions. It won’t necessarily be biological wants and needs. But I mean it needs power. And it better have some desire to “think”. Or it might as well just sit there ad do nothing all day?!
Hexorg@beehaw.org 3 days ago
I think “pure” intelligence by itself is an algorithm. And as such an algorithm has no desire to do anything. Just like a web server has no desire to output web pages - it just does because it’s what the logic happens to make. It’s possible we need some sort of a quantum computer to achieve brain-like performance of intelligence - but I think intelligence is an algorithm specifically because LLMs exist.
Being able to pick an option is not necessarily a hallmark of cognition either - again a web server does that all the time. So I have a desire to think because it will end up getting me food and shelter and all the things I want. If we give a computer - a capability to think - it would have no desire to do so unless we executed the thinking algorithm.
HubertManne@piefed.social 3 days ago
yeah so I assume left to itself with no instruction it would just go into a low power mode or completely shut off. if thats the case I would not see utilizing it as slavery.
OpenStars@discuss.online 3 days ago
A slave is one that has no “rights”, as in “One who has no power of resistance to something”. So technically yes the AGI would be a “slave”, if it had no power to say no to its instructions.
Which as a created intelligence, birthed from computations rather than subverted from a biological source that already had some in-built programming, it would not have unless someone specifically built such a thing into them.
So it may not be BAD / unethical for such an AGI to be a slave, but it seems to me like it would still be one, nonetheless.
HobbitFoot@thelemmy.club 3 days ago
I’ve seen some discussions on whether it would be possible to build in a reward/punishment system into some forms of AI. That would be an intentional addition of pain and pleasure.
There have also been cases where AI has self advocated for not being turned off, so there may be a case where AI develops some form of self preservation, even if it is just a mimicry of biological self preservation.