Submitted 6 months ago by sabreW4K3@lazysoci.al to technology@beehaw.org
“understand people’s minds” —> “be less likely to manipulate”
Alright I’m not expert enough in manipulation, but isn’t the whole idea that you understand how people think so you can trick them more efficiently ?
Besides, the AI doesn’t “think” about manipulating, it just does what it’s programming/training tells it to do, no ?
Where did he claim that it would make it less likely to manipulate? Can you give me a timestamp?
I’m just quoting the recap verbatim.
Besides, the AI doesn’t “think” about manipulating, it just does what it’s programming/training tells it to do, no ?
Not even that, it is a statistical model based on it’s dataset. If the dataset happens to contain mostly “visual impairment” as a reason for needing help to bypassing captchas (not really unexpected, because the dataset is actual text written by humans), and thus that’s the most likely route it takes. GPT indeed has no notion of concepts like a goal and using deception.
Reasoning and “thinking” can arise as emergent properties of this system. Not everything the model says is backed up by direct data. As you surely know, you’ve heard of AI hallucinations.
I believe the researchers in that experiment allowed the model to write out its thoughts to a separate place where only they could read them.
By god, watch the video and not the crappy AI-generated summary. This man is one of the best AI safety explainers in the world. You don’t have to agree with everything he says, but I think you’ll agree with the vast majority of it.
The summary is total rubbish and completely misrepresents what it’s actually about. I’m not sure why anyone would bother including that poorly AI-generated summary, if they had already watched the video. Useless AI bullshit.
The video is actually about the movement of AI Safety over the past year from something of fringe academic interest or curiosity into the mainstream of tech discourse, and even into active government policy. He discusses the advancements in AI in the past year in the context of AI Safety, namely, that they are moving faster than expected and that this increases the urgency of AI Safety research.
I’ve followed Robert Miles’ YouTube channel for years and watched his old numberphile videos before “GenAI” was really a thing. He’s a great communicator and a genuinely thoughtful guy. I think he’s overly keen on anthropomorphising what AI is doing, partly because it makes it easier to communicate, but also because I think it suits the field of research he’s dedicated himself to. In this particular video, he ascribes a “theory of mind” based on the LLM’s response to a traditional and well-known theory of mind test. The test is included in the training data, and ChatGPT3.5 successfully recognises it and responds correctly. However, when the details of the test (i.e. specific names, items, etc.) are changed, but the form of the problem is the same, ChatGPT3.5 fails. ChatGPT 4, however, still succeeds – which Miles concludes means that ChatGPT 4 has a stronger theory of mind.
My view is that this is obviously wrong. I mean, just prima facie absurd. ChatGPT3.5 correctly recognises the problem as a classic psychology question, and responds with the standard psychology answer. Miles says that the test is found in the training data. So it’s in ChatGPT4’s training data, too. And ChatGPT 4’s LLM is good enough that, even if you change the nouns used in the problem, it is still able to recognise that the problem is the same one found in its training data. That does not in any way prove it has a theory of mind! It just proves that the problem is in its training set! If 3.5 doesn’t have a theory of mind because a small change can mess up its answer, how can 4.0 have a theory of mind, if 4.0 is doing the same thing that 3.5 is doing, just a bit better?
The most obvious problem is that the theory of mind test is designed for determining whether children have developed a theory of mind yet. That is, they test whether the development of the human brain has reached a stage that is common among other human brains, in which they can correctly understand that other people may have different internal mental states. We know that humans are, generally, capable of doing this, that this understanding is developed during childhood years, and that some children develop it sooner than others. So we have devised a test to distinguish between those children who have developed this capability and those children who have not.
It would be absurd to apply the same test to anything other than a human child. It would be like giving the LLM the “mirror test” for animal self-awareness. Clearly, since the LLM cannot recognise itself in a mirror, it is not self-aware. Is that a reasonable conclusion too? Or do we cherry-pick the existing tests to suit the LLM’s capabilities?
Now, Miles’ substantial point is that the “overton window” for AI Safety has shifted, bringing it into the mainstream of tech and political discourse. To that extent, it doesn’t matter whether ChatGPT has consciousness or not, or a theory of mind, as long as enough people in mainstream tech and political discourse believe it does for it to warrant greater attention on AI Safety. Miles further believes that AI Safety is important in its own right, so perhaps he doesn’t mind whether or not the overton window has shifted on the basis of true AI capability or imagined capability. He hints at, but doesn’t really explore, the ulterior motives for large tech companies to suggest that the tools they are developing are so powerful that they might destroy the world. (He doesn’t even say it as explicitly as I did just then, which I think is a failing.) But maybe that’s ok for him, as long as AI Safety research is being taken seriously.
I disagree. It would be better to base policy on things that are true, and if you have to believe that LLMs have a theory of mind in order to gain mainstream attention on AI Safety, then I think this will lead us to bad policymaking. It will miss the real harms that AI pose – facial recognition used to bar people from shops that have a disproportionately high error rate for black people, resumé scanners and other hiring tools that, again, disproportionately discriminate against black people and other minorities, non-consensual AI porn, etc etc. We may well need policies to regulate this stuff, but focus on hypothetical existential risk of AGI in the future, over the very real and present harms that AI is doing right now, is misguided and dangerous.
It’s a pity, because if AI Safety had just stayed an academic curiosity (as Rob says it was for him), maybe we’d have the policy resources to tackle the real and present problems that AI is causing for people.
Kissaki@beehaw.org 6 months ago
uh, no, it can’t do that
Instant disqualification for me.
As far as I know, GPT-4 doesn’t autonomously do web requests. I assume either someone trained specialized it with prompts and then interfaced it with TaskRabbit themselves - or used GPT-4 to help interface to TaskRabbit too. For both of which their wording is utterly misleading or wrong.
The description certainly doesn’t want me to watch it. I don’t want to give them traffic, and I doubt it’d be positively interesting to me.
NeatNit@discuss.tchncs.de 6 months ago
Watch the actual video before your instant qualification? That summary seems AI-generated to me and isn’t even close to faithful to the video
Kissaki@beehaw.org 6 months ago
That’s a problem with the summary though, not with me taking the description seriously.
If your summary misrepresents the video, why include it? It’s gonna do the opposite of what you add it for.
Do you watch every video available? I certainly can’t. So I make use of teasers and descriptions. That’s what they’re there and useful for.