I think it’s less of an issue of LLMs being drunk and more that ostensibly sober people put them behind the wheel totally aware of how drunk they are while telling everyone that they’re stone cold sober.
Large Language Models Are Drunk at the Wheel
Submitted 8 months ago by jansk@beehaw.org to technology@beehaw.org
https://matt.si/2024-02/llms-overpromised/
Comments
Kwakigra@beehaw.org 8 months ago
redxef@feddit.de 8 months ago
I’ve seen so many bots on lemmy summarising the contents of websites and blocked all of them, because of this. They are not reliable, and I still caught myself reading those. I don’t even want to know how many summaries which are in a post body are just generated by an LLM.
tal@lemmy.today 8 months ago
Pretty sure that this has been happening for as long as AI and similar things like machine learning have been a thing. Overstated promises, people consistently presenting research or products or investments using the sexiest terms they can manage. New term comes out (e.g. “Artificial General Intelligence”) to differentiate more-sophisticated AI, and they get latched onto and dragged down into the muck too.
I think that the fix is to come up with terms attached to concrete technical capabilities, where there’s no fuzziness to exploit by people trying to promote things.
GenderNeutralBro@lemmy.sdf.org 8 months ago
AGI is not a new term. It’s been in use since the 90s and the concept has been around for much longer.
I agree that we should use more specific terms whenever possible. I call LLMs “LLMs” or “language models”. Not that it’s inaccurate to call them AI, but it’s not useful either. AI is an extraordinarily broad term. Pac-Man had AI. And there’s a large portion of the population who thinks it means something much, much more lofty and specific than it ever really has. At this point, the term should probably be abandoned. Any attempt to reclaim it is bound to fail.
I see this as yet another example of a technical term being bastardized by mainstream press who do not understand the field. It happens all the time with tech. I remember when “virus” actually meant something; the industry eventually abandoned the term because it was bastardized to the point of uselessness; now we just say “malware” and if we need to refer to viruses specifically…well we just don’t for the most part.
This is a linguistic problem more than a technical problem.
tal@kbin.social 8 months ago
It's not new today, but it post-dates "AI" and hit the same problem then.
eveninghere@beehaw.org 8 months ago
What’s funny, we complain about the terminology use of AI, but nobody can actually define the intelligence.