Comment on AI Seeks Out Racist Language in Property Deeds for Termination
apotheotic@beehaw.org 5 weeks agoThe person you’re replying to is correct though. They do not understand, they do not analyse. They generate (roughly) the most statistically likely answer to your prompt, which may very well end up being text representing an accurate analysis. They might even be incredibly reliable at doing so. But this person is just pushing back against the idea of these models actually understanding or analysing. Its slightly pedantic, sure, but its important to distinguish in the world of machine intelligence.
GetOffMyLan@programming.dev 5 weeks ago
I literally quoted the word for that exact reason. It just gets really tiring when you talk about AIs and someone always has to make this point. We all know they don’t think or understand in the same way we do. No one gains anything by it being pointed out constantly.
apotheotic@beehaw.org 5 weeks ago
You said “they literally do analyze text” when that is not, literally, what they do.
And no, we don’t “all know” that. Lay persons have no way of knowing whether AI products currently in use have any capacity for genuine understanding and reasoning, other than the fact that the promotional material uses words like “understanding”, “reasoning”, “thought process”, and people talking about it use the same words. The language we choose to use is important!
GetOffMyLan@programming.dev 4 weeks ago
No it’s not. It’s pedantic and arguing semantics. It is essentially useless and a waste of everyone’s time.
apotheotic@beehaw.org 4 weeks ago
I never made any “AI bad” arguments (in fact, I said that they may be incredibly well suited to this) I just argued for the correct use of words and you hallucinated.
knightly@pawb.social 4 weeks ago
LLMs arent “bad” (ignoring, of course, the massive content theft necessary to train them), but they are being wildly misused.
“Analysis” is precisely one of those misuses. Grand Theft Autocomplete can’t even count, ask it how many 'e’s are in “elephant” and you’ll get an answer anywhere from 1 to 3.
This is because they do not read or understand, they produce strings of tokens based on a statistical likelihood of what comes next. If prompted for an analysis they’ll output something that looks like an analysis, but to determine whether it is accurate or not a human has to do the work.
Rivalarrival@lemmy.today 4 weeks ago
The human capacity for reason is greatly overrated. The overwhelming majority of conversation is regurgitated thought, which is exactly what LLMs are designed to do.
apotheotic@beehaw.org 4 weeks ago
I don’t really dispute that but at least we are able to apply formal analytical methods with repeatable outcomes. LLMs might (and do) achieve a similar result but they do so without any formal approach that can be reviewed, which has its drawbacks.