Especially since the stats saying that they’re wrong about 53% of the time are right there.
Comment on You probably shouldn't trust the info anyway.
Affidavit@lemm.ee 6 days agoCan’t help but notice that you’ve cropped out your prompt.
Played around a bit, and it seems the only way to get a response like yours is to specifically ask for it.
Honestly, I’m getting pretty sick of these low-effort misinformation posts about LLMs.
LLMs aren’t perfect, but the amount of nonsensical trash ‘gotchas’ out there is really annoying.
EldritchFeminity@lemmy.blahaj.zone 6 days ago
grandkaiser@lemmy.world 4 days ago
That’s right around 9% lower than the statistic that 62% of all statistics on the Internet are made up on the spot!
EldritchFeminity@lemmy.blahaj.zone 4 days ago
I wish I had the source on hand, but you’ll just have to trust my word - after all, 47% of the time, it’s right 100% of the time!
Joking aside, I do wish I had the link to the study as it was cited in an article from earlier this year about AI making stuff up even when it cited sources (literally lying about what was in the sources it claimed it got the info from) and how the companies behind these AI collectively shrugged their shoulders and said “there’s nothing we can do about it” when asked what they intend to do about these “hallucinations,” as they call them.
grandkaiser@lemmy.world 4 days ago
I do hope you can find it! It’s especially strange that the companies all implied that there was no answer (especially considering that reducing hallucinations has been one of the primary goals over the past year!) Maybe they meant that there was no answer at the moment. Much like how the wright Brothers had no way to control the random pitching and rolling and had no answer to it. (Of course the invention of the aileron would fix that later.)
_bcron@lemmy.world 6 days ago
The prompt was ‘safest way to cook rice’, but I usually just use LLMs to try to teach it slang so it probably thinks I’m 12. But it has no qualms encouraging me to build plywood ornithopters and make mistakes lol
Image
Affidavit@lemm.ee 6 days ago
Here’s my first attempt at that prompt using OpenAI’s ChatGPT4. I tested the same prompt using other models as well, (e.g. Llama and Wizard), both gave legitimate responses in the first attempt. Image
I get that it’s currently ‘in’ to dis AI, but frankly, it’s pretty disingenuous how every other post about AI I see is blatant misinformation.
Does AI hallucinate? Hell yes. It makes up shit all the time. Are the responses overly cautious? I’d say they are, but nowhere near as much as people claim. LLMs can be a useful tool. Trusting them blindly would be foolish, but I sincerely doubt that the response you linked was unbiased, either by previous prompts or numerous attempts to ‘reroll’ the response until you got something you wanted to build your own narrative.
_bcron@lemmy.world 6 days ago
I don’t think I’m sufficiently explaining that I’ve never made an earnest attempt at a sane structured conversation with Gemini, like ever.
Image
hoshikarakitaridia@lemmy.world 6 days ago
I love this lmao
When chatgpt calls you the rizzler you know we living in the future
_bcron@lemmy.world 6 days ago
That entire conversation began with “My neighbors parrot grammar mogged me again, what do” and Gemini talked me into mogging the parrot in various other ways since clearly grammar isn’t my strong suit
Revan343@lemmy.ca 6 days ago
So do have like a mastodon where you post these? Because that’s hilarious
_bcron@lemmy.world 6 days ago
No I just send snippets to my family’s group chat until my parents quit acknowledging my existence for months because they presumptively silenced the entire thread, and then Christmas rolls around and they find out my sister had a whole fucking baby in the meantime