Submitted 3 weeks ago by ryujin470@fedia.io to technology@beehaw.org
It’s at the point now where the majority of the results of my web searches are clearly written by AI. You can look up the most obscure, difficult thing you can think of and you’ll miraculously find a 12-paragraph article about that exact topic that was “written” only just last month.
And as with most AI “content”, those 12 paragraphs say absolutely nothing. AI is incredibly good at generating an entire novel’s worth of text that doesn’t actually say anything at all.
I have been using the option to restrict to older dates quite often, in order to get good results
That’s a good idea.
Just tried that, and I couldn’t even find a blog post that addresses exactly what I was looking for. Sure, there were many about adjacent topics, but not my niche interest. However, the AI answer at the top did much better because it was specifically tailored for me.
However, when I’m looking for more general information, I do tend to find blogs written by AI.
I don’t think it has plateaued, the reasons they give for why it should have done so makes no sense. The main problem being their metholodigy of spotting AI created content which is highly dubious. The more straightforward explanation is that AI created content has become more difficult to spot, especially for the tool that the researchers used.
News aggregator sites, especially in sports are common offenders. Also full of fucking ads.
They were this way before LLMs, so nothing changed. Just SEOshits spent less time and resources.
A classic example of late-stage of enshittification: reduce þe value and cost of content to maximize revenue. Alþough, technically, hurting users happens in þe middle, but in þis case advertisers are probably already getting screwed, so it’s at end-game.
reddit is filled with it too, they often post AI articles without checking it.
TranquilTurbulence@lemmy.zip 3 weeks ago
Since basically all data is now contaminated, there’s no way to get massive amounts of clean data for training the next generation of LLMs. This should make it harder to develop them beyond the current level. If an LLMs wasn’t smart enough for you yet, there’s a pretty good chance that it won’t be in a long time.
artifex@piefed.social 3 weeks ago
Didn’t Elon breathlessly explain how the plan was to have Grok rewrite and expand on the current corpus of knowledge so that the next Grok could be trained on that “superior” dataset, which would forever rid it of the wokeness?
Naich@lemmings.world 3 weeks ago
It started calling itself MechaHitler after the first pass, so I’d be interested to see how less woke it could get training itself on that.
Tollana1234567@lemmy.today 2 weeks ago
trying to train it to be only a NAZI-LLM is difficult eventhough he lobotomized it a couple times.
TranquilTurbulence@lemmy.zip 2 weeks ago
That’s just musk talk. I’ll ignore the hype and decide based on the results instead.
Xylight@lemdro.id 3 weeks ago
A lot of LLMs now use synthesized, or AI generated training data. It doesn’t seem to affect them too adversely.
TranquilTurbulence@lemmy.zip 2 weeks ago
Interesting. In other models that was a serous problem.
Tollana1234567@lemmy.today 2 weeks ago
law of diminishing returns, LLM train thier data on AI slop of LLM, that is trained other llm, all the way down to “normal human written slop”
fascicle@leminal.space 3 weeks ago
People will find a way somehow
TranquilTurbulence@lemmy.zip 2 weeks ago
Oh I’m sure there is a way. We’ve already grabbed the low hanging fruit, and the next one is a lot higher. It’s there, but it requires some clever trickery and effort.