Open Menu
AllLocalCommunitiesAbout
lotide
AllLocalCommunitiesAbout
Login

Researchers show that training on “junk data” can lead to LLM “brain rot”

⁨61⁩ ⁨likes⁩

Submitted ⁨⁨3⁩ ⁨weeks⁩ ago⁩ by ⁨ryujin470@fedia.io⁩ to ⁨technology@beehaw.org⁩

https://arstechnica.com/ai/2025/10/researchers-show-that-training-on-junk-data-can-lead-to-llm-brain-rot/?comments-page=1%23comments

source

Comments

Sort:hotnewtop
  • hperrin@lemmy.ca ⁨3⁩ ⁨weeks⁩ ago

    Just like humans.

    source
  • jarfil@beehaw.org ⁨3⁩ ⁨weeks⁩ ago

    Using a complex GPT-4o prompt, they sought to pull out tweets that focused on “superficial topics

    Wait a moment… They asked an LLM, to tell them what was “junk”, and another LLM, trained on what an LLM marked as junk, turned out to be a junk LLM?

    It talks about model collapse, but this smells like research collapse.

    source
  • HappyFrog@lemmy.blahaj.zone ⁨3⁩ ⁨weeks⁩ ago

    I say continue! It will be fun to have a brain rotted ai that can only quote memes

    source
    • SharkAttak@kbin.melroy.org ⁨3⁩ ⁨weeks⁩ ago

      This explains the AWS collapse even better.

      source
  • Tollana1234567@lemmy.today ⁨3⁩ ⁨weeks⁩ ago

    no, training LLM on other LLM, on unverified facts, or sources leads to brain rot.

    source
    • darkmogool@feddit.org ⁨3⁩ ⁨weeks⁩ ago

      same, same, but different, but still the same

      source
  • VitoRobles@lemmy.today ⁨3⁩ ⁨weeks⁩ ago

    Is junk data just YouTube content because of so, then it’s already poisoned my kids and their friends.

    Whatever 67 means.

    source
  • Damage@feddit.it ⁨3⁩ ⁨weeks⁩ ago

    AI brain rots humans, itself, the internet… Just great

    source
  • OpenStars@piefed.social ⁨3⁩ ⁨weeks⁩ ago

    img

    source