Comment on Is AI progress stuck?
horse_battery_staple@lemmy.world 4 weeks ago
YES
The transforms these LLMs are built on are not as efficient as they are novel. Without repeatability there won’t be any kind of self learning so a next step in AI won’t work.
scrubbles@poptalk.scrubbles.tech 4 weeks ago
I really love that training llms on LLM output has been proven to cause it to unravel into nonsense. And rather than thinking about that before releasing, all these mega corps had to make profit in the short term first, and now the Internet is polluted with LLM output everywhere. I don’t know that they will be able to generate a newer version than 2021
PP_BOY_@lemmy.world 4 weeks ago
Reminds me of low-background steel