Machine learning algorithm from 2017, scaled up a few orders of magnitude so that it finally more or less works, then repackaged and sold by marketing teams.
Comment on AGI achieved đ¤
SoftestSapphic@lemmy.world â¨3⊠â¨days⊠agoMaybe they should call it what it is
Machine Learning algorithms from 1990 repackaged and sold to us by marketing teams.
jsomae@lemmy.ml â¨2⊠â¨days⊠ago
SoftestSapphic@lemmy.world â¨2⊠â¨days⊠ago
Adding weights doesnât make it a fundamentally different algorithm.
We have hit a wall where these programs have combed over the totality of the internet and all available datasets and texts in existence.
Weâre done here until thereâs a fundamentally new approach that isnât repetitive training.
jsomae@lemmy.ml â¨2⊠â¨days⊠ago
Transformers were pretty novel in 2017, I donât know if they were really around before that.
Anyway, Iâm doubtful that a larger corpus is whatâs needed at this point. (Though that said, thereâs a lot more text remaining in instant messager chat logs like discord that probably have yet to be integrated into LLMs. Not sure.) Iâm also doubtful that scaling up is going to keep working, but it wouldnât surprise that much me if it does keep working for a long while. My guess is that thereâs some small tweaks to be discovered that really improve things a lot but still basically like like repetitive training as you put it.
outhouseperilous@lemmy.dbzer0.com â¨2⊠â¨days⊠ago
Okay but have you considered that if we just reduce human intelligence enough, we can still maybe get these things equivalent to human level intelligence, or slightly above?
We have the technology.
outhouseperilous@lemmy.dbzer0.com â¨2⊠â¨days⊠ago
Hey now, thatâs unfair and queerphobic.
These models are from 1950, with juiced up data sets. Alan turing personally sid a lot of work on them, before he cracked the math and figured out they were shit and would always be shit.
SoftestSapphic@lemmy.world â¨2⊠â¨days⊠ago
Fair lol
Alan Turing was the GOAT
RIP my beautiful prince
outhouseperilous@lemmy.dbzer0.com â¨2⊠â¨days⊠ago
Also, thank you for being basically a person. This topic does a lot to convince me those arenât a thing.
outhouseperilous@lemmy.dbzer0.com â¨2⊠â¨days⊠ago
His politics werenât perfect, but he got more nazis killed than a lot of people with much worse takes, and was a genuinely brilliant reasonably ethical contributor to a lot of cool shit that should have fucking stayed cool.