Comment on đ¤ Interesting
HrabiaVulpes@europe.pub â¨2⊠â¨weeks⊠ago
current wave of AI isnât even new technology
We had predictive text. We had neural networks. We had both for more than few decades. Someone just decides âwhat if predictive text was built on neural network?â and it worked much better than old solution. In fact old solution worked pretty much like one-layer neural network.
TechBros literally took something we already had, made it more expensive and sold it to investors.
themagzuz@lemmy.blahaj.zone â¨2⊠â¨weeks⊠ago
ehh not exactly. the current wave within ai was started in 2017 with the google paper âattention is all you needâ, which introduced the transformer architecture (the T in GPT). deep neural networks were still used for NLP before this, it was just LSTMs instead of transformers, which had various limitations