Comment on 🤔 Interesting

<- View Parent
themagzuz@lemmy.blahaj.zone ⁨2⁊ ⁨weeks⁊ ago

ehh not exactly. the current wave within ai was started in 2017 with the google paper “attention is all you need”, which introduced the transformer architecture (the T in GPT). deep neural networks were still used for NLP before this, it was just LSTMs instead of transformers, which had various limitations

source
Sort:hotnewtop