Comment on 🤔 Interesting
themagzuz@lemmy.blahaj.zone 1 month agoehh not exactly. the current wave within ai was started in 2017 with the google paper “attention is all you need”, which introduced the transformer architecture (the T in GPT). deep neural networks were still used for NLP before this, it was just LSTMs instead of transformers, which had various limitations