Comment on Yes that is definitely what I was going for, thank you
ayyy@sh.itjust.works 1 month agoApple’s autocorrect is based on GPT, of chatGPT fame, but it’s the GPT2 model which came out around 2015. Back then it ran on supercomputers, now it fits in your pocket. ChatGPT uses the GPT4 model which requires really big supercomputers for now.
gmtom@lemmy.world 1 month ago
That’s to train it. Even the most modern version of AIs like deepseek or get can run on a raspberry pi.
ayyy@sh.itjust.works 1 month ago
Only if you distill it to the point of uselessness (well, even more useless). Otherwise you wouldn’t have headlines like this.
gmtom@lemmy.world 1 month ago
No? I litterally run a local deepseek model on a raspberry pi to use as an alexa-like personal assistant.
ayyy@sh.itjust.works 1 month ago
Yea I guess it works fine for anything that doesn’t require a real context window.