Comment on If so-called AI is basically just Large Language Models, how come predictive text on my phone is bollock-useless?

asterfield@lemmy.world ⁨6⁩ ⁨months⁩ ago

LLMs like chatgpt take a wild amount of resources to run.

If you want something as smart as gpt3 and you want it to run at typing speeds, you’ll need a gaming PC running it.

People just recently managed to run gpt3 strength models at all on ordinary laptop hardware (slowly).

There is currently no way to run something gpt4 strength on ordinary consumer hardware (I’m just guessing but I think it takes a few hundred gb of VRAM to run)

source
Sort:hotnewtop