Comment on Hexadecimal
Don’t you need a beefy GPU to run local LLMs?
Depends on how many parameters you want to use. I can run it with 8billion on my laptop.
MasterNerd@lemm.ee 4 months ago
Depends on how many parameters you want to use. I can run it with 8billion on my laptop.