Comment on using ram is stealing!
W98BSoD@lemmy.dbzer0.com 1 week agoI’d love to us a local LLM that runs fairly well on like an 10-12th gen i5 and 16 GB RAM.
Any suggestions?
Comment on using ram is stealing!
W98BSoD@lemmy.dbzer0.com 1 week agoI’d love to us a local LLM that runs fairly well on like an 10-12th gen i5 and 16 GB RAM.
Any suggestions?
LeftReddit2@lemmy.world 1 week ago
Probably a smaller model of Gemma like Gemma 3n. I use a model of Gemma for my router though I forget which one specifically.