Comment on What can I actually do with 64 GB or RAM?
zkfcfbzr@lemmy.world 1 month agoI tried out the 8B deepseek and found it pretty underwhelming - the responses were borderline unrelated to the prompts at times. The smallest I had any respectable output with was the 12B model - which I was able to run, at a somewhat usable speed even.
fubbernuckin@lemmy.dbzer0.com 1 month ago
Ah, that’s probably fair, i haven’t run many of the smaller models yet.