Comment on What can I actually do with 64 GB or RAM?
zkfcfbzr@lemmy.world 6 days agoI tried out the 8B deepseek and found it pretty underwhelming - the responses were borderline unrelated to the prompts at times. The smallest I had any respectable output with was the 12B model - which I was able to run, at a somewhat usable speed even.
fubbernuckin@lemmy.dbzer0.com 5 days ago
Ah, that’s probably fair, i haven’t run many of the smaller models yet.