Comment on Advice - Getting started with LLMs

<- View Parent
xcjs@programming.dev ⁨7⁩ ⁨months⁩ ago

It should be split between VRAM and regular RAM, at least if it’s GGUF model. Maybe it’s not, and that’s what’s wrong?

source
Sort:hotnewtop