Comment on Advice - Getting started with LLMs
xcjs@programming.dev 6 months agoIt should be split between VRAM and regular RAM, at least if it’s GGUF model. Maybe it’s not, and that’s what’s wrong?
Comment on Advice - Getting started with LLMs
xcjs@programming.dev 6 months agoIt should be split between VRAM and regular RAM, at least if it’s GGUF model. Maybe it’s not, and that’s what’s wrong?