Comment on Gemini wont talk about Bernie Sanders
Sharp312@lemmy.one 15 hours agoI have dabbled with running llms locally, I’d absoluteley love to but for some reason amd dropped support for my GPU in their ROCm drivers, which are needed for using my GPU for ai on Linux.
When I tried it fell back to using my cpu and I could only use small models because of the low vram of my RX 590 😔
Smokeydope@lemmy.world 15 hours ago
I had luck with using vulcan in kobold.cpp as a substitute for rocm with my amd card.