Comment on Can I use my Nvidia card for cuda related ai stuff?

PeterPoopshit@lemmy.world ⁨9⁩ ⁨months⁩ ago

Actually I got an nvidia card working on easy diffusion on Debian. The barrier for getting a chat ai working in gpu acceleration mode is actually thr fact that I don’t have the patience to deal with all that python venv nonsense so I use llamacpp. It runs in c++ which means no python dependencies to fuck you with at the cost of cpu-only generation.

source
Sort:hotnewtop