Comment on Can I use my Nvidia card for cuda related ai stuff?
PeterPoopshit@lemmy.world 11 months ago
Actually I got an nvidia card working on easy diffusion on Debian. The barrier for getting a chat ai working in gpu acceleration mode is actually thr fact that I don’t have the patience to deal with all that python venv nonsense so I use llamacpp. It runs in c++ which means no python dependencies to fuck you with at the cost of cpu-only generation.