Comment on Can I use my Nvidia card for cuda related ai stuff?
youCanCallMeDragon@lemmy.world 11 months ago
I have been on my laptop with 4Gb nvidia gpu. If you’re using the webgui there’s optimization parameters like xformers and I think opt.sdp.attention or something that uses about half the amount of memory. I had to update the graphics card to get it working first.