Can I use my Nvidia card for cuda related ai stuff?

Comments

• what@lemmy.world ⁨11⁩ ⁨months⁩ ago

  I’ve been using cuda for cracking hashes without issue. Now if someone at Nvidia could work on not making their driver suck at daily driving on Linux it would be great

  source

  • cyberpunk007@lemmy.ca ⁨11⁩ ⁨months⁩ ago

    Nvidia: 😂

    source
  • AnarchistsForDemocracy@lemmy.world ⁨11⁩ ⁨months⁩ ago

    AMD is boss

    source
• PeterPoopshit@lemmy.world ⁨11⁩ ⁨months⁩ ago

  Actually I got an nvidia card working on easy diffusion on Debian. The barrier for getting a chat ai working in gpu acceleration mode is actually thr fact that I don’t have the patience to deal with all that python venv nonsense so I use llamacpp. It runs in c++ which means no python dependencies to fuck you with at the cost of cpu-only generation.

  source
• youCanCallMeDragon@lemmy.world ⁨11⁩ ⁨months⁩ ago

  I have been on my laptop with 4Gb nvidia gpu. If you’re using the webgui there’s optimization parameters like xformers and I think opt.sdp.attention or something that uses about half the amount of memory. I had to update the graphics card to get it working first.

  source
• QaspR@lemmy.world ⁨11⁩ ⁨months⁩ ago

  Yeah, for sure. I use my GTX 1070 for CUDA stuff all the time.

  source
• Enzy@lemm.ee ⁨11⁩ ⁨months⁩ ago

  Yes just rotate it and connect it to the cpu bearings

  source
• PlanetOfOrd@lemmy.world ⁨11⁩ ⁨months⁩ ago

  Yup, start by running nvidia-smi to get the details on your Nvidia. Then install pytorch. The rest is up to you!

  source
• nomecks@lemmy.world ⁨11⁩ ⁨months⁩ ago

  Like not plugged to power, or not plugged to a display?

  source

  • AnarchistsForDemocracy@lemmy.world ⁨11⁩ ⁨months⁩ ago

    Not plugged to display, still plugged into the motherboard.

    source

    • nomecks@lemmy.world ⁨11⁩ ⁨months⁩ ago

      I can’t speak to compatibility with AMD but having a display connected isn’t a requirement

      source

      • -> View More Comments
  • AnarchistsForDemocracy@lemmy.world ⁨11⁩ ⁨months⁩ ago

    I’m sorry I misremebered everything. Seems like my nvidia is hooked up to my screens it’s just the amd that is plugged into the mother board while not plugged into any screens. Can I use the amd card for ai stuff as well? I was trying to use pytorch for now

    source

    • rufus@discuss.tchncs.de ⁨11⁩ ⁨months⁩ ago

      AMD’s compute stack is called ROCm.

      rocm.docs.amd.com/en/latest/

      source

      • -> View More Comments