Comment on Nvidia Announces RTX 50's Graphic Card Blackwell Series: RTX 5090 ($1999), RTX 5080 ($999), RTX 5070 Ti ($749), RTX 5070 ($549)
What if I’m buying a graphics card to run Flux or an LLM locally. Aren’t these cards good for those use cases?
Oh yeah for sure, I’ve run Llama 3.2 on my RTX 4080 and it struggles but it’s not obnoxiously slow. I think they are betting more software will ship with integrated LLMs that run locally on users PCs instead of relying on cloud compute.
Breve@pawb.social 2 days ago
Oh yeah for sure, I’ve run Llama 3.2 on my RTX 4080 and it struggles but it’s not obnoxiously slow. I think they are betting more software will ship with integrated LLMs that run locally on users PCs instead of relying on cloud compute.