Comment on *Throws grenade and runs*
ChocolateFrostedSugarBombs@lemmy.world 4 days agoIt’s a good thing that what kind of energy it runs on is the only problem with the technology and that we can cheaply generate the necessary amount of power at home.
The_Terrible_Humbaba@slrpnk.net 4 days ago
I mean, you certainly don’t need any more energy than you would for video games, for most of the stuff people are looking to use at home.
It is possible to generate it, but even if someone can’t, I don’t see the fuckai people yelling at game Devs for increasing requirements for so little gain, or at GPU Devs for not focusing enough on the draw power of GPUs. In fact, just 1 or 2 years ago I think, NVIDIA released a GPU generation that was only a little more powerful but had a lot more energy efficiency, and they got shat on by the internet because it wasn’t powerful enough - no cared about the lower power draw.
mojofrododojo@lemmy.world 4 days ago
oh yeah running a rack of gpus full out for inference and whatnot is exactly like playing some games.
buuuullll SHIT.
ivanafterall@lemmy.world 4 days ago
Also, tons of people have complained about the increasing power requirements of increasingly large GPUs, the increasing hardware demands of “AAA” games despite the low quality, etc… An entire universe of indie games has emerged in part because of that bullshit.
mojofrododojo@lemmy.world 4 days ago
yup - a friend of mine has a dead 3080 - nvidia did not do a good job designing those power connectors.
The_Terrible_Humbaba@slrpnk.net 4 days ago
“Tons of people”
I was one of those people, on Lemmy, and I’m telling you first hand the vast majority of people did not give a shit, they just wanted a more powerful GPU
The_Terrible_Humbaba@slrpnk.net 4 days ago
You don’t need all that to run local morals, don’t straw man me.
mojofrododojo@lemmy.world 4 days ago
lol. I know you mean local models, but also I suspect your local morals are lacking too considering the other comment.
the inference and model construction take grunt bud; just because you’re not doing it yourself doesn’t make it free.