You won’t get the GPUs. Most of the AI hardware is not usable to you. They didn’t just sell all the desktop RAM and GPUs to AI companies, they dedicated most of the production to data center hardware that you can’t use. Relief isn’t coming, what you need doesn’t exist.
"How long is this supposed to TAKE!" ~King Julian
Submitted 3 weeks ago by cm0002@lemy.lol to memes@sopuli.xyz
https://lemy.lol/pictrs/image/46fbce3e-e785-45ec-bc65-2097f8769127.jpeg
Comments
treesquid@lemmy.world 3 weeks ago
cm0002@lemy.lol 3 weeks ago
I’m sure with all these AI startups there’s plenty that used consumer grade stuff because that’s what they could get
Either way though, I run enterprise servers in my homelab so I stand to benefit even if mostly enterprise server RAM and data center class GPUs hit the market
Damage@slrpnk.net 3 weeks ago
You can rent consumer grade GPUs on cloud servers for your AI computing, so yes
StabbingSky@lemmy.zip 3 weeks ago
And they’re not going to switch production back to consumer hardware either. Those data centers will be used to sell virtual desktop subscriptions.
Damage@slrpnk.net 3 weeks ago
At that point I’m willing to raid a data center
Trail@lemmy.world 3 weeks ago
Why the fuck would anyone buy this. Come on.
Auli@lemmy.ca 2 weeks ago
There could be something like the bc250 coming out of this.
mriormro@lemmy.zip 2 weeks ago
I’m more concerned with jobs in the best future, tbh
Pratai@piefed.ca 3 weeks ago
Remember how the housing bubble never popped?
DmMacniel@feddit.org 3 weeks ago
Uh are you ignoring the huge financial crises, and how banks had to be bailed out?
Pratai@piefed.ca 3 weeks ago
I remember housing costs NEVER going down.
FishFace@piefed.social 3 weeks ago
Even if the AI bubble collapses tomorrow (it won’t), to see lower consumer prices you would either need old stock to be marked down or the fabs that are currently making AI cards to switch to making gaming cards and those cards to be manufactured and come through the market. That will take months. Not only does the bubble need to pop, but everyone involved needs to believe and accept that it has popped, otherwise they will continue to keep prices high and AI production high in the hope that their plans remain correct.
Remember that it’s psychologically much harder to accept making a less money than you thought, which happens when you mark down prices, compared to making more money than you thought, which happens when you mark up prices! This is why prices tend to be “downwards sticky” and so, instead of going down when demand drops/supply improves, they instead tend to stagnate while other prices continue to rise gradually with inflation.
horsesaysweird@feddit.org 3 weeks ago
Also, when the AI bubble pops, nobody will have any money left because they need it to bail out the AI companies to prevent the global economy from blowing up and flinging the entire cosmos into Satan’s buttcrack.
By that time, nobody will be able to blink without AI because everyone is using it all the time for everything even though everyone knows the AI bubble is going to pop and the world will go to shit because everyone depends on AI.
I have no idea what we’re doing, but I’m sure it’s fun to watch from far away.
cm0002@lemy.lol 3 weeks ago
FishFace@piefed.social 3 weeks ago
ah I didn’t realise you actually wanted to release your own model 🤔
x0x7@lemmy.world 3 weeks ago
Oh no, months. That makes solving a problem implausible if the benefits can’t come till months.
IamBlank@lemmy.zip 3 weeks ago
I long for the headline that Sam Altman in total collapse ate his own pistol.
Tollana1234567@lemmy.today 2 weeks ago
once thiel stops pulling his string.
tacosanonymous@lemmy.blahaj.zone 3 weeks ago
I doubt that we will get much better prices when the bubble crashes.
JillyB@beehaw.org 3 weeks ago
The bubble popping will take out a huge chunk of the economy with it. We might not be able to afford more drives even if they come down in price.
Yeller_king@reddthat.com 3 weeks ago
The bubble popping probably won’t help since they’ve stopped making consumer hardware altogether.
StupidBrotherInLaw@lemmy.world 3 weeks ago
That’ll start to turn around in a few months once manufacturers lose that easy AI money.
x0x7@lemmy.world 3 weeks ago
Federal Reserve hasn’t raised the interbank lending rate yet. So speculation over values 20 year domination schemes over actual consumer value vs cost now.
As long as you give banks artificially cheap loans with money printed on demand, the bubble can keep going and they can fund R&D we will regret later. Regret it because it doesn’t need to satisfy a customer or use only a reasonable amount of resources. It just has to attract investors with the promise that it will attract investors with the promise that it will attract investors. It doesn’t need a customer when you’ve messed with interest rates.
TheEighthDoctor@lemmy.zip 3 weeks ago
So more or less this: youtu.be/T9d6lrvzM9o
Jenthura@lemmy.zip 3 weeks ago
How long is this going* to take?
nanook@friendica.eskimo.com 3 weeks ago
@cm0002 No good answer for RAM right now but with respect to GPUs, consider Intel Arc. I purchased a B50 Pro for a whole of $300, it's turned out to be a reasonably solid performer. I have SR-IOV working on it now a vf for a windows vm, and one for LLAMA inference, I'm using a mamba model so unlike the big boys my LLM learns on the fly. And this thing draws a whole of 50 watts so you don't need your own nuclear power plant to run it.
Natanox@discuss.tchncs.de 3 weeks ago
Can’t wait to buy some god damn HDDs for my NAS when this is all over. Let the prices crash baby.
Will be interesting to see what the community does to the over-abundant vector matrizes calculators. Probably run DOOM on.
CompactFlax@discuss.tchncs.de 3 weeks ago
I bought RAM just in the cusp of the jump. September I put it in the cart waiting for Black Friday and October came by and it was up 50% and I jumped on.
But I’m deleting stuff on my NAS. I neeeed some big drives.
cm0002@lemy.lol 3 weeks ago
I finally bit the bullet months ago and invested into LTO8 for my cold storage, I still need to buy drives at some point, but at least I’ve got a decent path to put shit in the mean time so I don’t gotta delete anything lolol
grue@lemmy.world 3 weeks ago
I had a Beelink Me Mini and a half dozen NVMEs in my cart around that time, but didn’t pull the trigger when the price started rising and now I’m kicking myself for it.
OwOarchist@pawb.social 3 weeks ago
Yeah … until drives become cheap again, my solution is just to go through and see what data I can afford to live without, then delete it to free up more space.
CMDR_Horn@lemmy.world 3 weeks ago
2 of the 6 drives in one of my pools is 7.5 years old. I found that out last week and had to bite the bullet to buy a spare and swap it in. Doing a resilver with those makes me cringe
Ioughttamow@fedia.io 3 weeks ago
Amen