brucethemoose
@brucethemoose@lemmy.world
- Comment on Do LLM modelers maintain a list of manual corrections fed by humans? 3 days ago:
Yes. Absolutely.
The meme in the research community is that current LLMs are literally trained on benchmarks and common stuff people test in LM-Arena, like the how many r’s in strawberry question.
I’m not talking speculatively: Meta literally got caught red-handed doing this. They ran a separate finetune just to look good on lm-arena. And some benchmarks like MMLU have errors in them that many LLMs *answer ‘correctly’.
- Comment on Steam: Updates to User Review Scores Based on Language 4 days ago:
Full disclosure, I will sometimes cry about cryptocurrency stuff. But I mined a bitcoin many moons ago, too!
- Comment on Steam: Updates to User Review Scores Based on Language 4 days ago:
Yeah.
That’s the vibe I get from Lemmygrad too, like they assume the rest of the world is constantly pondering how much they hate China, as a dominating thought.
- Comment on Zuckerberg's Huge AI Push Is Already Crumbling Into Chaos 5 days ago:
But they are putting the horse before the cart. These APIs and models are unsexy commodities, and Meta doesn’t have anything close to something they can charge for. Even OpenAI and Anthropic can barely justify it these days.
Others building on top Llama get them there, though. Which all the Chinese companies recognize now and are emulating: they can open the model, let it snowball with communal development to wipe out closed competitors, then offer products on top of it.
What’s conspicuous is that (at least some) in Meta recognized this. But Zuck is so fickle he won’t stick with any good idea.
- Comment on Zuckerberg's Huge AI Push Is Already Crumbling Into Chaos 5 days ago:
Yeah the article is pretty bad… But the missing context is Zuckerberg let a lot of devs go, and the lab that actually built something neat (Llama 1-4) has all but been dismantled.
The new hires reek of tech bro and big egos butting together, especially the (alleged) talk to close source their next models. ‘TBD Lab’ is supposedly tasked with the next Llama release, but I am not holding my breath.
- Comment on Civilization 7's latest update has "hit mods harder than usual", but for a good reason 6 days ago:
Aside:
“We wanted to acknowledge that this update hit mods harder than usual,” community manager Sarah Engel wrote on the game’s Discord.
I despise Discord. Every single niche I love is now locked behind a bunch of unsearchable banter in closed, often invite-only apps.
- Comment on Civilization 7's latest update has "hit mods harder than usual", but for a good reason 6 days ago:
Yeah, I think early access is a great model. Certainly better than “release it and (maybe) fix it later”
- Comment on Jonathan Frakes Surprised ‘Strange New Worlds’ Star Trek Spoof Was Controversial; Talks Directing ‘Academy’ And More 6 days ago:
I mean, I wish TNG was a little less silly too.
- Comment on What's your thoughts on this? 1 week ago:
one viral AI avatar or “Barbie Box” image can consume enough energy to fully charge an electric car several times.
A Model 3 battery is ~200,000 kiloJoules.
Absolute worst case for an image, even taking extreme estimates and amortizing out all the training, is like 20kJ. Maybe 60kJ for a slop video that takes under a minute to render, which is on the order of browsing Lemmy on a laptop for a bit.
- Comment on We’re Suing Minecraft in a Class Action Lawsuit 1 week ago:
I only appreciate this because I hate watching videos instead of reading texts for subjects like this. It’s so much slower.
- Comment on We’re Suing Minecraft in a Class Action Lawsuit 1 week ago:
We’re talking about a modder making something as a hobby/passion project, not some suit trying to push that to everyone.
- Comment on Where do you ask for TV Show suggestion on Lemy? 1 week ago:
Try lemmy.world/c/television@piefed.social
Or ask here too, heh.
- Comment on AI experts return from China stunned: The U.S. grid is so weak, the race may already be over 1 week ago:
I mean, I’m a local AI evangelist and have made a living off it. The energy use of AI thing is total nonsense, as much as Lemmy doesn’t like to hear it.
I keep a 32B or 49B loaded pretty much all the time.
You are right about the theft vs social media thing too, even if you put it a little abrasively. Why people are so worked up in the face of machines like Facebook and Google is mind boggling.
…But AI is a freaking bubble, too.
Look at company valuations vs how shit isn’t working, and how much it costs.
Look around the ML research community. They all know Altman and his infinite scaling to AGI pitch is just a big fat tech bro lie. AI is going to move forward as a useful tool through making it smaller and more efficient, but transformers LLMs with randomized sampling are not just going to turn into real artificial intelligence if enough investors thrown money at these closed off enterprises.
- Comment on AI experts return from China stunned: The U.S. grid is so weak, the race may already be over 1 week ago:
The irony is Zuck shuttered the absolute best asset they have: the Llama LLM team.
Cuz, you know, he’s a fickle coward who would say and do anything to hide his insecurity.
- Comment on Tencent doesn’t care if it can buy American GPUs again – it already has all the chips it needs 1 week ago:
I think the underlying message is making/serving AI isn’t a mythical goldmine: it’s becoming a dirt cheap commodity, and a tool for companies to use.
- Comment on AI experts return from China stunned: The U.S. grid is so weak, the race may already be over 1 week ago:
This is all based on the assumption that AI will need exponential power.
It will not.
-
AI is a bubble.
-
Even if it isn’t, fab capacity is limited.
-
The actual ‘AI’ market is racing to the bottom with smaller, task focused models.
-
A bunch of reproduced papers (like bitnet) that reduce power exponentially are just waiting for someone to try a larger test.
-
Alltogether… inference moves to smartphones and PCs.
This is just the finance crowd parroting Altman. Not that the US doesnt need a better energy grid like China, but the justification is built on lies that just aren’t going to happen.
-
- Comment on [deleted] 1 week ago:
Judge the risk of him finding out from someone else. I think only you can decide that, based on your situation and peers.
When he finds out, it should be from you. And you don’t have to go into specifics when you tell him.
Picture it from his perspective. If one of his friends (who found out from their parent or something) tells your son, do you want him to be surprised you were keeping a secret based on how some teenage boy describes it? Or would you want him to already know the basics from you?
- Comment on Anon is feeling romantic 1 week ago:
Does a fanfic count?
- Comment on Begun the kernel wars have 1 week ago:
Yeah, I remember this with CoD.
Everyone I knew was on console through. Are people cross playing these days? Or using PC more?
- Comment on Begun the kernel wars have 1 week ago:
I think the point is there are a lot of excellent shooters to choose from.
- Comment on The New Yorker Asks: Is the A.I. Boom Turning Into an A.I. Bubble? 1 week ago:
because there’s seemingly not enough power infrastructure
This is overblown. I mean, if you estimate TSMC’s entire capacity and assume every data center GPU they make is full TDP 100% of the time (which is not true), the net consumption isn’t that high. The local power/cooling infrastructure things are more about corpo cost cutting.
Altman’s preaching that power use will be exponential is a lie that’s already crumbling.
But there is absolutely precedent for underused hardware flooding the used markets, or getting cheap on cloud providers. Honestly this would be incredible for the local inference community, as it would give tinkerers (like me) actually affordable access to experiment with.
- Comment on The New Yorker Asks: Is the A.I. Boom Turning Into an A.I. Bubble? 1 week ago:
Not a lot? The quirk is they’ve hyper specialized nodes around AI.
The GPU boxes are useful for some other things, but they will be massively oversupplied, and they mostly aren’t networked like supercomputer clusters.
- Comment on The New Yorker Asks: Is the A.I. Boom Turning Into an A.I. Bubble? 1 week ago:
I mean, hardware prices will fall if there’s a crash, like they did with crypto GPU mining.
I am salivating over this. Bring out the firesale A100s.
- Comment on The New Yorker Asks: Is the A.I. Boom Turning Into an A.I. Bubble? 1 week ago:
Ohhh yes. Altmans promotion for it was the Death Star coming up from behind a planet.
Maybe something on the corporate side, like big players not seeing a return of their investment.
Ohhh, it is. The big corporate hosters arent making much money and burning cash, and it’s not getting any better as specialized open models eat them from the bottom up.
- Comment on Could I just create my own drive format? 1 week ago:
FYI you might be interested in WinBTRFS:
Which is basically what you are describing: shoehorning support for a new file system into Windows.
Linux also has all sorts of exotic and special purpose filesystem, like swap on spare GPU VRAM, software managed SSD stacks and such.
- Comment on Could this possibly be one of the dumbest reddit bans ever? 1 week ago:
It is when you keep getting shadowbanned for no discernable reason, like me.
And not like ‘I’m a jerk and don’t recognize it.’ I literally only posted in a fandom TV sub and a niche technical sub, never even close to combative…
- Comment on AI IS BURNING THE PLANNET!! 2 weeks ago:
AI power growth is projected to grow exponentially for a service a lot of people view as morally reprehensible and actively harmful
And this is a lie altman is telling to get more money.
It’s not scaling. GPT-5 is making it more obvious, but the ML research community has known this for some time.
- Comment on GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it. 2 weeks ago:
Nah, I tried them. For the size, they suck, mostly because there’s a high chance they will randomly refuse anything you ask them unless it STEM or Code.
…And there are better models if all you need is STEM and Code.
- Comment on New idea 2 weeks ago:
Milk Pipe Network
steamcommunity.com/sharedfiles/filedetails/?id=29…
A bit more elaborate:
www.youtube.com/watch?v=NXEcVNsDO_U
And, of course, IRL!
Milk Pipe Hoses
- Comment on A dedicated section in my Steam library 2 weeks ago:
TBH I love getting attached to good characters with good VAs and cutscenes in games (though I haven’t plated 33 yet).
I would cite FemV. CP2077 would be alright with an unvoiced protag (for me), but the VA fucking killed it, especially with the dynamic with Johnny.