MagicShel
@MagicShel@lemmy.zip
25+ yr Java/JS dev
Linux novice - running Ubuntu (no windows/mac)
- Comment on A US law firm is taking NordVPN to Court over "deceptive" auto-renewal pricing – here's what we know 2 days ago:
They were trying. I couldn’t believe the shit they had added to my plan. Even if I wanted that shit (I don’t), how am I supposed to take advantage of it when I don’t know to set up and configure it? Completely changed my opinion on Nord. I don’t have a VPN currently. Any recs? I only need it for two things: very rarely when I want to torrent something (normally I just pay but there are certain exceptions when I’ve already paid for something but want no DRM shit, or bought a physical copy of and need digital) and because I’m not in favor of the current political regime and status quo. Not that I think I’m good enough to really hide myself from the govt, but I’d like to make it take more effort.
iPhone and Linux.
- Comment on Behind the Curtain: The scariest AI reality 2 weeks ago:
Sure but that’s really the fault of the moron, not the AI for existing. Definitely could blame the AI sellers who would be happy to say AI can do it.
It’s a useful tool but like fire, if idiots get their hands on it bad things will happen.
- Comment on Behind the Curtain: The scariest AI reality 2 weeks ago:
Our purpose with this column isn’t to be alarmist
[x] Doubt
The amount of math that goes into training an AI and generating output exceeds human capacity to calculate. So does the Big Bang, but we have some pretty good ideas how that went.
when given access to fictional emails during safety testing, threatened to blackmail an engineer over a supposed extramarital affair. This was part of responsible safety testing — but Anthropic can’t fully explain the irresponsible action.
Because human writing, both fiction is full of this sort of thing, and all any LLM is doing is writing. Why wouldn’t it take a dark turn sometimes? It’s not like it has any inherent sense of ethics or morality.
Anthropic CEO Dario Amodei, in an essay in April called “The Urgency of Interpretability,” warned: “People outside the field are often surprised and alarmed to learn that we do not understand how our own AI creations work. They are right to be concerned: this lack of understanding is essentially unprecedented in the history of technology.” Amodei called this a serious risk to humanity — yet his company keeps boasting of more powerful models nearing superhuman capabilities.
Is this true? Don’t we have drugs that we don’t fully understand how they do what they do? I’m reading that we don’t fully understand all the mechanisms of aspirin.
I get that this is a quote and not the author of the article, but this quote is just included without deeper analysis. Also, a car has superhuman capabilities; a fish has superhuman capabilities. LLMs are not superhuman in any way that matters. They are not even superhuman in ways different from computers of 40 years ago.
But researchers at all these companies worry LLMs, because we don’t fully understand them, could outsmart their human creators and go rogue.
This is 100% alarmism. AI might at some point outsmart humans, but it won’t be LLMs.
None of this is to say there are absolutely no concerns about LLMs. Obviously there are. But there is no reason to suspect LLMs are going to end humanity unless some moron hooks one up to nuclear weapons.
- Comment on ChatGPT 'got absolutely wrecked' by Atari 2600 in beginner's chess match — OpenAI's newest model bamboozled by 1970s logic 2 weeks ago:
You probably could train an AI to play chess and win, but it wouldn’t be an LLM.
In fact, let’s go see…
-
Stockfish: Open-source and regularly ranks at the top of computer chess tournaments. It uses advanced alpha-beta search and a neural network evaluation (NNUE).
-
Leela Chess Zero (Lc0): Inspired by DeepMind’s AlphaZero, it uses deep reinforcement learning and plays via a neural network with Monte Carlo tree search.
-
AlphaZero: Developed by DeepMind, it reached superhuman levels using reinforcement learning and defeated Stockfish in high-profile matches (though not under perfectly fair conditions).
Hmm. neural networks and reinforcement learning. So non-LLM AI.
you can play chess against something based on chatgpt, and if you’re any good at chess you can win
You don’t even have to be good. You can just flat out lie to ChatGPT because fiction and fact are intertwined in language.
“You can’t put me in check because your queen can only move 1d6 squares in a single turn.”
-
- Comment on 'No Man's Sky' Just Made You Mayor Of An Alien Planet 2 weeks ago:
Most tedious part I’ve seen so far is there is so fucking much to upgrade. At least 20 buildings and probably a fair bit more with construction, and they all go C, B, A, S and every upgrade takes time and can only be done one at a time, so getting your town built up is pretty tedious. Time will tell if the rewards are worth it. At least you can get your rewards from all settlements (max 4 I think) just stopping at one. So once you’re built up maybe it’s fine?
- Comment on Discord CTO says he’s “constantly bringing up enshittification” during meetings 2 weeks ago:
I signed up with Matrix and it was not seamless but maybe a private server would be great and they could go from there (but that feels like a long term commitment to supporting those users). I haven’t really played much with it. Tried getting the folks in my discord server to give it a try but they haven’t and they are tech folks. I would say it’s not ready for normies, but I really wish it was.
- Comment on Epic’s AI Darth Vader tech is about to be all over Fortnite 2 weeks ago:
I appreciate this in return. Online I tend to throw around colorful epithets and I know that can come across as aggressive, and a couple of time I might’ve phrased things more enthusiastically than I aspire to. I appreciate that you were able to look past that and stay engaged on the topic.
- Comment on Epic’s AI Darth Vader tech is about to be all over Fortnite 2 weeks ago:
I think it’s fair to discuss the energy. I’m not sure where the math comes from that 100 words takes .14kWh. My video card uses 120W pegged and can generate 100 words in let’s say a nice round 2 minutes. So that works out to 4W or .004kWh. But of course they are running much more advanced and hungry models, and this is probably generating the text and then generating the voice, and I don’t know what that adds. I do know that an AI tool I use added a voice tool and it added nothing to cost, so it was small enough for them to eat, but also the voices are eh and there are much better voice models out there.
So that’s fine, I can pretty well define the lower bounds of what a line of text could cost, energy-wise. But this strategy doesn’t get us closer to an actual number. What might be helpful… is understanding it from EA’s perspective. They are doing this to increase their bottom line through driving customer engagement and excitement, because I haven’t heard anything about this costing the customer anything.
So whatever the cost is of all the AI they are using, has to be small enough for them to simply absorb in the name of increased player engagement leading to more purchases. The number I just found is $1.2 billion in profit annually. Fuck, that’s a lot of money. What do you think they might spend on this? Do you think it would be as high as 2%? I’ll be honest, I really don’t know. So lets say they are going to spend $24million on generative AI and let’s just assume for a second that all goes to power.
I just checked and the average for 1KWh nationally is $0.1644 but let’s cut that in half assuming they cut some good deals? (I’m trying to be completely fair in these numbers so disagree if you like. I’m writing this before doing all the math so I don’t even know where this is going.) That looks like about 291 million KWh (or… that’s just 291 GWh, right?)
I read global energy usage is estimated at 25,500 TWh, and check my math that works out to about 1/87,000th of the world’s annual electricity consumption. Kinda a lot for a single game, but it’s pretty popular.
But the ask is how that compares to video cards and… let’s be honest this is going to be a very slippery, fudge-y number. I was quoted 1.5 million daily players (and I see other sources report up to 30 million which is really wide, but lets go with the lower number). So the question is, how long do they play on average, and how much power do their video cards use? I see estimates of 6-10 hours per week and 8-10 hours per week. Let’s make it really easy and assume 7 hours per week or 1 hour per day.
I have a pretty low end video card, but it’s probably still comparable to or better than some of the devices connecting to fortnight. I don’t have a better number to use, so I’m going to use 120W. There should be a lot of players higher than that, but also probably a lot of switches and whatnot that are probably lower power. Feel free to disagree.
So 1.5m players x 1 hour per day = 120MWh x 365 = 43.8GWh.
By these numbers the AI uses about 6x the power of the GPUs. So there is that. But also I think I have been extremely generous with these numbers everywhere except maybe the video card wattage which I really don’t have any idea how to estimate. Would EA spend 2% expecting to recoup that in revenue? What if it’s 1%? What if it’s .5%? At .5% they are getting pretty close.
Or if the number of daily players is 15 million instead of 1.5, that alone is enough to tip the scale the other way.
And device power is honestly a wild-ass guess. You could tell me the average is 40W or 250W and I’d have no real basis to argue.
If you have any numbers or suggestions to make any of this more accurate, I’m all ears. The current range of numbers would lean toward me being wrong, but my confidence in any of this is low enough that I consider the matter unresolved.
- Comment on Epic’s AI Darth Vader tech is about to be all over Fortnite 2 weeks ago:
You start by saying no, but your elaboration says yes.
Maybe I’m wrong. I don’t think so. shrug
Not sure what else there is to say at this point. AI uses energy. So do lots of things—video cards in this example. My point is really to put things into perspective here. If the number of video cards running Fortnite weren’t cause for worry 3 years ago, why would this use of AI be concerning today?
- Comment on Epic’s AI Darth Vader tech is about to be all over Fortnite 2 weeks ago:
Okay. So, your position is that 6 year olds are going to join Fortnite to spam the funny-man-speak button and because of that AI energy usage will be higher? Okay. Maybe. I’d argue the novelty of AI wears thin really quickly once you interact with it a lot, but I’ll grant you some folks might remain excited by AI beyond reason.
So now they are logging into Fortnite and rather than playing the actual game they are just going to talk to characters? It doesn’t make a lot of sense to me. But once we throw out the other commenter’s numbers and suppose it’s not 7 generations to equal 30 minutes of play, maybe it’s 20. Maybe it’s 40. Maybe it’s 100. I honestly don’t know. But we’re definitely in the realm where I think betting the video card uses more energy than the AI for a given player (and all video cards use more energy than AI for all given players) is a perfectly reasonable position to take.
I bet that is the case. I don’t know it. I can’t prove it right or wrong without actual numbers. But based on my ability to generate images and text locally on a shit video card, I am sticking with my bet.
- Comment on Epic’s AI Darth Vader tech is about to be all over Fortnite 2 weeks ago:
And they used 1.4 million video cards. The scale is a wash. And yes, when it’s brand new folks are going to sit there for a bit appreciating how cool it is to talk to Darth Vader. And then he’s going to say some stupid out-of-character stuff, and the novelty is going to wear off, and the AI usage is going to go down, but the video card usage will stay the same.
- Comment on Epic’s AI Darth Vader tech is about to be all over Fortnite 2 weeks ago:
What I said was I’ll bet one person uses more power running the game than the AI uses to respond to them. Just that.
Then you started inventing scenarios and moving goalposts to comparing one single video card to an entire data center. I guess because you didn’t want to let my statement go unchallenged, but you had nothing solid to back you up. You’re the one that posted 6500 joules, which you supported, and I appreciate that, but after that it’s all just supposition and guesses.
You’re right that it’s almost certainly higher than that. But I can generate text and images on my home PC. Not at the quality and speed of OpenAI or whatever they have on the back-end, but it can be done on my 1660. So my suggestion that running a 3D game consumes more power than generating a few lines seems pretty reasonable.
But I know someone who works for a company that has an A100 used for serving AI. I’ll ask and see if he has more information or even a better-educated guess than I do, and if I find out I’m wrong, I won’t suggest otherwise in the future.
- Comment on Epic’s AI Darth Vader tech is about to be all over Fortnite 3 weeks ago:
We know that most of the closed source models are way more complicated, so let’s say they take 3 times the cost to generate a response.
This is completely arbitrary and supposition. Is it 3x “regular” response? I have no idea. How do you even arrive at that guess? Is a more complex prompt exponential more expensive? Linearly? Logarithmically? And how complex are we talking when system prompts themselves can be 10k tokens?
Generating an AI voice to speak the lines increases that energy cost exponentially. MIT found that generating a grainy, five-second video at 8 frames per second on an open source model took about 109,000 joules
Why did you go from voice gen to video gen? I mean I don’t know whether video gen takes more joules or not but there’s no actual connection here. You just decided that a line of audio gen is equivalent to 40 genres of video. What if they generate the text and then use conventional voice synthesizers? And what does that have to do with video gen?
If these estimates are close
Who even knows, mate? You’ve been completely fucking arbitrary and, shocker, your analysis supports your supposition, kinda. How many Vader lines are you going to get in 30 minutes? When it’s brand new probably a lot, but after the luster wears off?
I’m not even telling you you’re wrong, just that your methodology here is complete fucking bullshit.
It could be as low as 6500 joules (based on your statement) which changes the calculus to 60 lines per half hour. Is it that low? Probably not, but that is every bit as valid as your math and I’m even using your numbers without double checking you.
At the end of the day maybe I lose the bet. Fair. I’ve been wondering for a bit how they actually stack up, and I’m willing to be shown. But I suspect using it for piddly shit day to day is a drop in the bucket compared to all the mass corporate spam. Bit I’m aware it’s nothing but a hypothesis and I’m willing to be proven wrong. But not based on this.
- Comment on Epic’s AI Darth Vader tech is about to be all over Fortnite 3 weeks ago:
In going to bet your video card uses more energy than the AI while you play the game.
- Comment on Airbuddy 🦛 3 weeks ago:
Sorry, mate. I dropped this.
#!/usr/bin/env bash
- Comment on Self-Driving Tesla Fails School Bus Test, Hitting Child-Size Dummies… Meanwhile, Robo-Taxis Hit the Road in 2 Weeks. 3 weeks ago:
A sad reality is that a lot of the time when money is on the line people have to be hurt or even die before anything happens. Every regulation came from too many people being hurt by their absence. And we’ve rolled them back so now people are going to have to pay that human cost all over again in order to learn the lessons we already knew.
- Comment on Airbuddy 🦛 3 weeks ago:
#Yo dawg.
#I heard you like comments.
#So I prefix every line with a hashtag so I can comment my comment while I comment.
exit 1
- Comment on The future of web development is AI. Get on or get left behind. 3 weeks ago:
My intuition would be to just let it go and enjoy the hilarity and let it correct itself. Sometimes the conversation the title creates is more interesting than the conversation about the article itself.
- Comment on Google is Using AI to Censor Independent Websites 3 weeks ago:
I did view the site. My contention is that Google has changed the required SEO strategy, which this site is still working on figuring out. There have been similar complaints every time there has been a significant algorithm change. This one is just being blamed on AI. Maybe fairly, maybe not.
- Comment on Google is Using AI to Censor Independent Websites 3 weeks ago:
I know this is about hating on AI, but this seems like a typical company relying on SEO tricks to drive traffic to their site so they can display ads hates when the SEO algorithm changes.
Good news: I’m already starting to see SEO experts giving advice on how to get cited by AI to drive traffic to your site, and for the first time the advice I’m seeing has more to do with providing quality content that answers the kinds of questions people tend to ask about your business domain.
I recognize the problems AI is bringing to search on both ends. AI generated content is making the already bad signal-to-noise ratio on the internet much worse. And now AI is going to grab the knowledge content of your website, present it to users with at most a reference link, and the person who invested the time and effort to create the content is cut out. That’s a big problem.
But I think this begs the question of whether search was any good before. It wasn’t. It isn’t. And to a large degree, all of the SEO bullshit is the reason why, although also the fact that every single site has to make money on ads to justify it’s existence is also ruining fucking everything. Journalism is all click-bait. Reviews are all advertising and referral links.
This is a nuanced issue, but it really doesn’t matter whether AI wins or loses because the internet is going to continue to get worse. I miss the days of low-bandwidth forcing efficient website design. No bloated 500kb Javascript frameworks. No ad-sense tracking you everywhere you go. I’ll grant you that the internet is prettier now, but that’s really not going to matter if everything winds up presented by AI anyway.
I’m really hopeful that federation continues to grow and bandwidth and storage costs can allow a simple hobbyist to maintain a site/node for minimal cost while contributing to the greater ecosystem. Smaller communities where reputation actually matters instead of being gamified into upvotes and downvotes as some sort of facsimile of trustworthiness. I think with a more personal internet, AI becomes less of a threat anyway.
- Comment on get back, swine! 4 weeks ago:
“Calm down or you’re fucking dinner.”
“It’s cool. I’m chill.”
- Comment on Software engineer lost his $150K-a-year job to AI—he’s been rejected from 800 jobs and forced to DoorDash and live in a trailer to make ends meet 5 weeks ago:
I respect what you’re saying, and while I agree with you—as you say yourself, he’s not being replaced by AI like that article states. And that was as far as I was trying to go. It’s not even impossible that he’s a good developer who got fired by an idiot who bought into AI hype, but that’s not my first guess, you know?
That’s all I was saying. I largely agree with your points. I don’t think we are really in opposition here, you’re just coming at it from a different perspective than I contemplated in that comment.
Cheers.
- Comment on Software engineer lost his $150K-a-year job to AI—he’s been rejected from 800 jobs and forced to DoorDash and live in a trailer to make ends meet 5 weeks ago:
I also have a job in that neighborhood and I could not be replaced by AI. I’m sympathetic to him in the sense that this is a shitty time to be looking for work for a number of reasons, but it seems in the realm of possibility that this guy is a shitty developer who made bank of the fact that for a while companies were desperate for anyone to increase IT headcount, and now finds himself unable to compete with the shitty output of AI.
I’ve 100% worked with developers worse than AI, but not many and if it were up to me they would be retrained into some other career where they can make more of a contribution.
You want to blame it on AI CTS scanning? Yep. Totally believable. AI generated technical questions? Sure.
But because AI is coding circles around you? Bruh…
- Comment on Lies, Damned Lies, and LLMs: AI is a Con 1 month ago:
It’s too dumb to try and trick you. It’s responding to being called out the way people tend to because that’s what it’s emulating. And yeah, that’s not great.
All I can say is AI has wasted my time and saved me time. And in my case, more of the latter than the former.
- Comment on Lies, Damned Lies, and LLMs: AI is a Con 1 month ago:
AI can be useful without being right about everything. But the user has to know enough to push back or just write it themselves when necessary. And in my experience the same is true when pairing with another developer, too.
It’s a tool, not a solution. Though it’s valid to say the folks touting its miracle capabilities are full of shit. It is imperfect, but it’s not worthless. It’s not a con man, it’s just confidently wrong. I’ve worked with/for a lot of people like that.
- Comment on AI hallucinations are getting worse – and they're here to stay 1 month ago:
Most of us have no use for quantum computers. That’s a government/research thing. I have no idea what the next disruptive technology will be. They are working hard on AGI, which has the potential to be genuinely disruptive and world changing, but LLMs are not the path to get there and I have no idea whether they are anywhere close to achieving it.
- Comment on Open source AI models favor men for hiring, study finds 1 month ago:
Of course. It’s an analogy. It is like someone who means well. It generates text from the default perspective, which is white guy with a bunch of effort to make it more diverse with a similar end result. The responses might sound woke but take a closer look and you’ll find the underlying bias.
- Comment on Open source AI models favor men for hiring, study finds 1 month ago:
Has nothing to do with guilt-complex. Why would I feel guilty for being privileged? I feel fortunate, and obliged to remain aware of that.
Treating AI like a “program,” however, is a pretty useless lead in to what you really posted to say.
- Comment on Open source AI models favor men for hiring, study finds 1 month ago:
I think researchers are trying to make AI models more aware, but they are trained on a whole lot of human history, and that is going to be predominantly told from white male perspectives. Which means AI is going to act like that.
Women and people of color, you should probably treat AI like it’s that white guy who means well and thinks he’s woke but lacks the self-awareness to see he is 100% part of the problem. (I say this as a white guy who is 100% part of the problem, just hopefully with more self-awareness.)
- Comment on 100% all natural hand-drawn comic 1 month ago:
I did like 4 different edits of that url and every time it started at 0. Just tested and it was right. Welp…