Endmaker
@Endmaker@ani.social
- Comment on I had never had much interest in food preparation but it's actually kinda interesting 2 days ago:
- Comment on My new laptop chip has an 'AI' processor in it, and it's a complete waste of space 1 week ago:
Someone with the expertise should correct me if I am wrong; it’s been 4-5 years since I learnt about NPUs during my internship so I am very rusty:
You don’t even need a GPU if all you want to do is to run (i.e. perform inference using) a neural network (abbreviating it to NN). Just a CPU would do if the NN is sufficiently lightweight. The GPU is only needed to speed up the training of NNs.
The thing is, the CPU is a general-purpose processor, so it won’t be able run the NN optimally / as efficiently as possible. Imagine you want to do something that requires the NN and as a result, you can’t do anything else on your phone / laptop (it won’t be problem for desktops with GPUs though).
Where NPU really shines is when there are performance constraints on the model: when it has to be fast, lightweight and memory efficient. Use cases include mobile computing and IoT.
In fact, there’s news about live translation on Apple AirPod. I think this may be the perfect scenario for using NPUs - ideally housed within the earphones directly but if not, within a phone.
Disclaimer: I am only familiar with NPUs in the context of “old-school” convolutional neural networks (boy, tech moves so quickly). I am not familiar with NPUs for transformers - and LLMs by extension - but I won’t be surprised if NPUs have been adapted to work with them.
- Comment on My new laptop chip has an 'AI' processor in it, and it's a complete waste of space 1 week ago:
I’m pretty sure most video games require AI already. I have difficulty naming even one that doesn’t use AI.
Neural nets, on the other hand - I find it hard to imagine one running locally without impacting performance.
- Comment on Hmmm... 1 week ago:
They are all fish 🤓
- Comment on what are in you're top 3 favourite games of all time? 1 week ago:
I don’t like it actually but I have over 5k hours in Dota 2.
Average dota 2 experience.
- Comment on what are in you're top 3 favourite games of all time? 1 week ago:
- Singaporean Bridge - It’s basically a crossover of Bridge and Werewolf / Polar Bear / Among Us. That small change of not knowing who your partner is makes for games that are way more fun.
- Pokemon Soulsilver - I love the following mechanic. The other features of the game are really great too.
- Raze 2 - I have seen others describe it as the “Halo of flash games”
- Comment on [deleted] 1 month ago:
Donate some of it to charity.
- Comment on The future is amazing 1 month ago:
peak
- Comment on [deleted] 2 months ago:
I fucking love durians.
- Comment on [deleted] 2 months ago:
Not adding anything of value here; just want to point out your username is based.
- Comment on [deleted] 2 months ago:
The bank knows that:
- these people are able to pay it back
- it is more profitable for bank to continuously lend money to them (by charging interest on the loan)
This is the same reason why some countries and companies are perpetually in debt.
- Comment on [deleted] 3 months ago:
Relevant comic: by SMBC
- Comment on Is it normal to be constantly scared about how your friend will react to anything about you? 3 months ago:
There’s this saying: those who mind don’t matter, and those who matter don’t mind.
- Comment on Nexon announces the official return of old-school MapleStory with Classic World 3 months ago:
It’s a long shot but I hope they make it available on Linux / Mac.
- Comment on I just found out 'Age of War' is on steam 4 months ago:
Having Glorious Morning as the background music is perfect
- Comment on 2025-03-15 Unplanned lemm.ee downtime 5 months ago:
I read somewhere that the perpetuators are likely getting some practice in before attacking their actual targets. Lemmy instances just happened to be unlucky enough to be among the victims chosen for this rehearsal.
- Comment on Whats the green shape in between the three circles ? 5 months ago:
Out of shape
- Comment on Bottom of the Ocean 8 months ago:
A submersible with dead billionaires.
- Comment on Do the ultra-rich consume popular media? 8 months ago:
Among their favorites is “Fallout” – a post-apocalyptic drama based on the video game series of the same name.
I find this incredibly ironic.
- Comment on Do the ultra-rich consume popular media? 8 months ago:
Thanks for pointing it out; edited phrasing.
- Submitted 8 months ago to [deleted] | 49 comments
- Comment on 135.9 Million Reasons Why the Working Class Is So Angry 10 months ago:
- For those companies receiving taxpayer money, layoffs must be voluntary, not compulsory, as is already the case for many white-collar employees.
Companies can simply do a soft layoff by making working conditions worse (e.g. declaring a work-in-office mandate when working-from-home has been the norm)
- Comment on Anon gets pumped up 1 year ago:
