the electricity bill for each query – to power the servers and their chillers – would still make running these giant models very expensive.
This assumes there won’t be radical advances in cost-effective hardware to run the queries.
AI proponents work precisely towards such advances: hardware tailored to running the best performing models, at far lower costs than current GPUs and GPU derivates.
Something like “execute in RAM” neural network accelerators, could reduce query costs by several orders of magnitude.
The fraud of the cryptocurrency bubble was far more pervasive than the fraud in the dotcom bubble, so much so that without the fraud, there’s almost nothing left.
Ironically, what the crypto bubble left behind, was a surplus of GPUs, which got repurposed for AI… and just like crypto left GPUs to move onto purpose-built ASICs and other models like PoS instead of PoW, so does AI need to leave GPUs and move onto purpose-built hardware with better models (quantized NNs are a good example).
As a tangent, we could talk about how the gaming industry has enabled a GPU industry that in turn has enabled these off-shots.
JoMomma@lemm.ee 7 months ago
A very dumb bubble that will pop and leave companies scrambling to be certified “AI Free” to gain customers and employees
Godort@lemm.ee 7 months ago
So far, the only thing AI has shown to be pretty good at is summerizing a large amount of data, and even then it cant be fully trusted to not make mistakes.
h3ndrik@feddit.de 7 months ago
Hmm, I think summarization is a bad example. I’ve read quite some summaries that miss the point, sum up to the point where the simplification makes it wrong or the AI added things or paraphrased and made things at least ambiguous. Even with the state of the art tech. Especially if the original texts were condensed or written by professionals. Like scientific papers or good news articles…
What I think works better are tasks like translating text. That works really well. Sometimes things like rewording text. Or the style-transfer the image generators can do. Restoring old photos, coloring them or editing something in/out. I also like the creativity they provide me with. They can come up with ideas, flesh out my ideas.
I think AI is an useful tool for tasks like that. But not so much for summarization or handling factual information. I don’t see a reason why further research coudn’t improve on that… But at the current state it’s just the wrong choice of tools.
MxM111@kbin.social 7 months ago
AI is a tool, and one need to learn using it. But even today, just two years from introduction to the public (LLMs) it has lot's of uses. This is one of the fastest adaptation of nearly any technology.
vfosnar@beehaw.org 7 months ago
The same way companies advertise they are certified to be “Privacy respecting”, right? right?
aard@kyu.de 7 months ago
A problem of this bubble is that it is making AI synonymous with LLM - and when it goes down will burn other more sensibly forms of AI.