I do expect operational savings from this optimization, but my guesstimate would be a 2-5x savings rather than the reported 9x savings when looked at over a fixed time period.
I do expect operational savings from this optimization, but my guesstimate would be a 2-5x savings rather than the reported 9x savings when looked at over a fixed time period.
BCOVertigo@lemmy.world 20 hours ago
I mean if short term GPU supply is the bottleneck it will help that, but if it cooks the GPUs even faster and doesn’t result in less overall compute being done it just lets smaller players with less hardware compete with hyperscalers and may not actually be savings in the long term. The unit economics being negative are still the giant elephant in the room preparing to trample them.