Comment on Can we estimate the size of the Internet ? If so, what size would it be (in GB, TB or whatever) ?

Ephera@lemmy.ml ⁨4⁩ ⁨days⁩ ago

Something I always find kind of puts the scale into perspective, is that all these AI companies have a huge interest in storing as much of the internet’s data as possible, because they need access for training and it ensures they continue to have access to relatively high-quality (it’s only going to get worse with more and more content on the internet being generated).

And yet, even with their trillions of investor money, they evidently don’t have it all stored. Because they still regularly hammer all kinds of webpages with an insane number of requests, when they do their trainings.

source
Sort:hotnewtop