That’s a good point! I forgot about AI companies stealing as much as data as they can..
Comment on Can we estimate the size of the Internet ? If so, what size would it be (in GB, TB or whatever) ?
Ephera@lemmy.ml 4 days ago
Something I always find kind of puts the scale into perspective, is that all these AI companies have a huge interest in storing as much of the internet’s data as possible, because they need access for training and it ensures they continue to have access to relatively high-quality (it’s only going to get worse with more and more content on the internet being generated).
And yet, even with their trillions of investor money, they evidently don’t have it all stored. Because they still regularly hammer all kinds of webpages with an insane number of requests, when they do their trainings.
Buage_@piefed.social 4 days ago
fuckwit_mcbumcrumble@lemmy.dbzer0.com 4 days ago
They’re checking the websites for change. They’re apparently too stupid to tell websites that change often from ones that are more static.
They’re not using it live for training. That’d be far to slow for their training.