Comment on Microsoft and Reddit Are Fighting About Why Bing’s Crawler Is Blocked on Reddit

<- View Parent
MrSoup@lemmy.zip ⁨2⁩ ⁨months⁩ ago

I doubt Google respects any robots.txt

source
Sort:hotnewtop