Open Menu
AllLocalCommunitiesAbout
lotide
AllLocalCommunitiesAbout
Login

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

⁨85⁩ ⁨likes⁩

Submitted ⁨⁨2⁩ ⁨days⁩ ago⁩ by ⁨misk@piefed.social⁩ to ⁨technology@lemmy.zip⁩

https://blog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/

source

Comments

Sort:hotnewtop
  • count_dongulus@lemmy.world ⁨2⁩ ⁨days⁩ ago

    Good job Cloudflare

    source
  • friend_of_satan@lemmy.world ⁨1⁩ ⁨day⁩ ago

    I am shocked, shocked to discover an AI company breaking the social contract and behaving badly.

    source
  • BrikoX@lemmy.zip ⁨1⁩ ⁨day⁩ ago

    Ignoring the self-promo part of the article, Cloudflare is in big part responsible for all of this. Their home page promotes mostly “AI” tools, they are even offering “pay-per-crawl” to make it a viable business model.

    So while you correctly shit on Perplexity, don’t forget that Cloudflare is even worse enemy and not a friend.

    source
  • AlecSadler@lemmy.blahaj.zone ⁨1⁩ ⁨day⁩ ago

    Canceled my Perplexity subscription (that I got for free…lol) after their last shitty scandal.

    Fuck this company.

    source