Open Menu
AllLocalCommunitiesAbout
lotide
AllLocalCommunitiesAbout
Login

99% of My Website Traffic Is Bots: A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what's working now.

⁨103⁩ ⁨likes⁩

Submitted ⁨⁨2⁩ ⁨days⁩ ago⁩ by ⁨alyaza@beehaw.org⁩ to ⁨technology@beehaw.org⁩

https://patronview.com/news/99-percent-of-my-website-traffic-is-bots/

source

Comments

Sort:hotnewtop
  • adespoton@lemmy.ca ⁨1⁩ ⁨day⁩ ago

    I tried to read that. Then I tried skimming for the actual content. I found some, but eventually gave up. Claude can definitely tell a long-winded story.

    source
    • Cris_Citrus@piefed.zip ⁨1⁩ ⁨day⁩ ago

      Nothing about this reads as ai generated to me. Just seems like someone explaining the struggles they’ve had with their site being scraped, and what they’ve tried in response

      Seems like exactly what it says on the tin if you ask me 🤷🏻‍♂️

      source
      • XLE@piefed.social ⁨1⁩ ⁨day⁩ ago

        Nothing?

        Image

        I see three-armed robots.

        source
        • -> View More Comments
  • moldy_rice@piefed.keyboardvagabond.com ⁨1⁩ ⁨day⁩ ago

    I’m one of your human visitors who isn’t counted as a human because I don’t have use JavaScript btw

    source
  • somegeek@programming.dev ⁨20⁩ ⁨hours⁩ ago

    What have we gotten into

    source