Comment on 99% of My Website Traffic Is Bots: A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what's working now.

<- View Parent
adespoton@lemmy.ca ⁨1⁩ ⁨day⁩ ago

I think you’re still missing something then; the way words are bolded, the way bulleted lists are placed, sentence fragment structure, using actual <h#> structure and using it correctly, the even placement of generated images; it all screams “AI”.

One of the reasons AI uses that type of structure is that it is easy to generate nested context that way in markdown, and then convert directly to HTML, and AI agents talk markdown. In fact, pretty much every long form article I’ve seen generated by AI looks exactly like this, right down to the lack of information density.

There were definitely some places that were human tweaked, but most of this was generated in whole cloth off of the logs the website generated.

source
Sort:hotnewtop