dubbel
@dubbel@discuss.tchncs.de
This is a remote user, information on this page may be incomplete. View at Source ↗
- Comment on What are You Working on Wednesday 7 months ago:
It started with a popular mastodon posts on how to block openai crawlers I think, and I’d like to know whether people are actually implementing it.
- Comment on What are You Working on Wednesday 7 months ago:
Private project, not really security related: Crawling robots.txts to gather some statistics on which bots people are most often excluding - weirdly I couldn’t find any recent/regularly updated stats on this.