Comment on What are You Working on Wednesday

dubbel@discuss.tchncs.de ⁨1⁩ ⁨year⁩ ago

Private project, not really security related: Crawling robots.txts to gather some statistics on which bots people are most often excluding - weirdly I couldn’t find any recent/regularly updated stats on this.

source
Sort:hotnewtop