drkt@lemmy.dbzer0.comtoPrivacy@lemmy.ml•How to block AI Crawler Bots using robots.txt file
19·
1 month agoThis is still relying on the bot being nice enough to tell you that it’s a bot; it could just not.
This is still relying on the bot being nice enough to tell you that it’s a bot; it could just not.
Do you have more information about this? I would love to read more.
I generally agree but not everyone can choose where they work. For many people, the choice is starving on the street or work for Evil Corp.