Updated 23-Aug-2026
Scraping bots (AI and otherwise) have increased to the point where they have become virtual denial-of-service attacks. I'm not against AI in general, as I use it in several areas, but those in charge of these bots engage in unconscionable behavior, a kind of *destruction-of-the-commons" phenomena.
Contents
Anti-bot mitigation
Note that sourcehut has moved from Anubis to go-away.
Fail2Ban and Caddy
This is still very useful, and can be used with the latest Caddy web server as well.