Bots like Brew.

Brew doesn't like bots.

From the BSD Cafe's reverse proxy:

if ($http_user_agent ~* (bytespider)) {

return 403;

}

if ($http_user_agent ~* (AhrefsBot)) {

return 444;

}

if ($http_user_agent ~* (Amazonbot)) {

return 444;

}

#BSDCafeStatus #BSDCafeServices #StopScrapingTheBSDCafe

Reply to this note

Please Login to reply.

Discussion

You have to block them at the firewall level. They don't always obey