Bad bots

[Thomas Groman]

On Wed, 9 Jun 2021 13:35:27 +0500
Anna “CyberTailor” <cyber@sysrq.in> wrote:

> Who owns a crawler running on IP 140.82.24.154?
> 
> It doesn't respect robots.txt and makes requests too fast. I had to
> ban this IP with a firewall rule.
> 
> This thread is open for complaints on other bad behaving bots.

how about just putting rate limiting into your server?

-- 
 _______________________________________ 
/  Against his wishes, a math teacher's \
| classroom was remodeled. Ever since,  |
| he's been talking about the good old  |
| dais. His students planted a small    |
| orchard in his honor; the trees all   |
\ have square roots.                    /
 --------------------------------------- 
\
 \
   /\   /\   
  //\\_//\\     ____
  \_     _/    /   /
   / * * \    /^^^]
   \_\O/_/    [   ]
    /   \_    [   /
    \     \_  /  /
     [ [ /  \/ _/
    _[ [ \  /_/