# Disallows identified webcrawlers from scanning site. # A "Disallow: /" would block all scans. User-agent: * Disallow: /spider Disallow: /fpdb Disallow: /crawl Disallow: /WISENutbot Disallow: /65.222.176.123 Disallow: /74.6.87.124 Disallow: /208.64.220.171 Disallow: /65.222.176.123 Disallow: /65.222.176.124 Disallow: /65.222.176.125 Disallow: /217.212.224.140 Disallow: /217.212.224.141 Disallow: /217.212.224.143 Disallow: /217.212.224.144 Disallow: /217.212.224.145 Disallow: /217.212.224.168 Disallow: /217.212.224.169 Disallow: /217.212.224.177 Disallow: /217.212.224.178 # --- Cyveillance's Bots IP Range --- # iptables -A INPUT -s 65.222.176.0/24 -p tcp -j REJECT