Search found 1 match

by Brewster
05 May 2013, 11:06
Forum: General Discussion (csf)
Topic: abuse from bots with no user agent string
Replies: 1
Views: 2991

abuse from bots with no user agent string

Anyone got any experience with dealing with aggressive bots with no user agent string? I run a wordpress blog that has had an unknown robot use up 9.03 MB of bandwidth in 46,971 hits. I'm guessing that a bot that doesnt have a user agent string isn't likely to check for a robots.txt, so is there a w...