Would it be possible to add disable blocking yahoo crawler like the google one was added please
I keep getting these :
Time: Sat Dec 13 06:02:41 2008 +0000
IP: 72.30.142.91 (US/United States/llf531125.crawl.yahoo.net)
Hits: 1
Blocked: temporarily for 3600 seconds
Sample of block hits:
Dec 13 06:02:36 ns1 kernel: Firewall: *TCP_IN Blocked* IN=eth0 OUT= MAC=00:15:c5:e6:32:1c:00:d0:02:33:3c:00:08:00 SRC=72.30.142.91 DST= LEN=60 TOS=0x00 PREC=0x00 TTL=56 ID=21226 DF PROTO=TCP SPT=37383 DPT=8000 WINDOW=5840 RES=0x00 SYN URGP=0