Download Manager from http://guff.szub.net/plugins/

http://en.wikipedia.org/wiki/Category:United_States_patent_law

http://code.google.com/sm_thirdparty.html

http://super8wiki.com/index.php/Google_Sitemaps_from_MediaWiki

http://www.thinklemon.com/wiki/MediaWiki:Google_Sitemaps

http://knowledge.twocell.com/index.php?title=Implementing_Google_Sitemaps_with_Mediawiki

Wikipedia:WikiProject Preclinical Medicine: http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Preclinical_Medicine

http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Clinical_medicine/categorizations

The article “How to Defeat Bad Web Robots With Apache” by Lee Killough (http://www.leekillough.com/robots.html) described various techniques to block bad bots using mod_rewite, robots.txt and ipchains. In my opionion, instead of wasting our server’s CPU and memory to fend off bad bots, the best approach is to use iptables to completely block bad bots (those bad bots are from bad guys, or criminals).

To block a bad guy from 64.92.164.138 (IP address) using iptables:

iptables -I INPUT -s 64.92.164.138 -j DROP

/sbin/service iptables save

iptables -L -n

to check if this guy was blocked permanently,

more /etc/sysconfig/iptables

you will see:

# Generated by iptables-save v1.2.11 on Sun May 20 09:52:30 2007
*filter
:INPUT ACCEPT [0:0]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [8124:8872749]
:RH-Firewall-1-INPUT - [0:0]
-A INPUT -s 194.67.45.197 -j DROP
-A INPUT -s 84.65.163.1 -j DROP
-A INPUT -s 64.92.164.138 -j DROP
-A INPUT -s 81.170.208.83 -j DROP
-A INPUT -s 222.183.106.174 -j DROP
-A INPUT -j RH-Firewall-1-INPUT
-A FORWARD -j RH-Firewall-1-INPUT
-A RH-Firewall-1-INPUT -i lo -j ACCEPT
-A RH-Firewall-1-INPUT -i eth1 -j ACCEPT
-A RH-Firewall-1-INPUT -i eth0 -j ACCEPT
-A RH-Firewall-1-INPUT -p icmp -m icmp --icmp-type any -j ACCEPT
-A RH-Firewall-1-INPUT -p ipv6-crypt -j ACCEPT
-A RH-Firewall-1-INPUT -p ipv6-auth -j ACCEPT
-A RH-Firewall-1-INPUT -m state --state RELATED,ESTABLISHED -j ACCEPT
-A RH-Firewall-1-INPUT -p tcp -m state --state NEW -m tcp --dport 110 -j ACCEPT
-A RH-Firewall-1-INPUT -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT
-A RH-Firewall-1-INPUT -p tcp -m state --state NEW -m tcp --dport 22 -j ACCEPT
-A RH-Firewall-1-INPUT -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT
-A RH-Firewall-1-INPUT -j REJECT --reject-with icmp-host-prohibited
COMMIT

To restart firewall:

service iptables restart

Alternatively, you can try a Perl script from ESupplyMALL, it works great:

http://www.esupplymall.com/index.php?main_page=product_info&cPath=151&products_id=94358

Thefts may be able to steal your web content from Google cache, so you should put these two lines to you html file:

<META NAME="ROBOTS" CONTENT="NOARCHIVE">

<META NAME="GOOGLEBOT" CONTENT="NOARCHIVE">

Ref: http://evolt.org/article/Stopping_Spambots_II_The_Admin_Strikes_Back/18/21392/index.html