robot.txt

[Mike]

Here is the robot.txt file I use on all of my vbulletin sites. Most of the search engines will obey it. There are some that do not.