More about the Robots.txt Generator tool!
An SEO tool that allows you to generate a Robots.txt file so that you can block search engine crawlers from your site.
A Robots.txt is a text file that is placed in the root directory of a website and can be used to control robots by telling them which areas of the site they should not visit. For example, it can be used to keep the robots away from a development area or other unfinished parts of the site. The file is read by spiders that Google uses to scan sites and is also read by other search engine robots such as Bing and Yahoo.