Robots.txt Generator

Robots.txt Generator Tool

Robots.txt Generator Tool is designed to generate text to be placed into a robots.txt file. This file is required on your site if you wish to block any search engines from links and locations that you do not wish it to follow or index. The tool will automatically the text allowing you to copy and paste it into your own text file ready to upload to your own server(s). The file must always be called robots.txt.

How to use this tool

Enter the folders that you want to block from being "spidered" (separated by a comma) select all or tick the relevant search engines you would like to block.