editing your robots.txt file with article site manager ®
Most beginning website owners don't even know what a robots.txt file is or why they should use it! Fortunately we know the difference using one can do for a website. Each ASM site comes with a valid robots.txt file that is also set to disallow a lot of the 'bad bots' our there (email scrapers etc) as well being set up to keep spiders and bots out of the folders on your site that shouldn't be indexed.
In the administration panel we have also included an editor that allows you to quickly and easily add or remove lines from your robots.txt file and then rewrites the file back to the server. For those that don't fully understand what the commands in a robots.txt file do we have also included a handy link to the official robots.txt web page.
