Advanced Robots.txt generator offers support for ~300 Robots and Crawlers.
Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites.
Here are some key features of "Advanced Robots.txt Generator Professional":
· Automatic creation of Robots.txt file
· Automatic scanning of local site directories
· Comparison and correction with previously saved Robots.txt projects
· Unlimited number of projects and websites
· Automatic uploading to the web server
· WYSIWYG selection of Robots and file/directory exclusions
· Unlimited combinations for the Robot controls
· Online and offline documentation
· Manual in PDF format
· Unlimited and free customer support
· Free Upgrades for life.
Requirements:
· Internet Explorer so that the popups can be displayed in the Preview Menu window
What's New in This Release: [ read full changelog ]
· WYSIWYG interface
· Updated Robots
· Support for non-local files
· Comparison with previewsly saved robots.txt