Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. The software supports 300 robots, works in a WYSWIWYG visual way and comes with full documentation and support.
Log Analyzer will allow you to track spider visits and save log files with information on spider visits, as well as export it into different file formats.