Add some directives to your robots.txt file to keep your site safer

Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

SEO Crawlytics helps you gain a better understanding of the behaviour of robots.