Linux 软件免费装
当前标签:
crawlers
WordPress
Block Semalt from crawling your website.
WordPress
Protects e-mail addresses from being found by spam spiders (or any other web crawler).
WordPress
Add some directives to your robots.txt file to keep your site safer
插件图标
Customize your site's robots.txt and include remote content to it
插件图标
Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
WordPress
Pike FIrewall stands for limiting actions to the users that came from anonymous traffic sources, IDS for wordpress and robots verification/monitoring.
WordPress
SEO Crawlytics helps you gain a better understanding of the behaviour of robots.
WordPress
SpiderSquash analyzes client behavior and determines whether or not a client is a legitimate user or a malicious bot.
插件图标
Stop the Spam bot as semalt and buttons-for-website that appear on Google Analytics and have real reports.
WordPress
Simply uses the HTTP_REFERER to determine if it's from 'Semalt', and blocks it with a nice 403 "Unauthorized" response.
插件图标
Protect your rights by reviewing and blocking AI bots from using your content without compensation.
WordPress
This plugin allows you to control �robots� meta tag and �robots.txt� file from the control panel.
插件图标
Tells AI (Artificial Intelligence) companies not to scrap your site for their AI products.
插件图标
Generate a robots.txt to opt out of AI training. Get realtime analytics on the AI agents, crawlers, scrapers, and other bots visiting your website.