Linux 软件免费装
当前标签:
crawler
WordPress
Trick the spambots. Real dynamic JavaScript encryption of your email addresses.
WordPress
This plugin is no longer doing anything useful. Please delete it if you're still using it.
插件图标
BANGNAM WP is plugin all in one for yoursite
WordPress
Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.
插件图标
插件图标
Dynamic Robots.txt plugin will generate robots.txt file for your site. You can edit this file easily from the settings page.
插件图标
The "Advanced Robots.txt Optimizer & Editor" WordPress plugin enhances website functionality, SEO and traffic management by allowing users to customize the Robots.txt file with various features to block search engines, prevent crawling of duplicate content, optimize WooCommerce, add sitemap links, and block SEO tool crawlers to protect website resources, security and privacy.
插件图标
The Crawl Optimization Plugin is designed to help optimize your website’s crawl rate by removing unnecessary links and information from your HTTP headers.
插件图标
HTTP Authentication lets you make a site without letting anyone view it without valid credentials. This can protect the full site or only admin pages.
插件图标
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
插件图标
Add googleoff/googleon HTML comment tags before/after preformatted content and textarea HTML tags.
WordPress
Provides precise Open Graph data to LinkedIn for perfect sharing
WordPress
Project Honey Pot Http:BL allows you to verify IP addresses of clients connecting to your blog against the Project Honey Pot database.
插件图标
Display the results of your Page Modified crawls right within your WordPress Admin.
WordPress
rexCrawler is a regular expression web-crawler plugin. Able to parse websites, save data and show them on pages.
插件图标
Blocks some Feed and Comment resources in order to avoid spam bots
插件图标
Blocks the archive.org bots through the WordPress virtual robots.txt file.
插件图标
Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
插件图标
Keeps you to secure your whole site on the development time and admin pages from the Brute attack.
插件图标
Improve your Website Indexing: On-Page SEO is the No #1 Plugin for allowing website crawling by all Search Engines. As we mentioned at the outset, a little slip-up might keep robots from crawling (significant pieces of) your site. Another option now is available for Whatsapp Chat message and robots.txt auto file genneration and modification. By default, WordPress is not provided robots.txt files, when this plugin is added then automatically added the robots.txt file and check the sitemap.xml file. On-Page SEO is a powerful and easy-to-use plugin that can add Robots.txt files, Whatsapp and User submit post form. Whatsapp chat Button feature to your WordPress website to manage social live chat of your website.