Block AI Crawlers

开发者	lastsplash
更新时间	2024年4月21日 23:56
PHP版本:	5.6 及以上
WordPress版本:	6.5.2
版权:	GPLv2 or later
版权网址:	版权信息

下载

1.0.0 1.1.0 1.2.0 1.2.2

详情介绍:

This plugin will tell AI crawlers not to use your site for their training data. AI crawlers read a site's robots.txt to check for a request not to index. This plugin will send that signal to AI crawlers. It asks the following crawlers not to index your site:

ChatGPT and GPTBot - Crawlers and web browser used by OpenAI
Google Extended - Crawler used for Google's Gemini (formerly Google Bard) AI training
FacebookBot - Crawler used for Facebook's AI training
CommonCrawl - Crawler that compiles datasets used to train AI models
Anthropic AI - Crawler used by Anthropic
Omgili - Crawler used by Omgili for AI training
Bytespider - Crawler used by TikTolk for AI training
Cohere - Crawler used by Cohere AI training
DiffBot - Crawler used by Diffbot for AI training

Experimental Meta Tags The plugin adds the "noai, noimageai" directive to your site's meta tags. These tags tell AI bots not to use your content as part of their data sets. These are experimental and they have not been standardized. Disclaimer Note: While the plugin adds these markers, it is up to the crawlers themeselves to honor these requests.

安装:

Activate the plugin through the 'Plugins' menu in WordPress
Once installed the plugin is automatically activated. There are no user configured settings
You can view more about what crawlers are being blocked at "Settings > Block AI Crawlers"

屏幕截图:

常见问题:

How does this work?

The plugin adds directives to the robots.txt file to tell AI crawlers that they shouldn't index your site. It also adds the noai meta tag to your site's header to do the same.

What if I already have a robots.txt file on my web server?

If you have a physical robots.txt file on your web server, you won't be able to activate this plugin. The plugin only works when using WordPress' built-in virtual robots.txt.

Will this work with other plugins that modify the virtual robots.txt?

It should in theory. It just appends the directives to the robots.txt file.

Will this remove my site from existing data sets?

Unfortunately, no. However, it does tell bots that your site shouldn't be included in the future.

更新日志:

1.3.0

New: Adds settings page showing blocked crawlers
Enhancement: Remove crawler description in robots.txt

1.2.2

Update: Adds deploy from GitHub

1.2.1

Maintenance: Adds deploy from GitHub

1.2.0

Block Cohere crawler
Block DiffBot crawler
Block Anthropic AI crawler
Indicate compatibility w/WordPress 6.5.2

1.1.0

Blocks additional crawlers.

1.0.0 Initial Release.

Block AI Crawlers

标签

下载

详情介绍:

安装:

屏幕截图:

常见问题:

更新日志: