开发者 | lastsplash |
---|---|
更新时间 | 2024年11月11日 01:37 |
PHP版本: | 7.4 及以上 |
WordPress版本: | 6.7 |
版权: | GPLv2 or later |
版权网址: | 版权信息 |
robots.txt
, it blocks common AI crawlers and scrapers, aiming to protect your content from being used in the training of Large Language Models (LLMs).
Features
Blocks AI Crawlers
Includes:
robots.txt
and add the necessary meta tags. No further configuration is required, but you can check the settings page for a full list of blocked crawlers.
Limitations
While this plugin aims to block specified crawlers, it cannot guarantee complete protection against all forms of scraping, as some bots may disregard robots.txt
directives.
Support
For questions or support, please post on the forums or on GitHub.
Unfortunately, no. However, it does tell bots that your site shouldn't be used for future datasets.
The plugin adds directives to the robots.txt
file to tell AI crawlers that they shouldn't index your site. It also adds the noai
meta tag to your site's header to do the same.
I try to keep up with new crawlers and update the block list regularly.
Yes! please share suggestions on the forums or on GitHub.
robots.txt
file on my web server?If you have a physical robots.txt
file on your web server, you won't be able to activate this plugin. The plugin only works when using WordPress' built-in virtual robots.txt
.
robots.txt
?It should in theory. It just appends the directives to the robots.txt
file.
No. Search engines follow different robots.txt
rules.
readme.md
and readme.txt
blueprint.json
for plugin previewrobots.txt