开发者 |
daanverbaan
uisce |
---|---|
更新时间 | 2024年9月18日 19:34 |
捐献地址: | 去捐款 |
PHP版本: | 7.4 及以上 |
WordPress版本: | 6.6.2 |
版权: | GPLv2 or later |
版权网址: | 版权信息 |
robots.txt
file for the most common AI scraping bots.
Note: These instructions are not always respected by all bots.
ai-scrape-protect
folder to the /wp-content/plugins/
directory.The plugin adds specific User-agent
entries to your robots.txt
file that instruct common AI scraping bots not to crawl or scrape your site.
While this plugin adds recommendations to the robots.txt
file, not all bots follow these rules. This is a measure to discourage scraping rather than a foolproof solution.
Currently, the plugin includes a predefined list of bots. If you need to add or remove specific bots, you would need to modify the plugin code or contact the plugin author for customization.
The robots.txt
will be like it was before