开发者 | rhellewellgmailcom |
---|---|
更新时间 | 2024年8月31日 04:24 |
捐献地址: | 去捐款 |
PHP版本: | 7.2 及以上 |
WordPress版本: | 6.6 |
版权: | GPL2 |
版权网址: | 版权信息 |
wp-content/plugins
directoryIt's all automatic, but you can see the current virtual robots.txt settings via the Settings page. This is because the virtual file is automatically created by WordPress when the robots.txt file is requested.
Default settings are: ```
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://yourdomain.com/wp-sitemap.xml
# Added by CellarWeb Chatbot Blocker plugin Version 2.00 (3 Mar 2024) (begin) # Blocks ChatGPT bot scanning
User-agent: GPTBot
Disallow: /
# Blocks Bard bot scanning
User-agent: Bard
Disallow: /
# Blocks Bing bot scanning
User-agent: bingbot-chat/2.0
Disallow: /
# Blocks Common Crawl bot scanning
User-agent: CCBot
Disallow: /
# Blocks omgili bot scanning
User-agent: Omgili
Disallow: /
# Blocks omgilibot bot scanning
User-agent: Omgili Bot
Disallow: /
# Blocks Diffbot bot scanning
User-agent: Diffbot
Disallow: /
# Blocks MJ12bot bot scanning
User-agent: MJ12bot
Disallow: /
# Blocks anthropic-ai bot scanning
User-agent: anthropic-ai
Disallow: /
# Blocks ClaudeBot bot scanning
User-agent: ClaudeBot
Disallow: /
# Blocks FacebookBot bot scanning
User-agent: FacebookBot
Disallow: /
# Blocks Google-Extended bot scanning
User-agent: Google-Extended
Disallow: /
# Blocks SentiBot bot scanning
User-agent: SentiBot
Disallow: /
# Blocks sentibot bot scanning
User-agent: sentibot
Disallow: /
# Added by CellarWeb Chatbot Blocker plugin Version 2.00 (3 Mar 2024) (end)
```
We'll add them to the plugin when we find them. And the latest list will automatically be enabled by the plugin. Use the support pages for the plugin for requests.
We recommend using WP standards to add to your virtual robots.txt file.
Use the URL of www.yoursite.com?robots=1 , replacing 'yoursite.com' with your actual site domain name. There is a link on the Settings, Reading screen under the virtual robots.txt box created by the plugin.
The actual file will override any virtual settings. The screen will show a warning message below the display of the virtual settings if an actual file is found in the site's root folder.
The robots.txt file is used by responsbile bots to scan only the files that you want to be scanned. The plugin adds commands to block the AI bots from scanning your site and using your content. There might be some bots that ignore the robots.txt directives. This is not common, but there is no easy way to block those irresponsible bots.
You could, but they won't be effective. There are better ways to do SEO optimization.