开发者 | adenergizer |
---|---|
更新时间 | 2024年10月12日 21:04 |
捐献地址: | 去捐款 |
PHP版本: | 7.4.0 及以上 |
WordPress版本: | 6.6 |
版权: | GPLv3 or later |
版权网址: | 版权信息 |
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website. The robots.txt file is part of the the robots exclusion protocol (REP), a group of web standards that regulate how robots crawl the web, access and index content, and serve that content up to users.
It is an IAB (Interactive Advertising Bureau) approved text file that aims to prevent unauthorized inventory sales. Ads.txt is a simple, flexible, and secure method for publishers and distributors to declare who is authorized to sell their inventory, improving transparency for programmatic buyers.
Yes. The purpose of these files is to better describe the content on your website to web bots. These files help web crawlers to index the content and serve that content to users.
Make sure you've enabled the particular file in Adenergizer settings of WordPress admin area. Also, URL rewriting should be allowed.