Linux 软件免费装
当前标签:
ai crawlers
插件图标
See which AI crawlers request pages on your site, choose what each one is told, and check whether it took any notice.
插件图标
See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot) visit your site — and make your content visible to them with schema + llms.txt.
插件图标
Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium editions.
插件图标
Block, limit, or allow AI crawlers, search bots, and scrapers by category — with rate limiting and robots.txt generation.
插件图标
See which AI crawlers visit your site and which pages they've never fetched, control their access, and publish llms.txt. No external requests.
插件图标
Get your site found and cited by AI answer engines — simply. Control which AI assistants can appear or train, and publish an llms.txt.
插件图标
llms.txt + AI-readiness scanner for WordPress: get found by ChatGPT & Claude, manage AI crawlers in robots.txt, fix failures in one click.
插件图标
AI SEO for WordPress: see which AI crawlers read your site, push changes to Bing with IndexNow, and apply the SEO fixes you approve.
插件图标
Writes your SEO tags, checks every page of your site, and measures what AI crawlers can actually read. Nothing locked, no account needed.
插件图标
Control GPTBot, ClaudeBot and PerplexityBot in robots.txt, get alerts when AI search gets blocked, audit posts for AI answers, and manage llms.txt.
插件图标
Markdown for AI crawlers: a clean .md version of every page, a dynamic llms.txt, and a log of which AI bots actually read them.
插件图标
AI visibility for WooCommerce: check AI crawler access, score products for ChatGPT, build a Shopping feed, see when ChatGPT and AI Overviews cite you.
插件图标
See what search engines and AI crawlers find on your site: titles, meta, H1, schema, sitemap, GPTBot access and llms.txt. No account needed.
插件图标
Stop AI companies scraping your posts to train their chatbots. Block AI crawlers, state your terms, and switch off the AI inside WordPress.
插件图标
Block 30+ AI crawlers in your robots.txt, including GPTBot, ClaudeBot and CCBot, and choose exactly which bots get in.
插件图标
Monitor AI crawlers and MCP traffic, inventory agents and tools, control access, and improve AI visibility with llms.txt, Visibility Score, and readiness checks.
插件图标
Logs every request and tells you what it really is: a person, a search engine, an AI crawler, your own cache, or an attack.