CrawlWatch – AI Bot Insights
| 开发者 | kstmonowar |
|---|---|
| 更新时间 | 2026年9月15日 00:48 |
| PHP版本: | 7.4 及以上 |
| WordPress版本: | 7.1 |
| 版权: | GPLv2 or later |
| 版权网址: | 版权信息 |
详情介绍:
- AI bot hits + which URLs they read
- AI referrals (visitors coming from ChatGPT, Perplexity, Gemini, Claude)
- One-click llms.txt + ai.txt generator
- robots.txt allow/block per AI bot (preview, no code)
- Readiness Score 0-100 with ranked Quick Wins
- 100% free, no upsell. Data stays on your server. IPs are hashed, never stored raw.
安装:
- Upload the plugin folder to
/wp-content/plugins/or install from Plugins > Add New. - Activate through the Plugins screen.
- Go to CrawlWatch in the left menu and follow the 3-step setup.
- Open
yoursite.com/llms.txtto verify (plain permalinks or subdirectory installs: useyoursite.com/?crawlwatch_file=llms.txt).
屏幕截图:
常见问题:
Does this send data outside my site?
No. Everything is stored locally in one table (wp_crawlwatch_logs). IPs are SHA-256 hashed (IPv4 last octet and IPv6 /64 anonymized first). Zero external calls.
Will it slow my site?
No. Normal human visits do zero extra queries. Only detected AI hits do one insert. No CSS/JS on the frontend.
How long are logs kept?
Default 30 days (7/14/30/90/180 selectable). Daily WP-Cron auto-deletes older rows.
Does it work without Yoast/RankMath?
Yes. It only detects whether an SEO plugin is active (for the schema part of the score). No integration needed.
Will blocking a bot hurt my SEO?
Blocking AI training bots (GPTBot, ClaudeBot) does not affect Google search. Never block regular Googlebot — CrawlWatch only manages AI bots, and Google-Extended asks for confirmation first.
Why do I see few or zero hits with a cache plugin?
Tracking runs in PHP. Full-page caches (WP Rocket, LiteSpeed, W3 Total Cache, Cloudflare APO) serve cached pages without running PHP, so those visits are never logged. CrawlWatch shows a notice on its own pages when a known cache is active.
更新日志:
- Packagist distribution (composer.json) + full QA tooling: PHPCS, PHPStan level 5, PHPUnit.
- Grouped-by-bot tab, daily hits trend chart, score breakdown, Content Gaps renamed to AI Readiness.
- Robots preview fallback for subdirectory/plain-permalink installs, Quick Wins link to AI Readiness, CSV formula guard with site-timezone times, page-cache notice + FAQ, uninstall row-count hint.
- Fixes: grouped-stats prepare notice, Reset keeps active tab, compact chart layout, Overview submenu removed.
- Initial release: AI bot + referral tracker (40+ crawlers), Overview dashboard with score + Quick Wins, Bots filter/search/pagination, llms.txt + ai.txt generator (no file writes), robots.txt AI allow/block manager, Settings (retention/privacy/clear logs), 3-step setup wizard. 100% free, local-only, hashed IPs.