Bots Tracker is a custom-built plugin designed to:
- Detect and log visits from search engine bots and crawlers.
- Store visits in a dedicated database table for analysis.
- Display detailed bot visits inside WordPress Admin (with filters, pagination, and per-URL crawl budget).
- Compare crawl budget between two time ranges (current vs previous period).
Main features:
- Bot Detection & Logging
- Detects various bots (Googlebot, Bingbot, GPTBot, etc.) using User-Agent signatures.
- Saves bot name, visited URL path, IP address, and visit time to a custom database table.
- Admin Dashboard Pages
- Main Report: paginate and filter bot visits, with search by URL, bot name, and date range.
- Crawl Budget by URL: aggregate visits per URL with total hits, unique bots, and first/last visit times.
- Comparative Report: compare total crawl budget between current and previous periods.
- Clean Uninstall
- On plugin deletion, the custom database table and plugin options are removed from WordPress to keep your database clean.
- Settings & Data Management
- Configure how long bot visit logs are stored (data retention in days).
- Enable or disable bot filtering to store only selected bots (e.g., only Googlebot and Bingbot) or to exclude specific bots.
- Run on-demand database optimization for the bot visits table directly from the settings page.
- Manually delete old records using a one-click cleanup tool.
- Automatic cleanup via WP-Cron based on your configured retention period.