Track AI Agents and Control Bot Traffic
50% of your traffic is invisible to you. Get realtime insight into the hidden ecosystem of artificial agents crawling, scraping, archiving, and gathering intelligence on your website. Protect your content from unwanted AI training by generating a robots.txt that stays up to date with the latest known bots automatically.
Features
- Keep Your Robots.txt Updated Automatically: Use the API or WordPress plugin to continuously generate a robots.txt that stays up to date with the latest AI agents.
- Protect Your Content From Scraping: Block agents who try to ignore your robots.txt rules. Opt out of LLM training and save server costs.
- Expose Your Hidden Traffic With Agent Analytics: Analyze the activity of AI assistants, scrapers, and other bots swarming across your website in real time.
- Spot Emerging AI Trends: See when people use AI assistants to use your website for them.
- Identify Top Agents and Pages: Find out which autonomous agents visit your website the most, and which pages they're most interested in.
Demos
Links to demos can be found on the
home page.
Further Detail
This plugin connects your website to
Dark Visitors. It uses the Dark Visitors API to connect to your account and provide functionality.
By signing up, you agree to the
Terms of Service and
Privacy Policy.
- Install and activate the Dark Visitors plugin from the WordPress Plugin Directory
- Sign up for Dark Visitors and create a new project for your website.
- Copy your access token from the project's settings page, then paste it into the access token field on the plugin's configuration page.
Your website is now connected to Dark Visitors.