See which AI crawlers request pages on your site, choose what each one is told, and check whether it took any notice.