Which AI bots should a website allow?
That depends on the business policy. Search crawling, AI training, and user-triggered retrieval are different use cases and should be reviewed separately.
An AI crawler check shows which named bots your robots.txt explicitly allows or blocks, helping you separate search crawling, AI training preferences, and user-triggered retrieval.
Enter any public website URL. The result comes from the live response, not a guessed score or a generic template.
The tool reads the public response and shows what it measured.
Use the free check before deciding whether a full audit is useful.
Move from one signal to a complete SEO, GEO, and AEO audit.
Review explicit robots.txt access rules for major AI and search crawlers.
That depends on the business policy. Search crawling, AI training, and user-triggered retrieval are different use cases and should be reviewed separately.
No. It reports the public rules your site exposes. Each provider decides how its crawlers and products behave.
Check whether robots.txt is reachable, readable, and connected to your sitemap.
Run checkCheck whether a website publishes a reachable, readable llms.txt content index.
Run checkCheck sitemap discovery and validate the XML or text response delivered by your website.
Run check