Skip to main content
Website Audit shows what AI crawlers read on your site. It counts AI crawlers only. Search bots such as Googlebot are left out so the picture reflects AI systems.

What AI crawlers read on your site

The header card shows:
  • AI crawler visits in the selected period.
  • Pages read: distinct paths requested by AI crawlers.
  • Most-read page type and its share of visits.
Next to it, a status pill summarises the latest AI access check:

Page type breakdown

A bar chart of AI crawler visits by page type. It shows whether AI systems spend their time on your product and pricing pages or elsewhere.

Pages table

The most-crawled pages first. Click a path to open its rows in the Request log.
If an important page never appears here, check it isn’t disallowed in robots.txt, isn’t missing from your sitemap, and isn’t returning errors on AI Crawlers → Crawl errors.