Page type methodology - RankRaft AI Knowledge Base

Every path an AI crawler reads is classified into a page type. That lets you see, for example, whether AI crawlers spend their time on your product pages or on your blog.

Page types

Page type	Label in the dashboard
`landing_page`	Landing
`product_page`	Product
`pricing`	Pricing
`blog_editorial`	Blog / editorial
`docs_support`	Docs / support
`brand_about`	Brand / about
`ugc_page`	UGC
`technical_infra`	Technical
`other`	Other

How a path is classified

The query string and fragment are removed and a trailing slash is dropped.
The homepage (/) is always Landing.
The rules below are checked in order, case-insensitively. The first rule that matches wins.
Anything that matches no rule is Other.

Order	Type	Matches paths that start with…
1	Technical	`/robots.txt`, `/sitemap*.xml`, `/llms.txt`, `/llms-full.txt`, `/ai.txt`, `/feed`, `/rss`, `/atom`, `/.well-known`, `/api`, `/graphql`, `/wp-json`, `/_next`, `/static`, `/assets`
2	Technical	Any path ending in a file extension such as `.xml`, `.json`, `.txt`, `.js`, `.css`, `.png`, `.jpg`, `.svg`, `.webp`, `.mp4` or `.pdf`
3	Pricing	`/pricing`, `/plans`, `/plans-and-pricing`, `/price`
4	Docs / support	`/docs`, `/documentation`, `/help`, `/support`, `/kb`, `/knowledge-base`, `/faq`, `/guides`, `/manual`, `/reference`, `/developers`
5	Blog / editorial	`/blog`, `/news`, `/articles`, `/insights`, `/resources`, `/stories`, `/journal`, `/magazine`, `/press`, `/updates`, `/learn`, `/glossary`
6	Blog / editorial	Date-based paths such as `/2026/10/…`
7	Product	`/product`, `/products`, `/shop`, `/store`, `/catalog`, `/collections`, `/item`, `/p`, `/features`, `/solutions`, `/integrations`, `/templates`, `/apps`
8	Brand / about	`/about`, `/about-us`, `/company`, `/team`, `/careers`, `/jobs`, `/contact`, `/our-story`, `/mission`, `/investors`, `/partners`
9	UGC	`/community`, `/forum`, `/discuss`, `/reviews`, `/comments`, `/questions`, `/answers`, `/u`, `/users`, `/profiles`, `/members`
10	Landing	`/lp`, `/landing`, `/campaigns`, `/promo`, `/offers`, `/demo`, `/get-started`, `/signup`, `/trial`, `/free-trial`, `/webinars`, `/events`
11	Other	`/privacy`, `/terms`, `/legal`, `/cookies`, `/login`, `/sign-in`, `/account`, `/cart`, `/checkout`, `/search`

AI crawlers fetching /llms.txt, /robots.txt and your sitemaps show up as Technical. Those hits are a useful sign that a crawler is discovering your site’s structure.

Custom rules

If your URLs don’t follow these conventions, for example product pages under /menu/ or /catalogue/, contact [email protected] to add site-specific rules. Custom rules run before the defaults.