> ## Documentation Index
> Fetch the complete documentation index at: https://docs.rankraft.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Page type methodology

> How every crawled URL is classified into a page type.

Every path an AI crawler reads is classified into a page type. That lets you see, for example, whether AI crawlers spend their time on your product pages or on your blog.

## Page types

| Page type | Label in the dashboard |
| - | - |
| `landing_page` | Landing |
| `product_page` | Product |
| `pricing` | Pricing |
| `blog_editorial` | Blog / editorial |
| `docs_support` | Docs / support |
| `brand_about` | Brand / about |
| `ugc_page` | UGC |
| `technical_infra` | Technical |
| `other` | Other |

## How a path is classified

1. The query string and fragment are removed and a trailing slash is dropped.
2. The homepage (`/`) is always **Landing**.
3. The rules below are checked in order, case-insensitively. The first rule that matches wins.
4. Anything that matches no rule is **Other**.

| Order | Type | Matches paths that start with… |
| - | - | - |
| 1 | Technical | `/robots.txt`, `/sitemap*.xml`, `/llms.txt`, `/llms-full.txt`, `/ai.txt`, `/feed`, `/rss`, `/atom`, `/.well-known`, `/api`, `/graphql`, `/wp-json`, `/_next`, `/static`, `/assets` |
| 2 | Technical | Any path ending in a file extension such as `.xml`, `.json`, `.txt`, `.js`, `.css`, `.png`, `.jpg`, `.svg`, `.webp`, `.mp4` or `.pdf` |
| 3 | Pricing | `/pricing`, `/plans`, `/plans-and-pricing`, `/price` |
| 4 | Docs / support | `/docs`, `/documentation`, `/help`, `/support`, `/kb`, `/knowledge-base`, `/faq`, `/guides`, `/manual`, `/reference`, `/developers` |
| 5 | Blog / editorial | `/blog`, `/news`, `/articles`, `/insights`, `/resources`, `/stories`, `/journal`, `/magazine`, `/press`, `/updates`, `/learn`, `/glossary` |
| 6 | Blog / editorial | Date-based paths such as `/2026/10/…` |
| 7 | Product | `/product`, `/products`, `/shop`, `/store`, `/catalog`, `/collections`, `/item`, `/p`, `/features`, `/solutions`, `/integrations`, `/templates`, `/apps` |
| 8 | Brand / about | `/about`, `/about-us`, `/company`, `/team`, `/careers`, `/jobs`, `/contact`, `/our-story`, `/mission`, `/investors`, `/partners` |
| 9 | UGC | `/community`, `/forum`, `/discuss`, `/reviews`, `/comments`, `/questions`, `/answers`, `/u`, `/users`, `/profiles`, `/members` |
| 10 | Landing | `/lp`, `/landing`, `/campaigns`, `/promo`, `/offers`, `/demo`, `/get-started`, `/signup`, `/trial`, `/free-trial`, `/webinars`, `/events` |
| 11 | Other | `/privacy`, `/terms`, `/legal`, `/cookies`, `/login`, `/sign-in`, `/account`, `/cart`, `/checkout`, `/search` |

<Tip>
  AI crawlers fetching `/llms.txt`, `/robots.txt` and your sitemaps show up as **Technical**. Those hits are a useful sign that a crawler is discovering your site's structure.
</Tip>

## Custom rules

If your URLs don't follow these conventions, for example product pages under `/menu/` or `/catalogue/`, contact [hello@rankraft.ai](mailto:hello@rankraft.ai) to add site-specific rules. Custom rules run before the defaults.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.