An AI index for content creators and AI builders

AI Index is a search index for your website. When enabled, Cloudflare automatically creates it for your domain so you can use it to power your own websites search, or make your content available to AI platforms, and get compensated through Pay per crawl.

Unlike traditional search engines for your website that require setup and maintenance, AI Index is created automatically for your domain and made searchable right away. You avoid the complexity of managing infrastructure, while still getting the same core technology that powers our self-configured product, AI Search.

AI Index is created specially for your domain, and it is fully managed and configured by Cloudflare to remove setup complexity. You can also directly monetize access through Pay per crawl.

AI Search is a tool that lets you create search over any of your data, it doesn't have to come from your domain! You can put unstructured data like user manuals, company policies, or your websites content in it, and it also gives you the flexibility to configure the indexing and search pipeline so you can get more customization.

No, AI Index is designed to be simple and accessible. The index is created automatically, and you can manage your settings through a user-friendly dashboard.

AI Index makes it easier for AI builders and platforms to understand and interact with your content. You can directly push updates to these platforms, ensuring they always have the most current version of your site's data.

Yes. Your data remains secure. We give you full control over how your content is indexed and shared, so you can decide what is exposed to AI platforms.

The Pub/Sub web feed is a permissioned feed of the web for AI builders. Instead of blind crawling, you can subscribe to updates directly from sites that opt in to share their AI Index. This gives you structured data in real time.

Please fill out the form on this page and mark your interest. With access to the web feed, you can subscribe to updates from participating sites, discover high-quality content, and retrieve only what you need without blind crawling.