Cloudflare shares results of a pilot with OpenAI: signals from about 1% of its network helped ChatGPT search discover and index hundreds of millions of new pages
A CDN is now feeding AI search signals about which pages are new or changed, shifting how sites get found by AI.
// Key points
- The pilot began in July 2026 with a cohort of about 1% of Cloudflare’s network and helped OpenAI discover and index hundreds of millions of new pages.
- Signals filter out missing, redirecting and duplicate pages and indicate when a page is worth revisiting; harmful pages can be flagged individually instead of penalizing a whole domain.
- OpenAI independently ranks how those pages appear in ChatGPT; the research uses web metadata, not page content for model training.
- A signal doesn’t grant access, and site owners can still manage AI access with Cloudflare’s AI Crawl Control; the next phase will improve page selection and test faster change signals.
Builder's takeWith PandaClaws, what I care about most is how quickly published content becomes findable; this shows AI search indexing bypassing the classic sitemap and reading change signals from the CDN. If your site sits behind Cloudflare, check in AI Crawl Control that your policy for OpenAI’s crawler is what you intend; content sites should cut duplicate pages and pointless redirects, which directly hurt discovery.
// Background · from #OpenAI
Full timeline →- Oct 16 Codex CLI 0.163.0 lets you steer mid-response, runs read-only tools in parallel and checks network permission before DNS lookups
- Oct 13 Amazon Bedrock serves GPT-6 Sol and GPT-6 Luna through global cross-Region inference from five Asia Pacific Regions, and GPT-6 Astra from Singapore
- Oct 11 GPT-6.1 Sol gets an Ultrafast mode in the Responses API at six times the standard price