The Content Signals Policy is a robots.txt extension that lets a site state what crawlers may do with its content after fetching it. Cloudflare announced it on September 24, 2025.
Which signals are there?
There are three signals, each set to yes or no:
searchcovers building a search index and providing search results, for example returning links and short excerpts.ai-inputcovers inputting content into AI models, for example retrieval augmented generation, grounding or real-time use for generative AI search answers.ai-traincovers training or fine-tuning AI models.
A missing signal means no preference is stated.
How binding are they?
Cloudflare says the signals express preferences and are not technical countermeasures against scraping, and that some companies might ignore them. It recommends combining them with WAF rules and bot management for stronger enforcement. Whether specific search or AI companies evaluate the signals is not documented in the sources read.
For sites using Cloudflare’s managed robots.txt, the blog post gives the defaults as search=yes, ai-train=no, while Cloudflare’s docs list the default line as search=yes, ai-train=no, use=reference.
Example
User-Agent: *
Content-Signal: search=yes, ai-train=no
Allow: /
The site allows classic search and declines training. It states nothing about ai-input.
More on the searchVIU blog
Sources
- Giving users choice with Cloudflare's new Content Signals Policy – Cloudflare Blog (24.09.2025)blog.cloudflare.com
- robots.txt and Content Signals – Cloudflare Docsdevelopers.cloudflare.com
Last updated: