- AI opt-out
AI opt-out here means the ways a website can limit how Google's generative search features use its content, which are AI Overviews and AI …
- ai.txt
ai.txt is a proposed file name for a text file in which website operators state how AI systems may use their content.
- Content Signals Policy
The Content Signals Policy is a robots.txt extension that lets a site state what crawlers may do with its content after fetching it.
- EU AI Act
The EU AI Act is Regulation (EU) 2024/1689, the European Union's rules for artificial intelligence.
- Google-Extended
Google-Extended is a robots.txt product token that lets site owners control whether content Google has crawled may be used for training …
- llms-full.txt
llms-full.txt is a file that makes the complete text of a website or documentation available in one Markdown document.
- llms.txt
llms.txt is a proposed Markdown file at the root of a website (/llms.txt) that gives language models and AI agents a short, curated …
- Markdown for LLMs
A Markdown version for LLMs is a second, leaner version of a page in Markdown that AI agents and language models can request instead of …
- TDM reservation
A TDM reservation is a rights holder's declaration that third parties may not use their content for text and data mining (TDM).