MistralAI-User is a user agent from Mistral AI that visits a web page when a person asks Mistral’s assistant a question. It fetches single pages on request and is not a crawler that sweeps the web on its own.
At a glance
- Operator
- Mistral AI
- Purpose
- User-triggered fetch in the Vibe assistant, not used for training, says Mistral
- robots.txt token
- MistralAI-User
- User agent
- Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0; +https://docs.mistral.ai/robots)
- Respects robots.txt
- robots.txt governs which sites user requests can access, says Mistral
- IP list
- yes, as a JSON file
Last checked:
What is MistralAI-User used for?
Mistral’s documentation describes it as the agent for user actions in Vibe. When users ask Vibe a question, it may visit a web page to help answer. Some third-party pages name Le Chat as the product instead. Mistral says it is not used to crawl the web in any automatic fashion and not to crawl content for generative AI training.
The user agent string is:
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0; +https://docs.mistral.ai/robots)
Mistral publishes the IP addresses in a JSON file.
| Bot | Operator | Purpose | robots.txt token | robots.txt according to the operator | IP list published? |
|---|---|---|---|---|---|
| Google-Extended | Controls Gemini training and grounding (no crawler of its own) | Google-Extended | robots.txt token only; fetching is done by existing Google crawlers | n/a (no user agent of its own) | |
| GPTBot | OpenAI | Training | GPTBot | Disallowing it signals content should not be used to train foundation models | yes (openai.) |
| OAI-SearchBot | OpenAI | Search (ChatGPT) | OAI-SearchBot | opted-out sites are not shown in ChatGPT search answers | yes (openai.) |
| ChatGPT-User | OpenAI | User-triggered fetch | ChatGPT-User | robots.txt rules may not apply, says OpenAI (user-initiated) | yes (openai.) |
| ClaudeBot | Anthropic | Training | ClaudeBot | yes, Anthropic says its bots honor robots.txt | yes (claude.) |
| Claude-SearchBot | Anthropic | Search (Claude) | Claude-SearchBot | yes, Anthropic says its bots honor robots.txt | yes (claude.) |
| PerplexityBot | Perplexity | Search (Perplexity), not used for model training | PerplexityBot | controllable via robots.txt; the docs contain no explicit compliance statement | yes (perplexity.) |
| Applebot-Extended | Apple | Controls AI training (does not crawl, says Apple) | Applebot-Extended | robots.txt token only, applies to content Applebot already crawled | n/a (no crawler of its own) |
| CCBot | Common Crawl | Open web crawl archive | CCBot | can be blocked via robots.txt, says Common Crawl | yes (index.) |
| Meta-ExternalAgent | Meta | Training foundation AI models, improving products | meta-externalagent | can be blocked via robots.txt, says Meta | not stated by the operator |
A selection of ten AI bots from major operators, not a complete list. All values come from each operator's own documentation (as of 8 October 2026). The table does not show whether a bot actually complies with robots.txt; it only reflects what operators state. User agents can be spoofed; published IP lists or reverse DNS identify genuine requests. Sources: OpenAI: Overview of OpenAI Crawlers; Anthropic: Does Anthropic crawl data from the web, and how can site owners block the crawler? (updated 2026-04-07); Perplexity: Perplexity Crawlers; Google: Google's common crawlers (last updated 2026-07-14); Google: Overview of Google crawlers and fetchers (last updated 2026-06-12); Google: Verifying Google crawlers and fetchers (IP range files); Apple: About Applebot (2026-09-04); Meta: Meta Web Crawlers; Common Crawl: CCBot. Last checked: .
How can you control it?
According to Mistral, robots.txt tags control which sites these user requests may access. Blocking the bot can mean the page no longer shows up as a source in the assistant’s answers (an assessment, not a Mistral statement).
Example
User-agent: MistralAI-User
Disallow: /pricing/
The rule blocks /pricing/ for this bot and leaves the rest of the site reachable.
Sources
- Mistral Crawlers (robots) – Mistral AI Docsdocs.mistral.ai
Last updated: