MistralAI-Training
MistralAI-Training is blocked by 86 sites in the October 2026 survey, or 1.4% of readable files. The community reference lists its operator as Mistral AI.
Who runs MistralAI-Training?
| Fact | MistralAI-Training reference entry |
|---|---|
| Operator | “Mistral AI” |
| Purpose | “AI Data Scrapers” |
| Does MistralAI-Training obey robots.txt? | “Yes” |
| Frequency | “No information provided.” |
| Cloudflare managed list for MistralAI-Training | No |
These facts quote the stored community ai.robots.txt reference.
“MistralAI-Training crawls web content to build training datasets. Documented by Mistral at https://docs.mistral.ai/robots/”
This entry is classed as a crawler collecting data for AI. A site can welcome a page fetch prompted by a person while declining the collection of that text to build future models.
How many sites block it?
Our readable sample has 86 whole-site blocks, 1.4% of 6,171 files, with Disallow: / as the instruction. Of that full sample, 70 name this crawler, or 1.1%. The count without a whole-site block is 6,085.
Across Tranco’s top 1,000 ranks, there were 552 readable files. Among them, 1 file carry the name, or 0.2%, with 2 files blocking the whole site. The leading sites have a lower block share, 0.4%. Farther down, 84 of 5,619 files record a block, 1.5% of that group.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| MistralAI-Training, all ranks | 70 | 1.1% | 86 | 1.4% |
| MistralAI-Training, top 1,000 | 1 | 0.2% | 2 | 0.4% |
| MistralAI-Training, remaining ranks | 69 | 1.2% | 84 | 1.5% |
This is a count of blocks attached to the named crawler, covering the whole site. Blanket rules for every crawler do not enter it. Of 86 blocks, 17 do not also appear in our count of files naming it. We found 69 files naming it and blocking the whole site, along with 1 file naming it without that ban. Another 6,101 files omit the name. We ignore capitalization and repeated names.
How to block or allow it
These lines go in robots.txt at the root. User-agent: * yields to a group naming MistralAI-Training under the robots.txt standard.
Block the whole site
User-agent: MistralAI-Training
Disallow: /
Allow access
User-agent: MistralAI-Training
Allow: /It's the 86th most-named crawler of the 171 we counted in the crawler index.
Which other crawlers does this operator run?
How we counted
For MistralAI-Training, we surveyed Tranco’s top 10,000 sites on 19 October 2026. A request timed out after 8 seconds, with files capped at 262,144 bytes. Missing, unreachable and oversized files do not contribute to these shares. scripts/robots_2026_08_06.py (robots.py at app commit 07104ff) parsed both initial and repeat readings. See the full survey method.
Common questions
What does naming this crawler tell me?
We found 1 file without a whole-site ban among 70 that name it.
Are leading sites different?
Leading files record 0.2% with the name and 0.4% blocking it. Across all readable files, the corresponding shares are 1.1% and 1.4%.
How does the nearby crawler compare?
WRTNBot is named by 70 files and blocked by 68, or 1.1%. For this crawler, 70 files name it and 86 block it, a 1.4% share.