MistralAI-Index
MistralAI-Index is listed as a search crawler, and the community reference lists its operator as Mistral AI. In October 2026, 54 sites block it, a 0.9% share of readable files.
Who runs MistralAI-Index?
| Fact | MistralAI-Index reference entry |
|---|---|
| Operator | “Mistral AI” |
| Purpose | “Indexes web content for Mistral AI's search, used to answer questions in Le Chat. Per Mistral, not used for model training.” |
| Does MistralAI-Index obey robots.txt? | “Yes” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for MistralAI-Index | No |
These facts quote the stored community ai.robots.txt reference.
“MistralAI-Index is Mistral AI's indexing crawler. It collects web content for Mistral's search index (the source behind Le Chat's answers). Mistral states the content is not used for generative AI training. Documented at https://docs.mistral.ai/robots”
The listed use here is search. Search referrals or a user’s question can give an owner a reason to allow access while declining collection of page text for training.
How many sites block it?
Our readable sample has 54 whole-site blocks, 0.9% of 6,171 files, with Disallow: / as the instruction. Of that full sample, 43 name this crawler, or 0.7%. The count without a whole-site block is 6,117.
Across Tranco’s top 1,000 ranks, there were 552 readable files. Among them, 3 files carry the name, or 0.5%, with 4 files blocking the whole site. The leading sites have a lower block share, 0.7%. Farther down, 50 of 5,619 files record a block, 0.9% of that group.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| MistralAI-Index, all ranks | 43 | 0.7% | 54 | 0.9% |
| MistralAI-Index, top 1,000 | 3 | 0.5% | 4 | 0.7% |
| MistralAI-Index, remaining ranks | 40 | 0.7% | 50 | 0.9% |
For this entry, we counted whole-site bans attached to its own name, leaving general rules for all crawlers out of the total. Of 54 blocks, 16 do not also appear in our count of files naming it. Names and bans overlap in 38 files. We also found 5 files with a name and no whole-site ban, plus 6,128 files omitting the name. Case changes and repeated spellings are merged.
How to block or allow it
Edit the root robots.txt file on your site. The robots.txt standard gives a MistralAI-Index group precedence over User-agent: * for this crawler.
Block the whole site
User-agent: MistralAI-Index
Disallow: /Allow access
User-agent: MistralAI-Index
Allow: /It's the 126th most-named crawler of the 171 we counted in the crawler index.
Which other crawlers does this operator run?
How we counted
For MistralAI-Index, we surveyed Tranco’s top 10,000 sites on 19 October 2026. Each file had 8 seconds to arrive, up to 262,144 bytes. Missing, unreachable and oversized files do not contribute to these shares. Parsing includes files read again, through scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
What does naming this crawler tell me?
A name identifies the crawler addressed by a group. The survey found 5 files with that name and no recorded whole-site ban, out of 43.
Are leading sites different?
At the top of the ranking, 0.5% of readable files name it and 0.7% block it. Across all ranks, those shares are 0.7% and 0.9%.
How does the nearby crawler compare?
ExaSearchBot is named by 42 files and blocked by 40, or 0.6%. For this crawler, 43 files name it and 54 block it, a 0.9% share.