MoonshotBot
MoonshotBot collects content for model training, and the community reference lists its operator as Kimi. Our October 2026 survey found 16 sites blocking it, or 0.3% of the files we could read.
Who runs MoonshotBot?
| Fact | MoonshotBot reference entry |
|---|---|
| Operator | “Kimi” |
| Purpose | “MoonshotBot is a training crawler.” |
| Does MoonshotBot obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for MoonshotBot | No |
These facts quote the stored community ai.robots.txt reference.
“MoonshotBot is a training crawler operated by Kimi. Its job is to read public web pages and feed that content into a machine-learning pipeline that trains future versions of the model.”
Model training is this crawler’s listed use. An owner may allow a search crawler to list a page or an assistant to retrieve it for someone, yet decline to supply the text for training.
How many sites block it?
The name occurs in 16 out of 6,171 readable files, a 0.3% share. Across the full sample, the whole-site Disallow: / block count is 16, or 0.3%. Files without that ban number 6,155.
From the highest 1,000 ranks, 552 files could be read. Its naming count is 1, or 0.2%, and the block count is 1. The leading sites have a lower block share, 0.2%. Compare 15 blocks among the 5,619 readable files below those ranks, or 0.3%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| MoonshotBot, all ranks | 16 | 0.3% | 16 | 0.3% |
| MoonshotBot, top 1,000 | 1 | 0.2% | 1 | 0.2% |
| MoonshotBot, remaining ranks | 15 | 0.3% | 15 | 0.3% |
This is a count of blocks attached to the named crawler, covering the whole site. Blanket rules for every crawler do not enter it. Of 16 blocks, 1 does not also appear in our count of files naming it. The overlap between naming and blocking is 15 files. Naming without a whole-site ban accounts for 1, and 6,155 files never name it. We ignore capitalization and repeated names.
How to block or allow it
These lines go in robots.txt at the root. User-agent: * yields to a group naming MoonshotBot under the robots.txt standard.
Block the whole site
User-agent: MoonshotBot
Disallow: /Allow access
User-agent: MoonshotBot
Allow: /It's the 164th most-named crawler of the 171 we counted in the crawler index.
How we counted
For MoonshotBot, we surveyed Tranco’s top 10,000 sites on 19 October 2026. An 8-second wait or a file over 262,144 bytes ended a read. Missing, unreachable and oversized files do not contribute to these shares. Reading files again used scripts/robots_2026_08_06.py (robots.py at app commit 07104ff) as well. See the full survey method.
Common questions
Does a User-agent line mean it is blocked?
A name identifies the crawler addressed by a group. The survey found 1 file with that name and no recorded whole-site ban, out of 16.
What do the top-ranked sites show?
At the top of the ranking, 0.2% of readable files name it and 0.2% block it. Across all ranks, those shares are 0.3% and 0.3%.
Which nearby entry can I compare?
Trae is named by 16 files and blocked by 15, or 0.2%. For this crawler, 16 files name it and 16 block it, a 0.3% share.