Kimi-SearchBot
Kimi-SearchBot is listed as a search crawler, and the community reference lists its operator as Moonshot AI. In October 2026, 18 sites block it, a 0.3% share of readable files.
Who runs Kimi-SearchBot?
| Fact | Kimi-SearchBot reference entry |
|---|---|
| Operator | “Moonshot AI” |
| Purpose | “AI Search Crawlers” |
| Does Kimi-SearchBot obey robots.txt? | “Yes” |
| Frequency | “No information provided.” |
| Cloudflare managed list for Kimi-SearchBot | No |
These facts quote the stored community ai.robots.txt reference.
“Kimi-SearchBot powers Kimi's search features: it analyzes pages for relevance and builds the search index. Documented by Moonshot AI at https://www.kimi.ai/policies/kimi-crawlers”
The listed use here is search. Helping people find a page through search is a different use from using its contents to train a model, so owners may allow those visits separately.
How many sites block it?
Our readable sample has 18 whole-site blocks, 0.3% of 6,171 files, with Disallow: / as the instruction. Of that full sample, 17 name this crawler, or 0.3%. The count without a whole-site block is 6,153.
Breaking out the leading 1,000 sites gives 552 readable files, with 2 naming the crawler, or 0.4%. Whole-site blocking appears in 3 of them. Blocking is more common among the leading sites, at 0.5%. Beyond those ranks, 5,619 files have a blocking total of 15, 0.3% of that sample.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| Kimi-SearchBot, all ranks | 17 | 0.3% | 18 | 0.3% |
| Kimi-SearchBot, top 1,000 | 2 | 0.4% | 3 | 0.5% |
| Kimi-SearchBot, remaining ranks | 15 | 0.3% | 15 | 0.3% |
Only whole-site blocks recorded against this crawler’s name count here. Rules addressed to every crawler are outside this count. Of 18 blocks, 2 do not also appear in our count of files naming it. Names and bans overlap in 16 files. We also found 1 file with a name and no whole-site ban, plus 6,154 files omitting the name. Case changes and repeated spellings are merged.
How to block or allow it
These lines go in robots.txt at the root. User-agent: * yields to a group naming Kimi-SearchBot under the robots.txt standard.
Block the whole site
User-agent: Kimi-SearchBot
Disallow: /Allow access
User-agent: Kimi-SearchBot
Allow: /It's the 158th most-named crawler of the 171 we counted in the crawler index.
Which other crawlers does this operator run?
How we counted
For Kimi-SearchBot, we surveyed Tranco’s top 10,000 sites on 19 October 2026. Each file had 8 seconds to arrive, up to 262,144 bytes. Missing, unreachable and oversized files do not contribute to these shares. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
What does naming this crawler tell me?
A name identifies the crawler addressed by a group. The survey found 1 file with that name and no recorded whole-site ban, out of 17.
Are leading sites different?
For naming rules, 0.4% of the leading sample mentions it, compared with 0.3% overall. Whole-site blocking is 0.5% at leading ranks and 0.3% across the full sample.
How does the nearby crawler compare?
For comparison, YiBot has 17 files naming it and 16 blocks, or 0.3%. Our counts for this entry are 17 files with the name and 18 blocking the whole site, or 0.3%.