AI crawlers / Kimi-Agent

Kimi-Agent

Kimi-Agent has 13 recorded blocks in October 2026, or 0.2%, and 12 files naming it. The community reference lists its operator as Moonshot AI that browses websites while carrying out user-directed research and other tasks.

Who runs Kimi-Agent?

FactKimi-Agent reference entry
Operator“Moonshot AI that browses websites while carrying out user-directed research and other tasks”
Purpose“AI Agents”
Does Kimi-Agent obey robots.txt?“Unclear at this time.”
Frequency“Unclear at this time.”
Cloudflare managed list for Kimi-AgentNo

These facts quote the stored community ai.robots.txt reference.

“Kimi-Agent is a browser-enabled AI agent operated by Moonshot AI that browses websites while carrying out user-directed research and other tasks.”

The reference places this crawler among AI agents. A site can welcome a page fetch prompted by a person while declining the collection of that text to build future models.

How many sites block it?

Instructions to stay out of the whole site appear in 13 files, or 0.2% of 6,171 readable files. We counted 12 with its name in a User-agent line, a 0.2% share. Another 6,158 lack a recorded Disallow: / ban.

For the top 1,000 ranks, its name appears in 1 file out of 552, or 0.2%. Whole-site blocks total 2. Blocking is more common among the leading sites, at 0.4%. Lower in the ranking, blocking reaches 11 files out of 5,619, a 0.2% share.

Readable filesNamed byNamed shareBlocked byBlocked share
Kimi-Agent, all ranks120.2%130.2%
Kimi-Agent, top 1,00010.2%20.4%
Kimi-Agent, remaining ranks110.2%110.2%

Only whole-site blocks recorded against this crawler’s name count here. Rules addressed to every crawler are outside this count. Of 13 blocks, 2 do not also appear in our count of files naming it. Names and bans overlap in 11 files. We also found 1 file with a name and no whole-site ban, plus 6,159 files omitting the name. Case changes and repeated spellings are merged.

How to block or allow it

Use your site’s root file, robots.txt. Specific groups for Kimi-Agent take precedence over User-agent: *, according to the robots.txt standard.

Block the whole site

User-agent: Kimi-Agent
Disallow: /

Allow access

User-agent: Kimi-Agent
Allow: /

It's the 169th most-named crawler of the 171 we counted in the crawler index.

Which other crawlers does this operator run?

How we counted

For Kimi-Agent, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. Requests could run for 8 seconds, with a 262,144-byte file limit. Shares exclude unreachable, unavailable and oversized files. Collection and repeat readings used scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.

Common questions

Does a User-agent line mean it is blocked?

We found 1 file without a whole-site ban among 12 that name it.

What do the top-ranked sites show?

For naming rules, 0.2% of the leading sample mentions it, compared with 0.2% overall. Whole-site blocking is 0.4% at leading ranks and 0.2% across the full sample.

Which nearby entry can I compare?

For comparison, qodercli has 12 files naming it and 11 blocks, or 0.2%. Our counts for this entry are 12 files with the name and 13 blocking the whole site, or 0.2%.